Cargando…

Novel Graph-Based Model With Biaffine Attention for Family History Extraction From Clinical Text: Modeling Study

BACKGROUND: Family history information, including information on family members, side of the family of family members, living status of family members, and observations of family members, plays an important role in disease diagnosis and treatment. Family member information extraction aims to extract...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhan, Kecheng, Peng, Weihua, Xiong, Ying, Fu, Huhao, Chen, Qingcai, Wang, Xiaolong, Tang, Buzhou
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8100876/
https://www.ncbi.nlm.nih.gov/pubmed/33881405
http://dx.doi.org/10.2196/23587
_version_ 1783688872080703488
author Zhan, Kecheng
Peng, Weihua
Xiong, Ying
Fu, Huhao
Chen, Qingcai
Wang, Xiaolong
Tang, Buzhou
author_facet Zhan, Kecheng
Peng, Weihua
Xiong, Ying
Fu, Huhao
Chen, Qingcai
Wang, Xiaolong
Tang, Buzhou
author_sort Zhan, Kecheng
collection PubMed
description BACKGROUND: Family history information, including information on family members, side of the family of family members, living status of family members, and observations of family members, plays an important role in disease diagnosis and treatment. Family member information extraction aims to extract family history information from semistructured/unstructured text in electronic health records (EHRs), which is a challenging task regarding named entity recognition (NER) and relation extraction (RE), where named entities refer to family members, living status, and observations, and relations refer to relations between family members and living status, and relations between family members and observations. OBJECTIVE: This study aimed to introduce the system we developed for the 2019 n2c2/OHNLP track on family history extraction, which can jointly extract entities and relations about family history information from clinical text. METHODS: We proposed a novel graph-based model with biaffine attention for family history extraction from clinical text. In this model, we first designed a graph to represent family history information, that is, representing NER and RE regarding family history in a unified way, and then introduced a biaffine attention mechanism to extract family history information in clinical text. Convolution neural network (CNN)-Bidirectional Long Short Term Memory network (BiLSTM) and Bidirectional Encoder Representation from Transformers (BERT) were used to encode the input sentence, and a biaffine classifier was used to extract family history information. In addition, we developed a postprocessing module to adjust the results. A system based on the proposed method was developed for the 2019 n2c2/OHNLP shared task track on family history information extraction. RESULTS: Our system ranked first in the challenge, and the F1 scores of the best system on the NER subtask and RE subtask were 0.8745 and 0.6810, respectively. After the challenge, we further fine tuned the parameters and improved the F1 scores of the two subtasks to 0.8823 and 0.7048, respectively. CONCLUSIONS: The experimental results showed that the system based on the proposed method can extract family history information from clinical text effectively.
format Online
Article
Text
id pubmed-8100876
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-81008762021-05-07 Novel Graph-Based Model With Biaffine Attention for Family History Extraction From Clinical Text: Modeling Study Zhan, Kecheng Peng, Weihua Xiong, Ying Fu, Huhao Chen, Qingcai Wang, Xiaolong Tang, Buzhou JMIR Med Inform Original Paper BACKGROUND: Family history information, including information on family members, side of the family of family members, living status of family members, and observations of family members, plays an important role in disease diagnosis and treatment. Family member information extraction aims to extract family history information from semistructured/unstructured text in electronic health records (EHRs), which is a challenging task regarding named entity recognition (NER) and relation extraction (RE), where named entities refer to family members, living status, and observations, and relations refer to relations between family members and living status, and relations between family members and observations. OBJECTIVE: This study aimed to introduce the system we developed for the 2019 n2c2/OHNLP track on family history extraction, which can jointly extract entities and relations about family history information from clinical text. METHODS: We proposed a novel graph-based model with biaffine attention for family history extraction from clinical text. In this model, we first designed a graph to represent family history information, that is, representing NER and RE regarding family history in a unified way, and then introduced a biaffine attention mechanism to extract family history information in clinical text. Convolution neural network (CNN)-Bidirectional Long Short Term Memory network (BiLSTM) and Bidirectional Encoder Representation from Transformers (BERT) were used to encode the input sentence, and a biaffine classifier was used to extract family history information. In addition, we developed a postprocessing module to adjust the results. A system based on the proposed method was developed for the 2019 n2c2/OHNLP shared task track on family history information extraction. RESULTS: Our system ranked first in the challenge, and the F1 scores of the best system on the NER subtask and RE subtask were 0.8745 and 0.6810, respectively. After the challenge, we further fine tuned the parameters and improved the F1 scores of the two subtasks to 0.8823 and 0.7048, respectively. CONCLUSIONS: The experimental results showed that the system based on the proposed method can extract family history information from clinical text effectively. JMIR Publications 2021-04-21 /pmc/articles/PMC8100876/ /pubmed/33881405 http://dx.doi.org/10.2196/23587 Text en ©Kecheng Zhan, Weihua Peng, Ying Xiong, Huhao Fu, Qingcai Chen, Xiaolong Wang, Buzhou Tang. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 21.04.2021. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Zhan, Kecheng
Peng, Weihua
Xiong, Ying
Fu, Huhao
Chen, Qingcai
Wang, Xiaolong
Tang, Buzhou
Novel Graph-Based Model With Biaffine Attention for Family History Extraction From Clinical Text: Modeling Study
title Novel Graph-Based Model With Biaffine Attention for Family History Extraction From Clinical Text: Modeling Study
title_full Novel Graph-Based Model With Biaffine Attention for Family History Extraction From Clinical Text: Modeling Study
title_fullStr Novel Graph-Based Model With Biaffine Attention for Family History Extraction From Clinical Text: Modeling Study
title_full_unstemmed Novel Graph-Based Model With Biaffine Attention for Family History Extraction From Clinical Text: Modeling Study
title_short Novel Graph-Based Model With Biaffine Attention for Family History Extraction From Clinical Text: Modeling Study
title_sort novel graph-based model with biaffine attention for family history extraction from clinical text: modeling study
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8100876/
https://www.ncbi.nlm.nih.gov/pubmed/33881405
http://dx.doi.org/10.2196/23587
work_keys_str_mv AT zhankecheng novelgraphbasedmodelwithbiaffineattentionforfamilyhistoryextractionfromclinicaltextmodelingstudy
AT pengweihua novelgraphbasedmodelwithbiaffineattentionforfamilyhistoryextractionfromclinicaltextmodelingstudy
AT xiongying novelgraphbasedmodelwithbiaffineattentionforfamilyhistoryextractionfromclinicaltextmodelingstudy
AT fuhuhao novelgraphbasedmodelwithbiaffineattentionforfamilyhistoryextractionfromclinicaltextmodelingstudy
AT chenqingcai novelgraphbasedmodelwithbiaffineattentionforfamilyhistoryextractionfromclinicaltextmodelingstudy
AT wangxiaolong novelgraphbasedmodelwithbiaffineattentionforfamilyhistoryextractionfromclinicaltextmodelingstudy
AT tangbuzhou novelgraphbasedmodelwithbiaffineattentionforfamilyhistoryextractionfromclinicaltextmodelingstudy