Cargando…
Clinical Concept Extraction with Lexical Semantics to Support Automatic Annotation
Extracting clinical concepts, such as problems, diagnosis, and treatment, from unstructured clinical narrative documents enables data-driven approaches such as machine and deep learning to support advanced applications such as clinical decision-support systems, the assessment of disease progression,...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8535468/ https://www.ncbi.nlm.nih.gov/pubmed/34682315 http://dx.doi.org/10.3390/ijerph182010564 |
_version_ | 1784587791497166848 |
---|---|
author | Abbas, Asim Afzal, Muhammad Hussain, Jamil Ali, Taqdir Bilal, Hafiz Syed Muhammad Lee, Sungyoung Jeon, Seokhee |
author_facet | Abbas, Asim Afzal, Muhammad Hussain, Jamil Ali, Taqdir Bilal, Hafiz Syed Muhammad Lee, Sungyoung Jeon, Seokhee |
author_sort | Abbas, Asim |
collection | PubMed |
description | Extracting clinical concepts, such as problems, diagnosis, and treatment, from unstructured clinical narrative documents enables data-driven approaches such as machine and deep learning to support advanced applications such as clinical decision-support systems, the assessment of disease progression, and the intelligent analysis of treatment efficacy. Various tools such as cTAKES, Sophia, MetaMap, and other rules-based approaches and algorithms have been used for automatic concept extraction. Recently, machine- and deep-learning approaches have been used to extract, classify, and accurately annotate terms and phrases. However, the requirement of an annotated dataset, which is labor-intensive, impedes the success of data-driven approaches. A rule-based mechanism could support the process of annotation, but existing rule-based approaches fail to adequately capture contextual, syntactic, and semantic patterns. This study intends to introduce a comprehensive rule-based system that automatically extracts clinical concepts from unstructured narratives with higher accuracy and transparency. The proposed system is a pipelined approach, capable of recognizing clinical concepts of three types, problem, treatment, and test, in the dataset collected from a published repository as a part of the I2b2 challenge 2010. The system’s performance is compared with that of three existing systems: Quick UMLS, BIO-CRF, and the Rules (i2b2) model. Compared to the baseline systems, the average F1-score of 72.94% was found to be 13% better than Quick UMLS, 3% better than BIO CRF, and 30.1% better than the Rules (i2b2) model. Individually, the system performance was noticeably higher for problem-related concepts, with an F1-score of 80.45%, followed by treatment-related concepts and test-related concepts, with F1-scores of 76.06% and 55.3%, respectively. The proposed methodology significantly improves the performance of concept extraction from unstructured clinical narratives by exploiting the linguistic and lexical semantic features. The approach can ease the automatic annotation process of clinical data, which ultimately improves the performance of supervised data-driven applications trained with these data. |
format | Online Article Text |
id | pubmed-8535468 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-85354682021-10-23 Clinical Concept Extraction with Lexical Semantics to Support Automatic Annotation Abbas, Asim Afzal, Muhammad Hussain, Jamil Ali, Taqdir Bilal, Hafiz Syed Muhammad Lee, Sungyoung Jeon, Seokhee Int J Environ Res Public Health Article Extracting clinical concepts, such as problems, diagnosis, and treatment, from unstructured clinical narrative documents enables data-driven approaches such as machine and deep learning to support advanced applications such as clinical decision-support systems, the assessment of disease progression, and the intelligent analysis of treatment efficacy. Various tools such as cTAKES, Sophia, MetaMap, and other rules-based approaches and algorithms have been used for automatic concept extraction. Recently, machine- and deep-learning approaches have been used to extract, classify, and accurately annotate terms and phrases. However, the requirement of an annotated dataset, which is labor-intensive, impedes the success of data-driven approaches. A rule-based mechanism could support the process of annotation, but existing rule-based approaches fail to adequately capture contextual, syntactic, and semantic patterns. This study intends to introduce a comprehensive rule-based system that automatically extracts clinical concepts from unstructured narratives with higher accuracy and transparency. The proposed system is a pipelined approach, capable of recognizing clinical concepts of three types, problem, treatment, and test, in the dataset collected from a published repository as a part of the I2b2 challenge 2010. The system’s performance is compared with that of three existing systems: Quick UMLS, BIO-CRF, and the Rules (i2b2) model. Compared to the baseline systems, the average F1-score of 72.94% was found to be 13% better than Quick UMLS, 3% better than BIO CRF, and 30.1% better than the Rules (i2b2) model. Individually, the system performance was noticeably higher for problem-related concepts, with an F1-score of 80.45%, followed by treatment-related concepts and test-related concepts, with F1-scores of 76.06% and 55.3%, respectively. The proposed methodology significantly improves the performance of concept extraction from unstructured clinical narratives by exploiting the linguistic and lexical semantic features. The approach can ease the automatic annotation process of clinical data, which ultimately improves the performance of supervised data-driven applications trained with these data. MDPI 2021-10-09 /pmc/articles/PMC8535468/ /pubmed/34682315 http://dx.doi.org/10.3390/ijerph182010564 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Abbas, Asim Afzal, Muhammad Hussain, Jamil Ali, Taqdir Bilal, Hafiz Syed Muhammad Lee, Sungyoung Jeon, Seokhee Clinical Concept Extraction with Lexical Semantics to Support Automatic Annotation |
title | Clinical Concept Extraction with Lexical Semantics to Support Automatic Annotation |
title_full | Clinical Concept Extraction with Lexical Semantics to Support Automatic Annotation |
title_fullStr | Clinical Concept Extraction with Lexical Semantics to Support Automatic Annotation |
title_full_unstemmed | Clinical Concept Extraction with Lexical Semantics to Support Automatic Annotation |
title_short | Clinical Concept Extraction with Lexical Semantics to Support Automatic Annotation |
title_sort | clinical concept extraction with lexical semantics to support automatic annotation |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8535468/ https://www.ncbi.nlm.nih.gov/pubmed/34682315 http://dx.doi.org/10.3390/ijerph182010564 |
work_keys_str_mv | AT abbasasim clinicalconceptextractionwithlexicalsemanticstosupportautomaticannotation AT afzalmuhammad clinicalconceptextractionwithlexicalsemanticstosupportautomaticannotation AT hussainjamil clinicalconceptextractionwithlexicalsemanticstosupportautomaticannotation AT alitaqdir clinicalconceptextractionwithlexicalsemanticstosupportautomaticannotation AT bilalhafizsyedmuhammad clinicalconceptextractionwithlexicalsemanticstosupportautomaticannotation AT leesungyoung clinicalconceptextractionwithlexicalsemanticstosupportautomaticannotation AT jeonseokhee clinicalconceptextractionwithlexicalsemanticstosupportautomaticannotation |