Cargando…

Deep Learning-Based Natural Language Processing for Screening Psychiatric Patients

The introduction of pre-trained language models in natural language processing (NLP) based on deep learning and the availability of electronic health records (EHRs) presents a great opportunity to transfer the “knowledge” learned from data in the general domain to enable the analysis of unstructured...

Descripción completa

Detalles Bibliográficos
Autores principales: Dai, Hong-Jie, Su, Chu-Hsien, Lee, You-Qian, Zhang, You-Chen, Wang, Chen-Kai, Kuo, Chian-Jue, Wu, Chi-Shin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7874001/
https://www.ncbi.nlm.nih.gov/pubmed/33584354
http://dx.doi.org/10.3389/fpsyt.2020.533949
_version_ 1783649496181243904
author Dai, Hong-Jie
Su, Chu-Hsien
Lee, You-Qian
Zhang, You-Chen
Wang, Chen-Kai
Kuo, Chian-Jue
Wu, Chi-Shin
author_facet Dai, Hong-Jie
Su, Chu-Hsien
Lee, You-Qian
Zhang, You-Chen
Wang, Chen-Kai
Kuo, Chian-Jue
Wu, Chi-Shin
author_sort Dai, Hong-Jie
collection PubMed
description The introduction of pre-trained language models in natural language processing (NLP) based on deep learning and the availability of electronic health records (EHRs) presents a great opportunity to transfer the “knowledge” learned from data in the general domain to enable the analysis of unstructured textual data in clinical domains. This study explored the feasibility of applying NLP to a small EHR dataset to investigate the power of transfer learning to facilitate the process of patient screening in psychiatry. A total of 500 patients were randomly selected from a medical center database. Three annotators with clinical experience reviewed the notes to make diagnoses for major/minor depression, bipolar disorder, schizophrenia, and dementia to form a small and highly imbalanced corpus. Several state-of-the-art NLP methods based on deep learning along with pre-trained models based on shallow or deep transfer learning were adapted to develop models to classify the aforementioned diseases. We hypothesized that the models that rely on transferred knowledge would be expected to outperform the models learned from scratch. The experimental results demonstrated that the models with the pre-trained techniques outperformed the models without transferred knowledge by micro-avg. and macro-avg. F-scores of 0.11 and 0.28, respectively. Our results also suggested that the use of the feature dependency strategy to build multi-labeling models instead of problem transformation is superior considering its higher performance and simplicity in the training process.
format Online
Article
Text
id pubmed-7874001
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-78740012021-02-11 Deep Learning-Based Natural Language Processing for Screening Psychiatric Patients Dai, Hong-Jie Su, Chu-Hsien Lee, You-Qian Zhang, You-Chen Wang, Chen-Kai Kuo, Chian-Jue Wu, Chi-Shin Front Psychiatry Psychiatry The introduction of pre-trained language models in natural language processing (NLP) based on deep learning and the availability of electronic health records (EHRs) presents a great opportunity to transfer the “knowledge” learned from data in the general domain to enable the analysis of unstructured textual data in clinical domains. This study explored the feasibility of applying NLP to a small EHR dataset to investigate the power of transfer learning to facilitate the process of patient screening in psychiatry. A total of 500 patients were randomly selected from a medical center database. Three annotators with clinical experience reviewed the notes to make diagnoses for major/minor depression, bipolar disorder, schizophrenia, and dementia to form a small and highly imbalanced corpus. Several state-of-the-art NLP methods based on deep learning along with pre-trained models based on shallow or deep transfer learning were adapted to develop models to classify the aforementioned diseases. We hypothesized that the models that rely on transferred knowledge would be expected to outperform the models learned from scratch. The experimental results demonstrated that the models with the pre-trained techniques outperformed the models without transferred knowledge by micro-avg. and macro-avg. F-scores of 0.11 and 0.28, respectively. Our results also suggested that the use of the feature dependency strategy to build multi-labeling models instead of problem transformation is superior considering its higher performance and simplicity in the training process. Frontiers Media S.A. 2021-01-15 /pmc/articles/PMC7874001/ /pubmed/33584354 http://dx.doi.org/10.3389/fpsyt.2020.533949 Text en Copyright © 2021 Dai, Su, Lee, Zhang, Wang, Kuo and Wu. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychiatry
Dai, Hong-Jie
Su, Chu-Hsien
Lee, You-Qian
Zhang, You-Chen
Wang, Chen-Kai
Kuo, Chian-Jue
Wu, Chi-Shin
Deep Learning-Based Natural Language Processing for Screening Psychiatric Patients
title Deep Learning-Based Natural Language Processing for Screening Psychiatric Patients
title_full Deep Learning-Based Natural Language Processing for Screening Psychiatric Patients
title_fullStr Deep Learning-Based Natural Language Processing for Screening Psychiatric Patients
title_full_unstemmed Deep Learning-Based Natural Language Processing for Screening Psychiatric Patients
title_short Deep Learning-Based Natural Language Processing for Screening Psychiatric Patients
title_sort deep learning-based natural language processing for screening psychiatric patients
topic Psychiatry
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7874001/
https://www.ncbi.nlm.nih.gov/pubmed/33584354
http://dx.doi.org/10.3389/fpsyt.2020.533949
work_keys_str_mv AT daihongjie deeplearningbasednaturallanguageprocessingforscreeningpsychiatricpatients
AT suchuhsien deeplearningbasednaturallanguageprocessingforscreeningpsychiatricpatients
AT leeyouqian deeplearningbasednaturallanguageprocessingforscreeningpsychiatricpatients
AT zhangyouchen deeplearningbasednaturallanguageprocessingforscreeningpsychiatricpatients
AT wangchenkai deeplearningbasednaturallanguageprocessingforscreeningpsychiatricpatients
AT kuochianjue deeplearningbasednaturallanguageprocessingforscreeningpsychiatricpatients
AT wuchishin deeplearningbasednaturallanguageprocessingforscreeningpsychiatricpatients