Cargando…

Detection of Depression and Suicide Risk Based on Text From Clinical Interviews Using Machine Learning: Possibility of a New Objective Diagnostic Marker

BACKGROUND: Depression and suicide are critical social problems worldwide, but tools to objectively diagnose them are lacking. Therefore, this study aimed to diagnose depression through machine learning and determine whether it is possible to identify groups at high risk of suicide through words spo...

Descripción completa

Detalles Bibliográficos
Autores principales: Shin, Daun, Kim, Kyungdo, Lee, Seung-Bo, Lee, Changwoo, Bae, Ye Seul, Cho, Won Ik, Kim, Min Ji, Hyung Keun Park, C., Chie, Eui Kyu, Kim, Nam Soo, Ahn, Yong Min
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9170939/
https://www.ncbi.nlm.nih.gov/pubmed/35686182
http://dx.doi.org/10.3389/fpsyt.2022.801301
_version_ 1784721545275375616
author Shin, Daun
Kim, Kyungdo
Lee, Seung-Bo
Lee, Changwoo
Bae, Ye Seul
Cho, Won Ik
Kim, Min Ji
Hyung Keun Park, C.
Chie, Eui Kyu
Kim, Nam Soo
Ahn, Yong Min
author_facet Shin, Daun
Kim, Kyungdo
Lee, Seung-Bo
Lee, Changwoo
Bae, Ye Seul
Cho, Won Ik
Kim, Min Ji
Hyung Keun Park, C.
Chie, Eui Kyu
Kim, Nam Soo
Ahn, Yong Min
author_sort Shin, Daun
collection PubMed
description BACKGROUND: Depression and suicide are critical social problems worldwide, but tools to objectively diagnose them are lacking. Therefore, this study aimed to diagnose depression through machine learning and determine whether it is possible to identify groups at high risk of suicide through words spoken by the participants in a semi-structured interview. METHODS: A total of 83 healthy and 83 depressed patients were recruited. All participants were recorded during the Mini-International Neuropsychiatric Interview. Through the suicide risk assessment from the interview items, participants with depression were classified into high-suicide-risk (31 participants) and low-suicide-risk (52 participants) groups. The recording was transcribed into text after only the words uttered by the participant were extracted. In addition, all participants were evaluated for depression, anxiety, suicidal ideation, and impulsivity. The chi-square test and student’s T-test were used to compare clinical variables, and the Naive Bayes classifier was used for the machine learning text model. RESULTS: A total of 21,376 words were extracted from all participants and the model for diagnosing patients with depression based on this text confirmed an area under the curve (AUC) of 0.905, a sensitivity of 0.699, and a specificity of 0.964. In the model that distinguished the two groups using statistically significant demographic variables, the AUC was only 0.761. The DeLong test result (p-value 0.001) confirmed that the text-based classification was superior to the demographic model. When predicting the high-suicide-risk group, the demographics-based AUC was 0.499, while the text-based one was 0.632. However, the AUC of the ensemble model incorporating demographic variables was 0.800. CONCLUSION: The possibility of diagnosing depression using interview text was confirmed; regarding suicide risk, the diagnosis accuracy increased when demographic variables were incorporated. Therefore, participants’ words during an interview show significant potential as an objective and diagnostic marker through machine learning.
format Online
Article
Text
id pubmed-9170939
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-91709392022-06-08 Detection of Depression and Suicide Risk Based on Text From Clinical Interviews Using Machine Learning: Possibility of a New Objective Diagnostic Marker Shin, Daun Kim, Kyungdo Lee, Seung-Bo Lee, Changwoo Bae, Ye Seul Cho, Won Ik Kim, Min Ji Hyung Keun Park, C. Chie, Eui Kyu Kim, Nam Soo Ahn, Yong Min Front Psychiatry Psychiatry BACKGROUND: Depression and suicide are critical social problems worldwide, but tools to objectively diagnose them are lacking. Therefore, this study aimed to diagnose depression through machine learning and determine whether it is possible to identify groups at high risk of suicide through words spoken by the participants in a semi-structured interview. METHODS: A total of 83 healthy and 83 depressed patients were recruited. All participants were recorded during the Mini-International Neuropsychiatric Interview. Through the suicide risk assessment from the interview items, participants with depression were classified into high-suicide-risk (31 participants) and low-suicide-risk (52 participants) groups. The recording was transcribed into text after only the words uttered by the participant were extracted. In addition, all participants were evaluated for depression, anxiety, suicidal ideation, and impulsivity. The chi-square test and student’s T-test were used to compare clinical variables, and the Naive Bayes classifier was used for the machine learning text model. RESULTS: A total of 21,376 words were extracted from all participants and the model for diagnosing patients with depression based on this text confirmed an area under the curve (AUC) of 0.905, a sensitivity of 0.699, and a specificity of 0.964. In the model that distinguished the two groups using statistically significant demographic variables, the AUC was only 0.761. The DeLong test result (p-value 0.001) confirmed that the text-based classification was superior to the demographic model. When predicting the high-suicide-risk group, the demographics-based AUC was 0.499, while the text-based one was 0.632. However, the AUC of the ensemble model incorporating demographic variables was 0.800. CONCLUSION: The possibility of diagnosing depression using interview text was confirmed; regarding suicide risk, the diagnosis accuracy increased when demographic variables were incorporated. Therefore, participants’ words during an interview show significant potential as an objective and diagnostic marker through machine learning. Frontiers Media S.A. 2022-05-24 /pmc/articles/PMC9170939/ /pubmed/35686182 http://dx.doi.org/10.3389/fpsyt.2022.801301 Text en Copyright © 2022 Shin, Kim, Lee, Lee, Bae, Cho, Kim, Hyung Keun Park, Chie, Kim and Ahn. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychiatry
Shin, Daun
Kim, Kyungdo
Lee, Seung-Bo
Lee, Changwoo
Bae, Ye Seul
Cho, Won Ik
Kim, Min Ji
Hyung Keun Park, C.
Chie, Eui Kyu
Kim, Nam Soo
Ahn, Yong Min
Detection of Depression and Suicide Risk Based on Text From Clinical Interviews Using Machine Learning: Possibility of a New Objective Diagnostic Marker
title Detection of Depression and Suicide Risk Based on Text From Clinical Interviews Using Machine Learning: Possibility of a New Objective Diagnostic Marker
title_full Detection of Depression and Suicide Risk Based on Text From Clinical Interviews Using Machine Learning: Possibility of a New Objective Diagnostic Marker
title_fullStr Detection of Depression and Suicide Risk Based on Text From Clinical Interviews Using Machine Learning: Possibility of a New Objective Diagnostic Marker
title_full_unstemmed Detection of Depression and Suicide Risk Based on Text From Clinical Interviews Using Machine Learning: Possibility of a New Objective Diagnostic Marker
title_short Detection of Depression and Suicide Risk Based on Text From Clinical Interviews Using Machine Learning: Possibility of a New Objective Diagnostic Marker
title_sort detection of depression and suicide risk based on text from clinical interviews using machine learning: possibility of a new objective diagnostic marker
topic Psychiatry
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9170939/
https://www.ncbi.nlm.nih.gov/pubmed/35686182
http://dx.doi.org/10.3389/fpsyt.2022.801301
work_keys_str_mv AT shindaun detectionofdepressionandsuicideriskbasedontextfromclinicalinterviewsusingmachinelearningpossibilityofanewobjectivediagnosticmarker
AT kimkyungdo detectionofdepressionandsuicideriskbasedontextfromclinicalinterviewsusingmachinelearningpossibilityofanewobjectivediagnosticmarker
AT leeseungbo detectionofdepressionandsuicideriskbasedontextfromclinicalinterviewsusingmachinelearningpossibilityofanewobjectivediagnosticmarker
AT leechangwoo detectionofdepressionandsuicideriskbasedontextfromclinicalinterviewsusingmachinelearningpossibilityofanewobjectivediagnosticmarker
AT baeyeseul detectionofdepressionandsuicideriskbasedontextfromclinicalinterviewsusingmachinelearningpossibilityofanewobjectivediagnosticmarker
AT chowonik detectionofdepressionandsuicideriskbasedontextfromclinicalinterviewsusingmachinelearningpossibilityofanewobjectivediagnosticmarker
AT kimminji detectionofdepressionandsuicideriskbasedontextfromclinicalinterviewsusingmachinelearningpossibilityofanewobjectivediagnosticmarker
AT hyungkeunparkc detectionofdepressionandsuicideriskbasedontextfromclinicalinterviewsusingmachinelearningpossibilityofanewobjectivediagnosticmarker
AT chieeuikyu detectionofdepressionandsuicideriskbasedontextfromclinicalinterviewsusingmachinelearningpossibilityofanewobjectivediagnosticmarker
AT kimnamsoo detectionofdepressionandsuicideriskbasedontextfromclinicalinterviewsusingmachinelearningpossibilityofanewobjectivediagnosticmarker
AT ahnyongmin detectionofdepressionandsuicideriskbasedontextfromclinicalinterviewsusingmachinelearningpossibilityofanewobjectivediagnosticmarker