Cargando…
Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality
BACKGROUND: Assessing a patient’s suicide risk is challenging for health professionals because it depends on voluntary disclosure by the patient and often has limited resources. The application of novel machine learning approaches to determine suicide risk has clinical utility. OBJECTIVE: This study...
Autores principales: | , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10131783/ https://www.ncbi.nlm.nih.gov/pubmed/36951913 http://dx.doi.org/10.2196/45456 |
_version_ | 1785031252354531328 |
---|---|
author | Min, Sooyeon Shin, Daun Rhee, Sang Jin Park, C Hyung Keun Yang, Jeong Hun Song, Yoojin Kim, Min Ji Kim, Kyungdo Cho, Won Ik Kwon, Oh Chul Ahn, Yong Min Lee, Hyunju |
author_facet | Min, Sooyeon Shin, Daun Rhee, Sang Jin Park, C Hyung Keun Yang, Jeong Hun Song, Yoojin Kim, Min Ji Kim, Kyungdo Cho, Won Ik Kwon, Oh Chul Ahn, Yong Min Lee, Hyunju |
author_sort | Min, Sooyeon |
collection | PubMed |
description | BACKGROUND: Assessing a patient’s suicide risk is challenging for health professionals because it depends on voluntary disclosure by the patient and often has limited resources. The application of novel machine learning approaches to determine suicide risk has clinical utility. OBJECTIVE: This study aimed to investigate cross-sectional and longitudinal approaches to assess suicidality based on acoustic voice features of psychiatric patients using artificial intelligence. METHODS: We collected 348 voice recordings during clinical interviews of 104 patients diagnosed with mood disorders at baseline and 2, 4, 8, and 12 months after recruitment. Suicidality was assessed using the Beck Scale for Suicidal Ideation and suicidal behavior using the Columbia Suicide Severity Rating Scale. The acoustic features of the voice, including temporal, formal, and spectral features, were extracted from the recordings. A between-person classification model that examines the vocal characteristics of individuals cross sectionally to detect individuals at high risk for suicide and a within-person classification model that detects considerable worsening of suicidality based on changes in acoustic features within an individual were developed and compared. Internal validation was performed using 10-fold cross validation of audio data from baseline to 2-month and external validation was performed using data from 2 to 4 months. RESULTS: A combined set of 12 acoustic features and 3 demographic variables (age, sex, and past suicide attempts) were included in the single-layer artificial neural network for the between-person classification model. Furthermore, 13 acoustic features were included in the extreme gradient boosting machine learning algorithm for the within-person model. The between-person classifier was able to detect high suicidality with 69% accuracy (sensitivity 74%, specificity 62%, area under the receiver operating characteristic curve 0.62), whereas the within-person model was able to predict worsening suicidality over 2 months with 79% accuracy (sensitivity 68%, specificity 84%, area under receiver operating characteristic curve 0.67). The second model showed 62% accuracy in predicting increased suicidality in external sets. CONCLUSIONS: Within-person analysis using changes in acoustic features within an individual is a promising approach to detect increased suicidality. Automated analysis of voice can be used to support the real-time assessment of suicide risk in primary care or telemedicine. |
format | Online Article Text |
id | pubmed-10131783 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-101317832023-04-27 Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality Min, Sooyeon Shin, Daun Rhee, Sang Jin Park, C Hyung Keun Yang, Jeong Hun Song, Yoojin Kim, Min Ji Kim, Kyungdo Cho, Won Ik Kwon, Oh Chul Ahn, Yong Min Lee, Hyunju J Med Internet Res Original Paper BACKGROUND: Assessing a patient’s suicide risk is challenging for health professionals because it depends on voluntary disclosure by the patient and often has limited resources. The application of novel machine learning approaches to determine suicide risk has clinical utility. OBJECTIVE: This study aimed to investigate cross-sectional and longitudinal approaches to assess suicidality based on acoustic voice features of psychiatric patients using artificial intelligence. METHODS: We collected 348 voice recordings during clinical interviews of 104 patients diagnosed with mood disorders at baseline and 2, 4, 8, and 12 months after recruitment. Suicidality was assessed using the Beck Scale for Suicidal Ideation and suicidal behavior using the Columbia Suicide Severity Rating Scale. The acoustic features of the voice, including temporal, formal, and spectral features, were extracted from the recordings. A between-person classification model that examines the vocal characteristics of individuals cross sectionally to detect individuals at high risk for suicide and a within-person classification model that detects considerable worsening of suicidality based on changes in acoustic features within an individual were developed and compared. Internal validation was performed using 10-fold cross validation of audio data from baseline to 2-month and external validation was performed using data from 2 to 4 months. RESULTS: A combined set of 12 acoustic features and 3 demographic variables (age, sex, and past suicide attempts) were included in the single-layer artificial neural network for the between-person classification model. Furthermore, 13 acoustic features were included in the extreme gradient boosting machine learning algorithm for the within-person model. The between-person classifier was able to detect high suicidality with 69% accuracy (sensitivity 74%, specificity 62%, area under the receiver operating characteristic curve 0.62), whereas the within-person model was able to predict worsening suicidality over 2 months with 79% accuracy (sensitivity 68%, specificity 84%, area under receiver operating characteristic curve 0.67). The second model showed 62% accuracy in predicting increased suicidality in external sets. CONCLUSIONS: Within-person analysis using changes in acoustic features within an individual is a promising approach to detect increased suicidality. Automated analysis of voice can be used to support the real-time assessment of suicide risk in primary care or telemedicine. JMIR Publications 2023-03-23 /pmc/articles/PMC10131783/ /pubmed/36951913 http://dx.doi.org/10.2196/45456 Text en ©Sooyeon Min, Daun Shin, Sang Jin Rhee, C Hyung Keun Park, Jeong Hun Yang, Yoojin Song, Min Ji Kim, Kyungdo Kim, Won Ik Cho, Oh Chul Kwon, Yong Min Ahn, Hyunju Lee. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 23.03.2023. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Min, Sooyeon Shin, Daun Rhee, Sang Jin Park, C Hyung Keun Yang, Jeong Hun Song, Yoojin Kim, Min Ji Kim, Kyungdo Cho, Won Ik Kwon, Oh Chul Ahn, Yong Min Lee, Hyunju Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality |
title | Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality |
title_full | Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality |
title_fullStr | Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality |
title_full_unstemmed | Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality |
title_short | Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality |
title_sort | acoustic analysis of speech for screening for suicide risk: machine learning classifiers for between- and within-person evaluation of suicidality |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10131783/ https://www.ncbi.nlm.nih.gov/pubmed/36951913 http://dx.doi.org/10.2196/45456 |
work_keys_str_mv | AT minsooyeon acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality AT shindaun acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality AT rheesangjin acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality AT parkchyungkeun acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality AT yangjeonghun acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality AT songyoojin acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality AT kimminji acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality AT kimkyungdo acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality AT chowonik acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality AT kwonohchul acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality AT ahnyongmin acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality AT leehyunju acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality |