Cargando…

Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality

BACKGROUND: Assessing a patient’s suicide risk is challenging for health professionals because it depends on voluntary disclosure by the patient and often has limited resources. The application of novel machine learning approaches to determine suicide risk has clinical utility. OBJECTIVE: This study...

Descripción completa

Detalles Bibliográficos
Autores principales: Min, Sooyeon, Shin, Daun, Rhee, Sang Jin, Park, C Hyung Keun, Yang, Jeong Hun, Song, Yoojin, Kim, Min Ji, Kim, Kyungdo, Cho, Won Ik, Kwon, Oh Chul, Ahn, Yong Min, Lee, Hyunju
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10131783/
https://www.ncbi.nlm.nih.gov/pubmed/36951913
http://dx.doi.org/10.2196/45456
_version_ 1785031252354531328
author Min, Sooyeon
Shin, Daun
Rhee, Sang Jin
Park, C Hyung Keun
Yang, Jeong Hun
Song, Yoojin
Kim, Min Ji
Kim, Kyungdo
Cho, Won Ik
Kwon, Oh Chul
Ahn, Yong Min
Lee, Hyunju
author_facet Min, Sooyeon
Shin, Daun
Rhee, Sang Jin
Park, C Hyung Keun
Yang, Jeong Hun
Song, Yoojin
Kim, Min Ji
Kim, Kyungdo
Cho, Won Ik
Kwon, Oh Chul
Ahn, Yong Min
Lee, Hyunju
author_sort Min, Sooyeon
collection PubMed
description BACKGROUND: Assessing a patient’s suicide risk is challenging for health professionals because it depends on voluntary disclosure by the patient and often has limited resources. The application of novel machine learning approaches to determine suicide risk has clinical utility. OBJECTIVE: This study aimed to investigate cross-sectional and longitudinal approaches to assess suicidality based on acoustic voice features of psychiatric patients using artificial intelligence. METHODS: We collected 348 voice recordings during clinical interviews of 104 patients diagnosed with mood disorders at baseline and 2, 4, 8, and 12 months after recruitment. Suicidality was assessed using the Beck Scale for Suicidal Ideation and suicidal behavior using the Columbia Suicide Severity Rating Scale. The acoustic features of the voice, including temporal, formal, and spectral features, were extracted from the recordings. A between-person classification model that examines the vocal characteristics of individuals cross sectionally to detect individuals at high risk for suicide and a within-person classification model that detects considerable worsening of suicidality based on changes in acoustic features within an individual were developed and compared. Internal validation was performed using 10-fold cross validation of audio data from baseline to 2-month and external validation was performed using data from 2 to 4 months. RESULTS: A combined set of 12 acoustic features and 3 demographic variables (age, sex, and past suicide attempts) were included in the single-layer artificial neural network for the between-person classification model. Furthermore, 13 acoustic features were included in the extreme gradient boosting machine learning algorithm for the within-person model. The between-person classifier was able to detect high suicidality with 69% accuracy (sensitivity 74%, specificity 62%, area under the receiver operating characteristic curve 0.62), whereas the within-person model was able to predict worsening suicidality over 2 months with 79% accuracy (sensitivity 68%, specificity 84%, area under receiver operating characteristic curve 0.67). The second model showed 62% accuracy in predicting increased suicidality in external sets. CONCLUSIONS: Within-person analysis using changes in acoustic features within an individual is a promising approach to detect increased suicidality. Automated analysis of voice can be used to support the real-time assessment of suicide risk in primary care or telemedicine.
format Online
Article
Text
id pubmed-10131783
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-101317832023-04-27 Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality Min, Sooyeon Shin, Daun Rhee, Sang Jin Park, C Hyung Keun Yang, Jeong Hun Song, Yoojin Kim, Min Ji Kim, Kyungdo Cho, Won Ik Kwon, Oh Chul Ahn, Yong Min Lee, Hyunju J Med Internet Res Original Paper BACKGROUND: Assessing a patient’s suicide risk is challenging for health professionals because it depends on voluntary disclosure by the patient and often has limited resources. The application of novel machine learning approaches to determine suicide risk has clinical utility. OBJECTIVE: This study aimed to investigate cross-sectional and longitudinal approaches to assess suicidality based on acoustic voice features of psychiatric patients using artificial intelligence. METHODS: We collected 348 voice recordings during clinical interviews of 104 patients diagnosed with mood disorders at baseline and 2, 4, 8, and 12 months after recruitment. Suicidality was assessed using the Beck Scale for Suicidal Ideation and suicidal behavior using the Columbia Suicide Severity Rating Scale. The acoustic features of the voice, including temporal, formal, and spectral features, were extracted from the recordings. A between-person classification model that examines the vocal characteristics of individuals cross sectionally to detect individuals at high risk for suicide and a within-person classification model that detects considerable worsening of suicidality based on changes in acoustic features within an individual were developed and compared. Internal validation was performed using 10-fold cross validation of audio data from baseline to 2-month and external validation was performed using data from 2 to 4 months. RESULTS: A combined set of 12 acoustic features and 3 demographic variables (age, sex, and past suicide attempts) were included in the single-layer artificial neural network for the between-person classification model. Furthermore, 13 acoustic features were included in the extreme gradient boosting machine learning algorithm for the within-person model. The between-person classifier was able to detect high suicidality with 69% accuracy (sensitivity 74%, specificity 62%, area under the receiver operating characteristic curve 0.62), whereas the within-person model was able to predict worsening suicidality over 2 months with 79% accuracy (sensitivity 68%, specificity 84%, area under receiver operating characteristic curve 0.67). The second model showed 62% accuracy in predicting increased suicidality in external sets. CONCLUSIONS: Within-person analysis using changes in acoustic features within an individual is a promising approach to detect increased suicidality. Automated analysis of voice can be used to support the real-time assessment of suicide risk in primary care or telemedicine. JMIR Publications 2023-03-23 /pmc/articles/PMC10131783/ /pubmed/36951913 http://dx.doi.org/10.2196/45456 Text en ©Sooyeon Min, Daun Shin, Sang Jin Rhee, C Hyung Keun Park, Jeong Hun Yang, Yoojin Song, Min Ji Kim, Kyungdo Kim, Won Ik Cho, Oh Chul Kwon, Yong Min Ahn, Hyunju Lee. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 23.03.2023. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Min, Sooyeon
Shin, Daun
Rhee, Sang Jin
Park, C Hyung Keun
Yang, Jeong Hun
Song, Yoojin
Kim, Min Ji
Kim, Kyungdo
Cho, Won Ik
Kwon, Oh Chul
Ahn, Yong Min
Lee, Hyunju
Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality
title Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality
title_full Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality
title_fullStr Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality
title_full_unstemmed Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality
title_short Acoustic Analysis of Speech for Screening for Suicide Risk: Machine Learning Classifiers for Between- and Within-Person Evaluation of Suicidality
title_sort acoustic analysis of speech for screening for suicide risk: machine learning classifiers for between- and within-person evaluation of suicidality
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10131783/
https://www.ncbi.nlm.nih.gov/pubmed/36951913
http://dx.doi.org/10.2196/45456
work_keys_str_mv AT minsooyeon acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality
AT shindaun acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality
AT rheesangjin acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality
AT parkchyungkeun acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality
AT yangjeonghun acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality
AT songyoojin acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality
AT kimminji acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality
AT kimkyungdo acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality
AT chowonik acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality
AT kwonohchul acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality
AT ahnyongmin acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality
AT leehyunju acousticanalysisofspeechforscreeningforsuicideriskmachinelearningclassifiersforbetweenandwithinpersonevaluationofsuicidality