Cargando…
Implementing Machine Learning Models for Suicide Risk Prediction in Clinical Practice: Focus Group Study With Hospital Providers
BACKGROUND: Interest in developing machine learning models that use electronic health record data to predict patients’ risk of suicidal behavior has recently proliferated. However, whether and how such models might be implemented and useful in clinical practice remain unknown. To ultimately make aut...
Autores principales: | , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8956996/ https://www.ncbi.nlm.nih.gov/pubmed/35275075 http://dx.doi.org/10.2196/30946 |
_version_ | 1784676676578312192 |
---|---|
author | Bentley, Kate H Zuromski, Kelly L Fortgang, Rebecca G Madsen, Emily M Kessler, Daniel Lee, Hyunjoon Nock, Matthew K Reis, Ben Y Castro, Victor M Smoller, Jordan W |
author_facet | Bentley, Kate H Zuromski, Kelly L Fortgang, Rebecca G Madsen, Emily M Kessler, Daniel Lee, Hyunjoon Nock, Matthew K Reis, Ben Y Castro, Victor M Smoller, Jordan W |
author_sort | Bentley, Kate H |
collection | PubMed |
description | BACKGROUND: Interest in developing machine learning models that use electronic health record data to predict patients’ risk of suicidal behavior has recently proliferated. However, whether and how such models might be implemented and useful in clinical practice remain unknown. To ultimately make automated suicide risk–prediction models useful in practice, and thus better prevent patient suicides, it is critical to partner with key stakeholders, including the frontline providers who will be using such tools, at each stage of the implementation process. OBJECTIVE: The aim of this focus group study is to inform ongoing and future efforts to deploy suicide risk–prediction models in clinical practice. The specific goals are to better understand hospital providers’ current practices for assessing and managing suicide risk; determine providers’ perspectives on using automated suicide risk–prediction models in practice; and identify barriers, facilitators, recommendations, and factors to consider. METHODS: We conducted 10 two-hour focus groups with a total of 40 providers from psychiatry, internal medicine and primary care, emergency medicine, and obstetrics and gynecology departments within an urban academic medical center. Audio recordings of open-ended group discussions were transcribed and coded for relevant and recurrent themes by 2 independent study staff members. All coded text was reviewed and discrepancies were resolved in consensus meetings with doctoral-level staff. RESULTS: Although most providers reported using standardized suicide risk assessment tools in their clinical practices, existing tools were commonly described as unhelpful and providers indicated dissatisfaction with current suicide risk assessment methods. Overall, providers’ general attitudes toward the practical use of automated suicide risk–prediction models and corresponding clinical decision support tools were positive. Providers were especially interested in the potential to identify high-risk patients who might be missed by traditional screening methods. Some expressed skepticism about the potential usefulness of these models in routine care; specific barriers included concerns about liability, alert fatigue, and increased demand on the health care system. Key facilitators included presenting specific patient-level features contributing to risk scores, emphasizing changes in risk over time, and developing systematic clinical workflows and provider training. Participants also recommended considering risk-prediction windows, timing of alerts, who will have access to model predictions, and variability across treatment settings. CONCLUSIONS: Providers were dissatisfied with current suicide risk assessment methods and were open to the use of a machine learning–based risk-prediction system to inform clinical decision-making. They also raised multiple concerns about potential barriers to the usefulness of this approach and suggested several possible facilitators. Future efforts in this area will benefit from incorporating systematic qualitative feedback from providers, patients, administrators, and payers on the use of these new approaches in routine care, especially given the complex, sensitive, and unfortunately still stigmatized nature of suicide risk. |
format | Online Article Text |
id | pubmed-8956996 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-89569962022-03-27 Implementing Machine Learning Models for Suicide Risk Prediction in Clinical Practice: Focus Group Study With Hospital Providers Bentley, Kate H Zuromski, Kelly L Fortgang, Rebecca G Madsen, Emily M Kessler, Daniel Lee, Hyunjoon Nock, Matthew K Reis, Ben Y Castro, Victor M Smoller, Jordan W JMIR Form Res Original Paper BACKGROUND: Interest in developing machine learning models that use electronic health record data to predict patients’ risk of suicidal behavior has recently proliferated. However, whether and how such models might be implemented and useful in clinical practice remain unknown. To ultimately make automated suicide risk–prediction models useful in practice, and thus better prevent patient suicides, it is critical to partner with key stakeholders, including the frontline providers who will be using such tools, at each stage of the implementation process. OBJECTIVE: The aim of this focus group study is to inform ongoing and future efforts to deploy suicide risk–prediction models in clinical practice. The specific goals are to better understand hospital providers’ current practices for assessing and managing suicide risk; determine providers’ perspectives on using automated suicide risk–prediction models in practice; and identify barriers, facilitators, recommendations, and factors to consider. METHODS: We conducted 10 two-hour focus groups with a total of 40 providers from psychiatry, internal medicine and primary care, emergency medicine, and obstetrics and gynecology departments within an urban academic medical center. Audio recordings of open-ended group discussions were transcribed and coded for relevant and recurrent themes by 2 independent study staff members. All coded text was reviewed and discrepancies were resolved in consensus meetings with doctoral-level staff. RESULTS: Although most providers reported using standardized suicide risk assessment tools in their clinical practices, existing tools were commonly described as unhelpful and providers indicated dissatisfaction with current suicide risk assessment methods. Overall, providers’ general attitudes toward the practical use of automated suicide risk–prediction models and corresponding clinical decision support tools were positive. Providers were especially interested in the potential to identify high-risk patients who might be missed by traditional screening methods. Some expressed skepticism about the potential usefulness of these models in routine care; specific barriers included concerns about liability, alert fatigue, and increased demand on the health care system. Key facilitators included presenting specific patient-level features contributing to risk scores, emphasizing changes in risk over time, and developing systematic clinical workflows and provider training. Participants also recommended considering risk-prediction windows, timing of alerts, who will have access to model predictions, and variability across treatment settings. CONCLUSIONS: Providers were dissatisfied with current suicide risk assessment methods and were open to the use of a machine learning–based risk-prediction system to inform clinical decision-making. They also raised multiple concerns about potential barriers to the usefulness of this approach and suggested several possible facilitators. Future efforts in this area will benefit from incorporating systematic qualitative feedback from providers, patients, administrators, and payers on the use of these new approaches in routine care, especially given the complex, sensitive, and unfortunately still stigmatized nature of suicide risk. JMIR Publications 2022-03-11 /pmc/articles/PMC8956996/ /pubmed/35275075 http://dx.doi.org/10.2196/30946 Text en ©Kate H Bentley, Kelly L Zuromski, Rebecca G Fortgang, Emily M Madsen, Daniel Kessler, Hyunjoon Lee, Matthew K Nock, Ben Y Reis, Victor M Castro, Jordan W Smoller. Originally published in JMIR Formative Research (https://formative.jmir.org), 11.03.2022. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Bentley, Kate H Zuromski, Kelly L Fortgang, Rebecca G Madsen, Emily M Kessler, Daniel Lee, Hyunjoon Nock, Matthew K Reis, Ben Y Castro, Victor M Smoller, Jordan W Implementing Machine Learning Models for Suicide Risk Prediction in Clinical Practice: Focus Group Study With Hospital Providers |
title | Implementing Machine Learning Models for Suicide Risk Prediction in Clinical Practice: Focus Group Study With Hospital Providers |
title_full | Implementing Machine Learning Models for Suicide Risk Prediction in Clinical Practice: Focus Group Study With Hospital Providers |
title_fullStr | Implementing Machine Learning Models for Suicide Risk Prediction in Clinical Practice: Focus Group Study With Hospital Providers |
title_full_unstemmed | Implementing Machine Learning Models for Suicide Risk Prediction in Clinical Practice: Focus Group Study With Hospital Providers |
title_short | Implementing Machine Learning Models for Suicide Risk Prediction in Clinical Practice: Focus Group Study With Hospital Providers |
title_sort | implementing machine learning models for suicide risk prediction in clinical practice: focus group study with hospital providers |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8956996/ https://www.ncbi.nlm.nih.gov/pubmed/35275075 http://dx.doi.org/10.2196/30946 |
work_keys_str_mv | AT bentleykateh implementingmachinelearningmodelsforsuicideriskpredictioninclinicalpracticefocusgroupstudywithhospitalproviders AT zuromskikellyl implementingmachinelearningmodelsforsuicideriskpredictioninclinicalpracticefocusgroupstudywithhospitalproviders AT fortgangrebeccag implementingmachinelearningmodelsforsuicideriskpredictioninclinicalpracticefocusgroupstudywithhospitalproviders AT madsenemilym implementingmachinelearningmodelsforsuicideriskpredictioninclinicalpracticefocusgroupstudywithhospitalproviders AT kesslerdaniel implementingmachinelearningmodelsforsuicideriskpredictioninclinicalpracticefocusgroupstudywithhospitalproviders AT leehyunjoon implementingmachinelearningmodelsforsuicideriskpredictioninclinicalpracticefocusgroupstudywithhospitalproviders AT nockmatthewk implementingmachinelearningmodelsforsuicideriskpredictioninclinicalpracticefocusgroupstudywithhospitalproviders AT reisbeny implementingmachinelearningmodelsforsuicideriskpredictioninclinicalpracticefocusgroupstudywithhospitalproviders AT castrovictorm implementingmachinelearningmodelsforsuicideriskpredictioninclinicalpracticefocusgroupstudywithhospitalproviders AT smollerjordanw implementingmachinelearningmodelsforsuicideriskpredictioninclinicalpracticefocusgroupstudywithhospitalproviders |