Cargando…
Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis
BACKGROUND: Drug-induced long-QT syndrome (diLQTS) is a major concern among patients who are hospitalized, for whom prediction models capable of identifying individualized risk could be useful to guide monitoring. We have previously demonstrated the feasibility of machine learning to predict the ris...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9756119/ https://www.ncbi.nlm.nih.gov/pubmed/36454608 http://dx.doi.org/10.2196/42163 |
_version_ | 1784851565265289216 |
---|---|
author | Simon, Steven T Trinkley, Katy E Malone, Daniel C Rosenberg, Michael Aaron |
author_facet | Simon, Steven T Trinkley, Katy E Malone, Daniel C Rosenberg, Michael Aaron |
author_sort | Simon, Steven T |
collection | PubMed |
description | BACKGROUND: Drug-induced long-QT syndrome (diLQTS) is a major concern among patients who are hospitalized, for whom prediction models capable of identifying individualized risk could be useful to guide monitoring. We have previously demonstrated the feasibility of machine learning to predict the risk of diLQTS, in which deep learning models provided superior accuracy for risk prediction, although these models were limited by a lack of interpretability. OBJECTIVE: In this investigation, we sought to examine the potential trade-off between interpretability and predictive accuracy with the use of more complex models to identify patients at risk for diLQTS. We planned to compare a deep learning algorithm to predict diLQTS with a more interpretable algorithm based on cluster analysis that would allow medication- and subpopulation-specific evaluation of risk. METHODS: We examined the risk of diLQTS among 35,639 inpatients treated between 2003 and 2018 with at least 1 of 39 medications associated with risk of diLQTS and who had an electrocardiogram in the system performed within 24 hours of medication administration. Predictors included over 22,000 diagnoses and medications at the time of medication administration, with cases of diLQTS defined as a corrected QT interval over 500 milliseconds after treatment with a culprit medication. The interpretable model was developed using cluster analysis (K=4 clusters), and risk was assessed for specific medications and classes of medications. The deep learning model was created using all predictors within a 6-layer neural network, based on previously identified hyperparameters. RESULTS: Among the medications, we found that class III antiarrhythmic medications were associated with increased risk across all clusters, and that in patients who are noncritically ill without cardiovascular disease, propofol was associated with increased risk, whereas ondansetron was associated with decreased risk. Compared with deep learning, the interpretable approach was less accurate (area under the receiver operating characteristic curve: 0.65 vs 0.78), with comparable calibration. CONCLUSIONS: In summary, we found that an interpretable modeling approach was less accurate, but more clinically applicable, than deep learning for the prediction of diLQTS. Future investigations should consider this trade-off in the development of methods for clinical prediction. |
format | Online Article Text |
id | pubmed-9756119 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-97561192022-12-17 Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis Simon, Steven T Trinkley, Katy E Malone, Daniel C Rosenberg, Michael Aaron J Med Internet Res Original Paper BACKGROUND: Drug-induced long-QT syndrome (diLQTS) is a major concern among patients who are hospitalized, for whom prediction models capable of identifying individualized risk could be useful to guide monitoring. We have previously demonstrated the feasibility of machine learning to predict the risk of diLQTS, in which deep learning models provided superior accuracy for risk prediction, although these models were limited by a lack of interpretability. OBJECTIVE: In this investigation, we sought to examine the potential trade-off between interpretability and predictive accuracy with the use of more complex models to identify patients at risk for diLQTS. We planned to compare a deep learning algorithm to predict diLQTS with a more interpretable algorithm based on cluster analysis that would allow medication- and subpopulation-specific evaluation of risk. METHODS: We examined the risk of diLQTS among 35,639 inpatients treated between 2003 and 2018 with at least 1 of 39 medications associated with risk of diLQTS and who had an electrocardiogram in the system performed within 24 hours of medication administration. Predictors included over 22,000 diagnoses and medications at the time of medication administration, with cases of diLQTS defined as a corrected QT interval over 500 milliseconds after treatment with a culprit medication. The interpretable model was developed using cluster analysis (K=4 clusters), and risk was assessed for specific medications and classes of medications. The deep learning model was created using all predictors within a 6-layer neural network, based on previously identified hyperparameters. RESULTS: Among the medications, we found that class III antiarrhythmic medications were associated with increased risk across all clusters, and that in patients who are noncritically ill without cardiovascular disease, propofol was associated with increased risk, whereas ondansetron was associated with decreased risk. Compared with deep learning, the interpretable approach was less accurate (area under the receiver operating characteristic curve: 0.65 vs 0.78), with comparable calibration. CONCLUSIONS: In summary, we found that an interpretable modeling approach was less accurate, but more clinically applicable, than deep learning for the prediction of diLQTS. Future investigations should consider this trade-off in the development of methods for clinical prediction. JMIR Publications 2022-12-01 /pmc/articles/PMC9756119/ /pubmed/36454608 http://dx.doi.org/10.2196/42163 Text en ©Steven T Simon, Katy E Trinkley, Daniel C Malone, Michael Aaron Rosenberg. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.12.2022. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Simon, Steven T Trinkley, Katy E Malone, Daniel C Rosenberg, Michael Aaron Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis |
title | Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis |
title_full | Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis |
title_fullStr | Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis |
title_full_unstemmed | Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis |
title_short | Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis |
title_sort | interpretable machine learning prediction of drug-induced qt prolongation: electronic health record analysis |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9756119/ https://www.ncbi.nlm.nih.gov/pubmed/36454608 http://dx.doi.org/10.2196/42163 |
work_keys_str_mv | AT simonstevent interpretablemachinelearningpredictionofdruginducedqtprolongationelectronichealthrecordanalysis AT trinkleykatye interpretablemachinelearningpredictionofdruginducedqtprolongationelectronichealthrecordanalysis AT malonedanielc interpretablemachinelearningpredictionofdruginducedqtprolongationelectronichealthrecordanalysis AT rosenbergmichaelaaron interpretablemachinelearningpredictionofdruginducedqtprolongationelectronichealthrecordanalysis |