Cargando…

Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis

BACKGROUND: Drug-induced long-QT syndrome (diLQTS) is a major concern among patients who are hospitalized, for whom prediction models capable of identifying individualized risk could be useful to guide monitoring. We have previously demonstrated the feasibility of machine learning to predict the ris...

Descripción completa

Detalles Bibliográficos
Autores principales: Simon, Steven T, Trinkley, Katy E, Malone, Daniel C, Rosenberg, Michael Aaron
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9756119/
https://www.ncbi.nlm.nih.gov/pubmed/36454608
http://dx.doi.org/10.2196/42163
_version_ 1784851565265289216
author Simon, Steven T
Trinkley, Katy E
Malone, Daniel C
Rosenberg, Michael Aaron
author_facet Simon, Steven T
Trinkley, Katy E
Malone, Daniel C
Rosenberg, Michael Aaron
author_sort Simon, Steven T
collection PubMed
description BACKGROUND: Drug-induced long-QT syndrome (diLQTS) is a major concern among patients who are hospitalized, for whom prediction models capable of identifying individualized risk could be useful to guide monitoring. We have previously demonstrated the feasibility of machine learning to predict the risk of diLQTS, in which deep learning models provided superior accuracy for risk prediction, although these models were limited by a lack of interpretability. OBJECTIVE: In this investigation, we sought to examine the potential trade-off between interpretability and predictive accuracy with the use of more complex models to identify patients at risk for diLQTS. We planned to compare a deep learning algorithm to predict diLQTS with a more interpretable algorithm based on cluster analysis that would allow medication- and subpopulation-specific evaluation of risk. METHODS: We examined the risk of diLQTS among 35,639 inpatients treated between 2003 and 2018 with at least 1 of 39 medications associated with risk of diLQTS and who had an electrocardiogram in the system performed within 24 hours of medication administration. Predictors included over 22,000 diagnoses and medications at the time of medication administration, with cases of diLQTS defined as a corrected QT interval over 500 milliseconds after treatment with a culprit medication. The interpretable model was developed using cluster analysis (K=4 clusters), and risk was assessed for specific medications and classes of medications. The deep learning model was created using all predictors within a 6-layer neural network, based on previously identified hyperparameters. RESULTS: Among the medications, we found that class III antiarrhythmic medications were associated with increased risk across all clusters, and that in patients who are noncritically ill without cardiovascular disease, propofol was associated with increased risk, whereas ondansetron was associated with decreased risk. Compared with deep learning, the interpretable approach was less accurate (area under the receiver operating characteristic curve: 0.65 vs 0.78), with comparable calibration. CONCLUSIONS: In summary, we found that an interpretable modeling approach was less accurate, but more clinically applicable, than deep learning for the prediction of diLQTS. Future investigations should consider this trade-off in the development of methods for clinical prediction.
format Online
Article
Text
id pubmed-9756119
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-97561192022-12-17 Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis Simon, Steven T Trinkley, Katy E Malone, Daniel C Rosenberg, Michael Aaron J Med Internet Res Original Paper BACKGROUND: Drug-induced long-QT syndrome (diLQTS) is a major concern among patients who are hospitalized, for whom prediction models capable of identifying individualized risk could be useful to guide monitoring. We have previously demonstrated the feasibility of machine learning to predict the risk of diLQTS, in which deep learning models provided superior accuracy for risk prediction, although these models were limited by a lack of interpretability. OBJECTIVE: In this investigation, we sought to examine the potential trade-off between interpretability and predictive accuracy with the use of more complex models to identify patients at risk for diLQTS. We planned to compare a deep learning algorithm to predict diLQTS with a more interpretable algorithm based on cluster analysis that would allow medication- and subpopulation-specific evaluation of risk. METHODS: We examined the risk of diLQTS among 35,639 inpatients treated between 2003 and 2018 with at least 1 of 39 medications associated with risk of diLQTS and who had an electrocardiogram in the system performed within 24 hours of medication administration. Predictors included over 22,000 diagnoses and medications at the time of medication administration, with cases of diLQTS defined as a corrected QT interval over 500 milliseconds after treatment with a culprit medication. The interpretable model was developed using cluster analysis (K=4 clusters), and risk was assessed for specific medications and classes of medications. The deep learning model was created using all predictors within a 6-layer neural network, based on previously identified hyperparameters. RESULTS: Among the medications, we found that class III antiarrhythmic medications were associated with increased risk across all clusters, and that in patients who are noncritically ill without cardiovascular disease, propofol was associated with increased risk, whereas ondansetron was associated with decreased risk. Compared with deep learning, the interpretable approach was less accurate (area under the receiver operating characteristic curve: 0.65 vs 0.78), with comparable calibration. CONCLUSIONS: In summary, we found that an interpretable modeling approach was less accurate, but more clinically applicable, than deep learning for the prediction of diLQTS. Future investigations should consider this trade-off in the development of methods for clinical prediction. JMIR Publications 2022-12-01 /pmc/articles/PMC9756119/ /pubmed/36454608 http://dx.doi.org/10.2196/42163 Text en ©Steven T Simon, Katy E Trinkley, Daniel C Malone, Michael Aaron Rosenberg. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.12.2022. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Simon, Steven T
Trinkley, Katy E
Malone, Daniel C
Rosenberg, Michael Aaron
Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis
title Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis
title_full Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis
title_fullStr Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis
title_full_unstemmed Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis
title_short Interpretable Machine Learning Prediction of Drug-Induced QT Prolongation: Electronic Health Record Analysis
title_sort interpretable machine learning prediction of drug-induced qt prolongation: electronic health record analysis
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9756119/
https://www.ncbi.nlm.nih.gov/pubmed/36454608
http://dx.doi.org/10.2196/42163
work_keys_str_mv AT simonstevent interpretablemachinelearningpredictionofdruginducedqtprolongationelectronichealthrecordanalysis
AT trinkleykatye interpretablemachinelearningpredictionofdruginducedqtprolongationelectronichealthrecordanalysis
AT malonedanielc interpretablemachinelearningpredictionofdruginducedqtprolongationelectronichealthrecordanalysis
AT rosenbergmichaelaaron interpretablemachinelearningpredictionofdruginducedqtprolongationelectronichealthrecordanalysis