Cargando…

rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography

BACKGROUND: Timely diagnosis of structural heart disease improves patient outcomes, yet many remain underdiagnosed. While population screening with echocardiography is impractical, ECG-based prediction models can help target high-risk patients. We developed a novel ECG-based machine learning approac...

Descripción completa

Detalles Bibliográficos
Autores principales: Ulloa-Cerna, Alvaro E., Jing, Linyuan, Pfeifer, John M., Raghunath, Sushravya, Ruhl, Jeffrey A., Rocha, Daniel B., Leader, Joseph B., Zimmerman, Noah, Lee, Greg, Steinhubl, Steven R., Good, Christopher W., Haggerty, Christopher M., Fornwalt, Brandon K., Chen, Ruijun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Lippincott Williams & Wilkins 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9241668/
https://www.ncbi.nlm.nih.gov/pubmed/35533093
http://dx.doi.org/10.1161/CIRCULATIONAHA.121.057869
_version_ 1784737858551021568
author Ulloa-Cerna, Alvaro E.
Jing, Linyuan
Pfeifer, John M.
Raghunath, Sushravya
Ruhl, Jeffrey A.
Rocha, Daniel B.
Leader, Joseph B.
Zimmerman, Noah
Lee, Greg
Steinhubl, Steven R.
Good, Christopher W.
Haggerty, Christopher M.
Fornwalt, Brandon K.
Chen, Ruijun
author_facet Ulloa-Cerna, Alvaro E.
Jing, Linyuan
Pfeifer, John M.
Raghunath, Sushravya
Ruhl, Jeffrey A.
Rocha, Daniel B.
Leader, Joseph B.
Zimmerman, Noah
Lee, Greg
Steinhubl, Steven R.
Good, Christopher W.
Haggerty, Christopher M.
Fornwalt, Brandon K.
Chen, Ruijun
author_sort Ulloa-Cerna, Alvaro E.
collection PubMed
description BACKGROUND: Timely diagnosis of structural heart disease improves patient outcomes, yet many remain underdiagnosed. While population screening with echocardiography is impractical, ECG-based prediction models can help target high-risk patients. We developed a novel ECG-based machine learning approach to predict multiple structural heart conditions, hypothesizing that a composite model would yield higher prevalence and positive predictive values to facilitate meaningful recommendations for echocardiography. METHODS: Using 2 232 130 ECGs linked to electronic health records and echocardiography reports from 484 765 adults between 1984 to 2021, we trained machine learning models to predict the presence or absence of any of 7 echocardiography-confirmed diseases within 1 year. This composite label included the following: moderate or severe valvular disease (aortic/mitral stenosis or regurgitation, tricuspid regurgitation), reduced ejection fraction <50%, or interventricular septal thickness >15 mm. We tested various combinations of input features (demographics, laboratory values, structured ECG data, ECG traces) and evaluated model performance using 5-fold cross-validation, multisite validation trained on 1 site and tested on 10 independent sites, and simulated retrospective deployment trained on pre-2010 data and deployed in 2010. RESULTS: Our composite rECHOmmend model used age, sex, and ECG traces and had a 0.91 area under the receiver operating characteristic curve and a 42% positive predictive value at 90% sensitivity, with a composite label prevalence of 17.9%. Individual disease models had area under the receiver operating characteristic curves from 0.86 to 0.93 and lower positive predictive values from 1% to 31%. Area under the receiver operating characteristic curves for models using different input features ranged from 0.80 to 0.93, increasing with additional features. Multisite validation showed similar results to cross-validation, with an aggregate area under the receiver operating characteristic curve of 0.91 across our independent test set of 10 clinical sites after training on a separate site. Our simulated retrospective deployment showed that for ECGs acquired in patients without preexisting structural heart disease in the year 2010, 11% were classified as high risk and 41% (4.5% of total patients) developed true echocardiography-confirmed disease within 1 year. CONCLUSIONS: An ECG-based machine learning model using a composite end point can identify a high-risk population for having undiagnosed, clinically significant structural heart disease while outperforming single-disease models and improving practical utility with higher positive predictive values. This approach can facilitate targeted screening with echocardiography to improve underdiagnosis of structural heart disease.
format Online
Article
Text
id pubmed-9241668
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Lippincott Williams & Wilkins
record_format MEDLINE/PubMed
spelling pubmed-92416682022-07-01 rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography Ulloa-Cerna, Alvaro E. Jing, Linyuan Pfeifer, John M. Raghunath, Sushravya Ruhl, Jeffrey A. Rocha, Daniel B. Leader, Joseph B. Zimmerman, Noah Lee, Greg Steinhubl, Steven R. Good, Christopher W. Haggerty, Christopher M. Fornwalt, Brandon K. Chen, Ruijun Circulation Original Research Articles BACKGROUND: Timely diagnosis of structural heart disease improves patient outcomes, yet many remain underdiagnosed. While population screening with echocardiography is impractical, ECG-based prediction models can help target high-risk patients. We developed a novel ECG-based machine learning approach to predict multiple structural heart conditions, hypothesizing that a composite model would yield higher prevalence and positive predictive values to facilitate meaningful recommendations for echocardiography. METHODS: Using 2 232 130 ECGs linked to electronic health records and echocardiography reports from 484 765 adults between 1984 to 2021, we trained machine learning models to predict the presence or absence of any of 7 echocardiography-confirmed diseases within 1 year. This composite label included the following: moderate or severe valvular disease (aortic/mitral stenosis or regurgitation, tricuspid regurgitation), reduced ejection fraction <50%, or interventricular septal thickness >15 mm. We tested various combinations of input features (demographics, laboratory values, structured ECG data, ECG traces) and evaluated model performance using 5-fold cross-validation, multisite validation trained on 1 site and tested on 10 independent sites, and simulated retrospective deployment trained on pre-2010 data and deployed in 2010. RESULTS: Our composite rECHOmmend model used age, sex, and ECG traces and had a 0.91 area under the receiver operating characteristic curve and a 42% positive predictive value at 90% sensitivity, with a composite label prevalence of 17.9%. Individual disease models had area under the receiver operating characteristic curves from 0.86 to 0.93 and lower positive predictive values from 1% to 31%. Area under the receiver operating characteristic curves for models using different input features ranged from 0.80 to 0.93, increasing with additional features. Multisite validation showed similar results to cross-validation, with an aggregate area under the receiver operating characteristic curve of 0.91 across our independent test set of 10 clinical sites after training on a separate site. Our simulated retrospective deployment showed that for ECGs acquired in patients without preexisting structural heart disease in the year 2010, 11% were classified as high risk and 41% (4.5% of total patients) developed true echocardiography-confirmed disease within 1 year. CONCLUSIONS: An ECG-based machine learning model using a composite end point can identify a high-risk population for having undiagnosed, clinically significant structural heart disease while outperforming single-disease models and improving practical utility with higher positive predictive values. This approach can facilitate targeted screening with echocardiography to improve underdiagnosis of structural heart disease. Lippincott Williams & Wilkins 2022-05-09 2022-07-05 /pmc/articles/PMC9241668/ /pubmed/35533093 http://dx.doi.org/10.1161/CIRCULATIONAHA.121.057869 Text en © 2022 The Authors. https://creativecommons.org/licenses/by-nc-nd/4.0/Circulation is published on behalf of the American Heart Association, Inc., by Wolters Kluwer Health, Inc. This is an open access article under the terms of the Creative Commons Attribution Non-Commercial-NoDerivs (https://creativecommons.org/licenses/by-nc-nd/4.0/) License, which permits use, distribution, and reproduction in any medium, provided that the original work is properly cited, the use is noncommercial, and no modifications or adaptations are made.
spellingShingle Original Research Articles
Ulloa-Cerna, Alvaro E.
Jing, Linyuan
Pfeifer, John M.
Raghunath, Sushravya
Ruhl, Jeffrey A.
Rocha, Daniel B.
Leader, Joseph B.
Zimmerman, Noah
Lee, Greg
Steinhubl, Steven R.
Good, Christopher W.
Haggerty, Christopher M.
Fornwalt, Brandon K.
Chen, Ruijun
rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography
title rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography
title_full rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography
title_fullStr rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography
title_full_unstemmed rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography
title_short rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography
title_sort rechommend: an ecg-based machine learning approach for identifying patients at increased risk of undiagnosed structural heart disease detectable by echocardiography
topic Original Research Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9241668/
https://www.ncbi.nlm.nih.gov/pubmed/35533093
http://dx.doi.org/10.1161/CIRCULATIONAHA.121.057869
work_keys_str_mv AT ulloacernaalvaroe rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT jinglinyuan rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT pfeiferjohnm rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT raghunathsushravya rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT ruhljeffreya rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT rochadanielb rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT leaderjosephb rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT zimmermannoah rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT leegreg rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT steinhublstevenr rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT goodchristopherw rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT haggertychristopherm rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT fornwaltbrandonk rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography
AT chenruijun rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography