Cargando…
rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography
BACKGROUND: Timely diagnosis of structural heart disease improves patient outcomes, yet many remain underdiagnosed. While population screening with echocardiography is impractical, ECG-based prediction models can help target high-risk patients. We developed a novel ECG-based machine learning approac...
Autores principales: | , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Lippincott Williams & Wilkins
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9241668/ https://www.ncbi.nlm.nih.gov/pubmed/35533093 http://dx.doi.org/10.1161/CIRCULATIONAHA.121.057869 |
_version_ | 1784737858551021568 |
---|---|
author | Ulloa-Cerna, Alvaro E. Jing, Linyuan Pfeifer, John M. Raghunath, Sushravya Ruhl, Jeffrey A. Rocha, Daniel B. Leader, Joseph B. Zimmerman, Noah Lee, Greg Steinhubl, Steven R. Good, Christopher W. Haggerty, Christopher M. Fornwalt, Brandon K. Chen, Ruijun |
author_facet | Ulloa-Cerna, Alvaro E. Jing, Linyuan Pfeifer, John M. Raghunath, Sushravya Ruhl, Jeffrey A. Rocha, Daniel B. Leader, Joseph B. Zimmerman, Noah Lee, Greg Steinhubl, Steven R. Good, Christopher W. Haggerty, Christopher M. Fornwalt, Brandon K. Chen, Ruijun |
author_sort | Ulloa-Cerna, Alvaro E. |
collection | PubMed |
description | BACKGROUND: Timely diagnosis of structural heart disease improves patient outcomes, yet many remain underdiagnosed. While population screening with echocardiography is impractical, ECG-based prediction models can help target high-risk patients. We developed a novel ECG-based machine learning approach to predict multiple structural heart conditions, hypothesizing that a composite model would yield higher prevalence and positive predictive values to facilitate meaningful recommendations for echocardiography. METHODS: Using 2 232 130 ECGs linked to electronic health records and echocardiography reports from 484 765 adults between 1984 to 2021, we trained machine learning models to predict the presence or absence of any of 7 echocardiography-confirmed diseases within 1 year. This composite label included the following: moderate or severe valvular disease (aortic/mitral stenosis or regurgitation, tricuspid regurgitation), reduced ejection fraction <50%, or interventricular septal thickness >15 mm. We tested various combinations of input features (demographics, laboratory values, structured ECG data, ECG traces) and evaluated model performance using 5-fold cross-validation, multisite validation trained on 1 site and tested on 10 independent sites, and simulated retrospective deployment trained on pre-2010 data and deployed in 2010. RESULTS: Our composite rECHOmmend model used age, sex, and ECG traces and had a 0.91 area under the receiver operating characteristic curve and a 42% positive predictive value at 90% sensitivity, with a composite label prevalence of 17.9%. Individual disease models had area under the receiver operating characteristic curves from 0.86 to 0.93 and lower positive predictive values from 1% to 31%. Area under the receiver operating characteristic curves for models using different input features ranged from 0.80 to 0.93, increasing with additional features. Multisite validation showed similar results to cross-validation, with an aggregate area under the receiver operating characteristic curve of 0.91 across our independent test set of 10 clinical sites after training on a separate site. Our simulated retrospective deployment showed that for ECGs acquired in patients without preexisting structural heart disease in the year 2010, 11% were classified as high risk and 41% (4.5% of total patients) developed true echocardiography-confirmed disease within 1 year. CONCLUSIONS: An ECG-based machine learning model using a composite end point can identify a high-risk population for having undiagnosed, clinically significant structural heart disease while outperforming single-disease models and improving practical utility with higher positive predictive values. This approach can facilitate targeted screening with echocardiography to improve underdiagnosis of structural heart disease. |
format | Online Article Text |
id | pubmed-9241668 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Lippincott Williams & Wilkins |
record_format | MEDLINE/PubMed |
spelling | pubmed-92416682022-07-01 rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography Ulloa-Cerna, Alvaro E. Jing, Linyuan Pfeifer, John M. Raghunath, Sushravya Ruhl, Jeffrey A. Rocha, Daniel B. Leader, Joseph B. Zimmerman, Noah Lee, Greg Steinhubl, Steven R. Good, Christopher W. Haggerty, Christopher M. Fornwalt, Brandon K. Chen, Ruijun Circulation Original Research Articles BACKGROUND: Timely diagnosis of structural heart disease improves patient outcomes, yet many remain underdiagnosed. While population screening with echocardiography is impractical, ECG-based prediction models can help target high-risk patients. We developed a novel ECG-based machine learning approach to predict multiple structural heart conditions, hypothesizing that a composite model would yield higher prevalence and positive predictive values to facilitate meaningful recommendations for echocardiography. METHODS: Using 2 232 130 ECGs linked to electronic health records and echocardiography reports from 484 765 adults between 1984 to 2021, we trained machine learning models to predict the presence or absence of any of 7 echocardiography-confirmed diseases within 1 year. This composite label included the following: moderate or severe valvular disease (aortic/mitral stenosis or regurgitation, tricuspid regurgitation), reduced ejection fraction <50%, or interventricular septal thickness >15 mm. We tested various combinations of input features (demographics, laboratory values, structured ECG data, ECG traces) and evaluated model performance using 5-fold cross-validation, multisite validation trained on 1 site and tested on 10 independent sites, and simulated retrospective deployment trained on pre-2010 data and deployed in 2010. RESULTS: Our composite rECHOmmend model used age, sex, and ECG traces and had a 0.91 area under the receiver operating characteristic curve and a 42% positive predictive value at 90% sensitivity, with a composite label prevalence of 17.9%. Individual disease models had area under the receiver operating characteristic curves from 0.86 to 0.93 and lower positive predictive values from 1% to 31%. Area under the receiver operating characteristic curves for models using different input features ranged from 0.80 to 0.93, increasing with additional features. Multisite validation showed similar results to cross-validation, with an aggregate area under the receiver operating characteristic curve of 0.91 across our independent test set of 10 clinical sites after training on a separate site. Our simulated retrospective deployment showed that for ECGs acquired in patients without preexisting structural heart disease in the year 2010, 11% were classified as high risk and 41% (4.5% of total patients) developed true echocardiography-confirmed disease within 1 year. CONCLUSIONS: An ECG-based machine learning model using a composite end point can identify a high-risk population for having undiagnosed, clinically significant structural heart disease while outperforming single-disease models and improving practical utility with higher positive predictive values. This approach can facilitate targeted screening with echocardiography to improve underdiagnosis of structural heart disease. Lippincott Williams & Wilkins 2022-05-09 2022-07-05 /pmc/articles/PMC9241668/ /pubmed/35533093 http://dx.doi.org/10.1161/CIRCULATIONAHA.121.057869 Text en © 2022 The Authors. https://creativecommons.org/licenses/by-nc-nd/4.0/Circulation is published on behalf of the American Heart Association, Inc., by Wolters Kluwer Health, Inc. This is an open access article under the terms of the Creative Commons Attribution Non-Commercial-NoDerivs (https://creativecommons.org/licenses/by-nc-nd/4.0/) License, which permits use, distribution, and reproduction in any medium, provided that the original work is properly cited, the use is noncommercial, and no modifications or adaptations are made. |
spellingShingle | Original Research Articles Ulloa-Cerna, Alvaro E. Jing, Linyuan Pfeifer, John M. Raghunath, Sushravya Ruhl, Jeffrey A. Rocha, Daniel B. Leader, Joseph B. Zimmerman, Noah Lee, Greg Steinhubl, Steven R. Good, Christopher W. Haggerty, Christopher M. Fornwalt, Brandon K. Chen, Ruijun rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography |
title | rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography |
title_full | rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography |
title_fullStr | rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography |
title_full_unstemmed | rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography |
title_short | rECHOmmend: An ECG-Based Machine Learning Approach for Identifying Patients at Increased Risk of Undiagnosed Structural Heart Disease Detectable by Echocardiography |
title_sort | rechommend: an ecg-based machine learning approach for identifying patients at increased risk of undiagnosed structural heart disease detectable by echocardiography |
topic | Original Research Articles |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9241668/ https://www.ncbi.nlm.nih.gov/pubmed/35533093 http://dx.doi.org/10.1161/CIRCULATIONAHA.121.057869 |
work_keys_str_mv | AT ulloacernaalvaroe rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT jinglinyuan rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT pfeiferjohnm rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT raghunathsushravya rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT ruhljeffreya rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT rochadanielb rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT leaderjosephb rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT zimmermannoah rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT leegreg rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT steinhublstevenr rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT goodchristopherw rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT haggertychristopherm rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT fornwaltbrandonk rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography AT chenruijun rechommendanecgbasedmachinelearningapproachforidentifyingpatientsatincreasedriskofundiagnosedstructuralheartdiseasedetectablebyechocardiography |