Cargando…
Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction
AIMS: Some artificial intelligence models applied in medical practice require ongoing retraining, introduce unintended racial bias, or have variable performance among different subgroups of patients. We assessed the real-world performance of the artificial intelligence-enhanced electrocardiogram to...
Autores principales: | , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Oxford University Press
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9558265/ https://www.ncbi.nlm.nih.gov/pubmed/36247412 http://dx.doi.org/10.1093/ehjdh/ztac028 |
_version_ | 1784807402012409856 |
---|---|
author | Harmon, David M Carter, Rickey E Cohen-Shelly, Michal Svatikova, Anna Adedinsewo, Demilade A Noseworthy, Peter A Kapa, Suraj Lopez-Jimenez, Francisco Friedman, Paul A Attia, Zachi I |
author_facet | Harmon, David M Carter, Rickey E Cohen-Shelly, Michal Svatikova, Anna Adedinsewo, Demilade A Noseworthy, Peter A Kapa, Suraj Lopez-Jimenez, Francisco Friedman, Paul A Attia, Zachi I |
author_sort | Harmon, David M |
collection | PubMed |
description | AIMS: Some artificial intelligence models applied in medical practice require ongoing retraining, introduce unintended racial bias, or have variable performance among different subgroups of patients. We assessed the real-world performance of the artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction with respect to multiple patient and electrocardiogram variables to determine the algorithm’s long-term efficacy and potential bias in the absence of retraining. METHODS AND RESULTS: Electrocardiograms acquired in 2019 at Mayo Clinic in Minnesota, Arizona, and Florida with an echocardiogram performed within 14 days were analyzed (n = 44 986 unique patients). The area under the curve (AUC) was calculated to evaluate performance of the algorithm among age groups, racial and ethnic groups, patient encounter location, electrocardiogram features, and over time. The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction had an AUC of 0.903 for the total cohort. Time series analysis of the model validated its temporal stability. Areas under the curve were similar for all racial and ethnic groups (0.90–0.92) with minimal performance difference between sexes. Patients with a ‘normal sinus rhythm’ electrocardiogram (n = 37 047) exhibited an AUC of 0.91. All other electrocardiogram features had areas under the curve between 0.79 and 0.91, with the lowest performance occurring in the left bundle branch block group (0.79). CONCLUSION: The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction is stable over time in the absence of retraining and robust with respect to multiple variables including time, patient race, and electrocardiogram features. |
format | Online Article Text |
id | pubmed-9558265 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Oxford University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-95582652022-10-13 Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction Harmon, David M Carter, Rickey E Cohen-Shelly, Michal Svatikova, Anna Adedinsewo, Demilade A Noseworthy, Peter A Kapa, Suraj Lopez-Jimenez, Francisco Friedman, Paul A Attia, Zachi I Eur Heart J Digit Health Original Article AIMS: Some artificial intelligence models applied in medical practice require ongoing retraining, introduce unintended racial bias, or have variable performance among different subgroups of patients. We assessed the real-world performance of the artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction with respect to multiple patient and electrocardiogram variables to determine the algorithm’s long-term efficacy and potential bias in the absence of retraining. METHODS AND RESULTS: Electrocardiograms acquired in 2019 at Mayo Clinic in Minnesota, Arizona, and Florida with an echocardiogram performed within 14 days were analyzed (n = 44 986 unique patients). The area under the curve (AUC) was calculated to evaluate performance of the algorithm among age groups, racial and ethnic groups, patient encounter location, electrocardiogram features, and over time. The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction had an AUC of 0.903 for the total cohort. Time series analysis of the model validated its temporal stability. Areas under the curve were similar for all racial and ethnic groups (0.90–0.92) with minimal performance difference between sexes. Patients with a ‘normal sinus rhythm’ electrocardiogram (n = 37 047) exhibited an AUC of 0.91. All other electrocardiogram features had areas under the curve between 0.79 and 0.91, with the lowest performance occurring in the left bundle branch block group (0.79). CONCLUSION: The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction is stable over time in the absence of retraining and robust with respect to multiple variables including time, patient race, and electrocardiogram features. Oxford University Press 2022-05-17 /pmc/articles/PMC9558265/ /pubmed/36247412 http://dx.doi.org/10.1093/ehjdh/ztac028 Text en © The Author(s) 2022. Published by Oxford University Press on behalf of the European Society of Cardiology. https://creativecommons.org/licenses/by-nc/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial License (https://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact journals.permissions@oup.com |
spellingShingle | Original Article Harmon, David M Carter, Rickey E Cohen-Shelly, Michal Svatikova, Anna Adedinsewo, Demilade A Noseworthy, Peter A Kapa, Suraj Lopez-Jimenez, Francisco Friedman, Paul A Attia, Zachi I Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction |
title | Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction |
title_full | Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction |
title_fullStr | Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction |
title_full_unstemmed | Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction |
title_short | Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction |
title_sort | real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction |
topic | Original Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9558265/ https://www.ncbi.nlm.nih.gov/pubmed/36247412 http://dx.doi.org/10.1093/ehjdh/ztac028 |
work_keys_str_mv | AT harmondavidm realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction AT carterrickeye realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction AT cohenshellymichal realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction AT svatikovaanna realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction AT adedinsewodemiladea realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction AT noseworthypetera realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction AT kapasuraj realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction AT lopezjimenezfrancisco realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction AT friedmanpaula realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction AT attiazachii realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction |