Cargando…

Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction

AIMS: Some artificial intelligence models applied in medical practice require ongoing retraining, introduce unintended racial bias, or have variable performance among different subgroups of patients. We assessed the real-world performance of the artificial intelligence-enhanced electrocardiogram to...

Descripción completa

Detalles Bibliográficos
Autores principales: Harmon, David M, Carter, Rickey E, Cohen-Shelly, Michal, Svatikova, Anna, Adedinsewo, Demilade A, Noseworthy, Peter A, Kapa, Suraj, Lopez-Jimenez, Francisco, Friedman, Paul A, Attia, Zachi I
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9558265/
https://www.ncbi.nlm.nih.gov/pubmed/36247412
http://dx.doi.org/10.1093/ehjdh/ztac028
_version_ 1784807402012409856
author Harmon, David M
Carter, Rickey E
Cohen-Shelly, Michal
Svatikova, Anna
Adedinsewo, Demilade A
Noseworthy, Peter A
Kapa, Suraj
Lopez-Jimenez, Francisco
Friedman, Paul A
Attia, Zachi I
author_facet Harmon, David M
Carter, Rickey E
Cohen-Shelly, Michal
Svatikova, Anna
Adedinsewo, Demilade A
Noseworthy, Peter A
Kapa, Suraj
Lopez-Jimenez, Francisco
Friedman, Paul A
Attia, Zachi I
author_sort Harmon, David M
collection PubMed
description AIMS: Some artificial intelligence models applied in medical practice require ongoing retraining, introduce unintended racial bias, or have variable performance among different subgroups of patients. We assessed the real-world performance of the artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction with respect to multiple patient and electrocardiogram variables to determine the algorithm’s long-term efficacy and potential bias in the absence of retraining. METHODS AND RESULTS: Electrocardiograms acquired in 2019 at Mayo Clinic in Minnesota, Arizona, and Florida with an echocardiogram performed within 14 days were analyzed (n = 44 986 unique patients). The area under the curve (AUC) was calculated to evaluate performance of the algorithm among age groups, racial and ethnic groups, patient encounter location, electrocardiogram features, and over time. The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction had an AUC of 0.903 for the total cohort. Time series analysis of the model validated its temporal stability. Areas under the curve were similar for all racial and ethnic groups (0.90–0.92) with minimal performance difference between sexes. Patients with a ‘normal sinus rhythm’ electrocardiogram (n = 37 047) exhibited an AUC of 0.91. All other electrocardiogram features had areas under the curve between 0.79 and 0.91, with the lowest performance occurring in the left bundle branch block group (0.79). CONCLUSION: The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction is stable over time in the absence of retraining and robust with respect to multiple variables including time, patient race, and electrocardiogram features.
format Online
Article
Text
id pubmed-9558265
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-95582652022-10-13 Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction Harmon, David M Carter, Rickey E Cohen-Shelly, Michal Svatikova, Anna Adedinsewo, Demilade A Noseworthy, Peter A Kapa, Suraj Lopez-Jimenez, Francisco Friedman, Paul A Attia, Zachi I Eur Heart J Digit Health Original Article AIMS: Some artificial intelligence models applied in medical practice require ongoing retraining, introduce unintended racial bias, or have variable performance among different subgroups of patients. We assessed the real-world performance of the artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction with respect to multiple patient and electrocardiogram variables to determine the algorithm’s long-term efficacy and potential bias in the absence of retraining. METHODS AND RESULTS: Electrocardiograms acquired in 2019 at Mayo Clinic in Minnesota, Arizona, and Florida with an echocardiogram performed within 14 days were analyzed (n = 44 986 unique patients). The area under the curve (AUC) was calculated to evaluate performance of the algorithm among age groups, racial and ethnic groups, patient encounter location, electrocardiogram features, and over time. The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction had an AUC of 0.903 for the total cohort. Time series analysis of the model validated its temporal stability. Areas under the curve were similar for all racial and ethnic groups (0.90–0.92) with minimal performance difference between sexes. Patients with a ‘normal sinus rhythm’ electrocardiogram (n = 37 047) exhibited an AUC of 0.91. All other electrocardiogram features had areas under the curve between 0.79 and 0.91, with the lowest performance occurring in the left bundle branch block group (0.79). CONCLUSION: The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction is stable over time in the absence of retraining and robust with respect to multiple variables including time, patient race, and electrocardiogram features. Oxford University Press 2022-05-17 /pmc/articles/PMC9558265/ /pubmed/36247412 http://dx.doi.org/10.1093/ehjdh/ztac028 Text en © The Author(s) 2022. Published by Oxford University Press on behalf of the European Society of Cardiology. https://creativecommons.org/licenses/by-nc/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial License (https://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact journals.permissions@oup.com
spellingShingle Original Article
Harmon, David M
Carter, Rickey E
Cohen-Shelly, Michal
Svatikova, Anna
Adedinsewo, Demilade A
Noseworthy, Peter A
Kapa, Suraj
Lopez-Jimenez, Francisco
Friedman, Paul A
Attia, Zachi I
Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction
title Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction
title_full Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction
title_fullStr Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction
title_full_unstemmed Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction
title_short Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction
title_sort real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9558265/
https://www.ncbi.nlm.nih.gov/pubmed/36247412
http://dx.doi.org/10.1093/ehjdh/ztac028
work_keys_str_mv AT harmondavidm realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction
AT carterrickeye realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction
AT cohenshellymichal realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction
AT svatikovaanna realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction
AT adedinsewodemiladea realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction
AT noseworthypetera realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction
AT kapasuraj realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction
AT lopezjimenezfrancisco realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction
AT friedmanpaula realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction
AT attiazachii realworldperformancelongtermefficacyandabsenceofbiasintheartificialintelligenceenhancedelectrocardiogramtodetectleftventricularsystolicdysfunction