Cargando…

Clinical validation of an artificial intelligence algorithm offering cross-platform detection of atrial fibrillation using smart device electrocardiograms

INTRODUCTION: Multiple smart devices capable of “screening” for atrial fibrillation (AF) based on single-lead electrocardiogram (SL ECG) are presently available. Manufacturers' algorithm capabilities and accuracy for the automated detection of AF vary. Reliable artificial intelligence (AI) algo...

Descripción completa

Detalles Bibliográficos
Autores principales: Mannhart, D, Lefebvre, B, Gardella, C, Henry, C, Serban, T, Knecht, S, Kuehne, M, Sticherling, C, Badertscher, P
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9779870/
http://dx.doi.org/10.1093/ehjdh/ztac076.2774
_version_ 1784856716038373376
author Mannhart, D
Lefebvre, B
Gardella, C
Henry, C
Serban, T
Knecht, S
Kuehne, M
Sticherling, C
Badertscher, P
author_facet Mannhart, D
Lefebvre, B
Gardella, C
Henry, C
Serban, T
Knecht, S
Kuehne, M
Sticherling, C
Badertscher, P
author_sort Mannhart, D
collection PubMed
description INTRODUCTION: Multiple smart devices capable of “screening” for atrial fibrillation (AF) based on single-lead electrocardiogram (SL ECG) are presently available. Manufacturers' algorithm capabilities and accuracy for the automated detection of AF vary. Reliable artificial intelligence (AI) algorithms would be valuable to assist physicians with managing the large amount of data. We aimed to assess the clinical value of applying a smart device agnostic AI-based algorithm for the detection of AF from five different smart devices (four smartwatches, one handheld device) and compared the results to the cardiologist-interpreted 12-lead ECG in a real world cohort of patients. METHODS: This is a prospective, observational study enrolling patients presenting to a cardiology service at a tertiary referral center. Patients were prescribed a 12-lead ECG, followed by five consecutive smart device recordings from five different manufacturers. SL ECGs were exported as PDF files from the devices and analyzed by a deep neural network (DNN) based platform which allows automated AI assisted cardiac rhythm interpretation. RESULTS: We prospectively enrolled 157 patients (32% female, median age 66 years). AF was present in 48 patients (31%) at time of recording, as documented by the 12-lead ECG. Accuracy for the detection of AF by the DNN-based algorithm was 96.6% for the Apple Watch 6, 95.2% for the AliveCor Kardia Mobile, 96.0% for the Fitbit Sense, 95.7% for the Samsung Galaxy Watch 3 and 93.8% for the Withings Scanwatch, respectively (Figure 1, left). While diagnostic accuracy of the DNN-based algorithm was similar compared to each manufacturer's individual algorithm, the proportion of SL ECGs with a conclusive diagnosis was significantly higher for all smart devices when using the DNN-based algorithm, p<0.001 (Figure 1, right). As complementary analysis, we assessed sensitivity and specificity detection capabilities in both algorithms (Figure 2). CONCLUSION: In this clinical validation, a DNN-based algorithm reported significantly more conclusive diagnoses for each smart device compared to the manufacturers' algorithms, whilst showing similarly high accuracy in the detection of AF compared to the cardiologist-interpreted standard 12-lead ECG. Given further validation, SL ECG assisted rhythm interpretation through a cross-platform AI-algorithm presents a promising clinical value for AF detection and offers a possible solution for managing the data surge for smart device-acquired ECGs. FUNDING ACKNOWLEDGEMENT: Type of funding sources: None.
format Online
Article
Text
id pubmed-9779870
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-97798702023-01-27 Clinical validation of an artificial intelligence algorithm offering cross-platform detection of atrial fibrillation using smart device electrocardiograms Mannhart, D Lefebvre, B Gardella, C Henry, C Serban, T Knecht, S Kuehne, M Sticherling, C Badertscher, P Eur Heart J Digit Health Abstracts INTRODUCTION: Multiple smart devices capable of “screening” for atrial fibrillation (AF) based on single-lead electrocardiogram (SL ECG) are presently available. Manufacturers' algorithm capabilities and accuracy for the automated detection of AF vary. Reliable artificial intelligence (AI) algorithms would be valuable to assist physicians with managing the large amount of data. We aimed to assess the clinical value of applying a smart device agnostic AI-based algorithm for the detection of AF from five different smart devices (four smartwatches, one handheld device) and compared the results to the cardiologist-interpreted 12-lead ECG in a real world cohort of patients. METHODS: This is a prospective, observational study enrolling patients presenting to a cardiology service at a tertiary referral center. Patients were prescribed a 12-lead ECG, followed by five consecutive smart device recordings from five different manufacturers. SL ECGs were exported as PDF files from the devices and analyzed by a deep neural network (DNN) based platform which allows automated AI assisted cardiac rhythm interpretation. RESULTS: We prospectively enrolled 157 patients (32% female, median age 66 years). AF was present in 48 patients (31%) at time of recording, as documented by the 12-lead ECG. Accuracy for the detection of AF by the DNN-based algorithm was 96.6% for the Apple Watch 6, 95.2% for the AliveCor Kardia Mobile, 96.0% for the Fitbit Sense, 95.7% for the Samsung Galaxy Watch 3 and 93.8% for the Withings Scanwatch, respectively (Figure 1, left). While diagnostic accuracy of the DNN-based algorithm was similar compared to each manufacturer's individual algorithm, the proportion of SL ECGs with a conclusive diagnosis was significantly higher for all smart devices when using the DNN-based algorithm, p<0.001 (Figure 1, right). As complementary analysis, we assessed sensitivity and specificity detection capabilities in both algorithms (Figure 2). CONCLUSION: In this clinical validation, a DNN-based algorithm reported significantly more conclusive diagnoses for each smart device compared to the manufacturers' algorithms, whilst showing similarly high accuracy in the detection of AF compared to the cardiologist-interpreted standard 12-lead ECG. Given further validation, SL ECG assisted rhythm interpretation through a cross-platform AI-algorithm presents a promising clinical value for AF detection and offers a possible solution for managing the data surge for smart device-acquired ECGs. FUNDING ACKNOWLEDGEMENT: Type of funding sources: None. Oxford University Press 2022-12-22 /pmc/articles/PMC9779870/ http://dx.doi.org/10.1093/ehjdh/ztac076.2774 Text en Reproduced from: European Heart Journal, Volume 43, Issue Supplement_2, October 2022, ehac544.2774, https://doi.org/10.1093/eurheartj/ehac544.2774 by permission of Oxford University Press on behalf of the European Society of Cardiology. The opinions expressed in the Journal item reproduced as this reprint are those of the authors and contributors, and do not necessarily reflect those of the European Society of Cardiology, the editors, the editorial board, Oxford University Press or the organization to which the authors are affiliated. The mention of trade names, commercial products or organizations, and the inclusion of advertisements in this reprint do not imply endorsement by the Journal, the editors, the editorial board, Oxford University Press or the organization to which the authors are affiliated. The editors and publishers have taken all reasonable precautions to verify drug names and doses, the results of experimental work and clinical findings published in the Journal. The ultimate responsibility for the use and dosage of drugs mentioned in this reprint and in interpretation of published material lies with the medical practitioner, and the editors and publisher cannot accept liability for damages arising from any error or omissions in the Journal or in this reprint. Please inform the editors of any errors. © The Author(s) 2022. https://creativecommons.org/licenses/by-nc/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact journals.permissions@oup.com
spellingShingle Abstracts
Mannhart, D
Lefebvre, B
Gardella, C
Henry, C
Serban, T
Knecht, S
Kuehne, M
Sticherling, C
Badertscher, P
Clinical validation of an artificial intelligence algorithm offering cross-platform detection of atrial fibrillation using smart device electrocardiograms
title Clinical validation of an artificial intelligence algorithm offering cross-platform detection of atrial fibrillation using smart device electrocardiograms
title_full Clinical validation of an artificial intelligence algorithm offering cross-platform detection of atrial fibrillation using smart device electrocardiograms
title_fullStr Clinical validation of an artificial intelligence algorithm offering cross-platform detection of atrial fibrillation using smart device electrocardiograms
title_full_unstemmed Clinical validation of an artificial intelligence algorithm offering cross-platform detection of atrial fibrillation using smart device electrocardiograms
title_short Clinical validation of an artificial intelligence algorithm offering cross-platform detection of atrial fibrillation using smart device electrocardiograms
title_sort clinical validation of an artificial intelligence algorithm offering cross-platform detection of atrial fibrillation using smart device electrocardiograms
topic Abstracts
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9779870/
http://dx.doi.org/10.1093/ehjdh/ztac076.2774
work_keys_str_mv AT mannhartd clinicalvalidationofanartificialintelligencealgorithmofferingcrossplatformdetectionofatrialfibrillationusingsmartdeviceelectrocardiograms
AT lefebvreb clinicalvalidationofanartificialintelligencealgorithmofferingcrossplatformdetectionofatrialfibrillationusingsmartdeviceelectrocardiograms
AT gardellac clinicalvalidationofanartificialintelligencealgorithmofferingcrossplatformdetectionofatrialfibrillationusingsmartdeviceelectrocardiograms
AT henryc clinicalvalidationofanartificialintelligencealgorithmofferingcrossplatformdetectionofatrialfibrillationusingsmartdeviceelectrocardiograms
AT serbant clinicalvalidationofanartificialintelligencealgorithmofferingcrossplatformdetectionofatrialfibrillationusingsmartdeviceelectrocardiograms
AT knechts clinicalvalidationofanartificialintelligencealgorithmofferingcrossplatformdetectionofatrialfibrillationusingsmartdeviceelectrocardiograms
AT kuehnem clinicalvalidationofanartificialintelligencealgorithmofferingcrossplatformdetectionofatrialfibrillationusingsmartdeviceelectrocardiograms
AT sticherlingc clinicalvalidationofanartificialintelligencealgorithmofferingcrossplatformdetectionofatrialfibrillationusingsmartdeviceelectrocardiograms
AT badertscherp clinicalvalidationofanartificialintelligencealgorithmofferingcrossplatformdetectionofatrialfibrillationusingsmartdeviceelectrocardiograms