Cargando…

Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach

BACKGROUND: Atrial fibrillation (AFib) is the most common cardiac arrhythmia associated with stroke, blood clots, heart failure, coronary artery disease, and/or death. Multiple methods have been proposed for AFib detection, with varying performances, but no single approach appears to be optimal. We...

Descripción completa

Detalles Bibliográficos
Autores principales: Bahrami Rad, Ali, Galloway, Conner, Treiman, Daniel, Xue, Joel, Li, Qiao, Sameni, Reza, Albert, Dave, Clifford, Gari D.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8594842/
https://www.ncbi.nlm.nih.gov/pubmed/34784378
http://dx.doi.org/10.1371/journal.pone.0259916
_version_ 1784600069576589312
author Bahrami Rad, Ali
Galloway, Conner
Treiman, Daniel
Xue, Joel
Li, Qiao
Sameni, Reza
Albert, Dave
Clifford, Gari D.
author_facet Bahrami Rad, Ali
Galloway, Conner
Treiman, Daniel
Xue, Joel
Li, Qiao
Sameni, Reza
Albert, Dave
Clifford, Gari D.
author_sort Bahrami Rad, Ali
collection PubMed
description BACKGROUND: Atrial fibrillation (AFib) is the most common cardiac arrhythmia associated with stroke, blood clots, heart failure, coronary artery disease, and/or death. Multiple methods have been proposed for AFib detection, with varying performances, but no single approach appears to be optimal. We hypothesized that each state-of-the-art algorithm is appropriate for different subsets of patients and provides some independent information. Therefore, a set of suitably chosen algorithms, combined in a weighted voting framework, will provide a superior performance to any single algorithm. METHODS: We investigate and modify 38 state-of-the-art AFib classification algorithms for a single-lead ambulatory electrocardiogram (ECG) monitoring device. All algorithms are ranked using a random forest classifier and an expert-labeled training dataset of 2,532 recordings. The seven top-ranked algorithms are combined by using an optimized weighting approach. RESULTS: The proposed fusion algorithm, when validated on a separate test dataset consisting of 4,644 recordings, resulted in an area under the receiver operating characteristic (ROC) curve of 0.99. The sensitivity, specificity, positive-predictive-value (PPV), negative-predictive-value (NPV), and F1-score of the proposed algorithm were 0.93, 0.97, 0.87, 0.99, and 0.90, respectively, which were all superior to any single algorithm or any previously published. CONCLUSION: This study demonstrates how a set of well-chosen independent algorithms and a voting mechanism to fuse the outputs of the algorithms, outperforms any single state-of-the-art algorithm for AFib detection. The proposed framework is a case study for the general notion of crowdsourcing between open-source algorithms in healthcare applications. The extension of this framework to similar applications may significantly save time, effort, and resources, by combining readily existing algorithms. It is also a step toward the democratization of artificial intelligence and its application in healthcare.
format Online
Article
Text
id pubmed-8594842
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-85948422021-11-17 Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach Bahrami Rad, Ali Galloway, Conner Treiman, Daniel Xue, Joel Li, Qiao Sameni, Reza Albert, Dave Clifford, Gari D. PLoS One Research Article BACKGROUND: Atrial fibrillation (AFib) is the most common cardiac arrhythmia associated with stroke, blood clots, heart failure, coronary artery disease, and/or death. Multiple methods have been proposed for AFib detection, with varying performances, but no single approach appears to be optimal. We hypothesized that each state-of-the-art algorithm is appropriate for different subsets of patients and provides some independent information. Therefore, a set of suitably chosen algorithms, combined in a weighted voting framework, will provide a superior performance to any single algorithm. METHODS: We investigate and modify 38 state-of-the-art AFib classification algorithms for a single-lead ambulatory electrocardiogram (ECG) monitoring device. All algorithms are ranked using a random forest classifier and an expert-labeled training dataset of 2,532 recordings. The seven top-ranked algorithms are combined by using an optimized weighting approach. RESULTS: The proposed fusion algorithm, when validated on a separate test dataset consisting of 4,644 recordings, resulted in an area under the receiver operating characteristic (ROC) curve of 0.99. The sensitivity, specificity, positive-predictive-value (PPV), negative-predictive-value (NPV), and F1-score of the proposed algorithm were 0.93, 0.97, 0.87, 0.99, and 0.90, respectively, which were all superior to any single algorithm or any previously published. CONCLUSION: This study demonstrates how a set of well-chosen independent algorithms and a voting mechanism to fuse the outputs of the algorithms, outperforms any single state-of-the-art algorithm for AFib detection. The proposed framework is a case study for the general notion of crowdsourcing between open-source algorithms in healthcare applications. The extension of this framework to similar applications may significantly save time, effort, and resources, by combining readily existing algorithms. It is also a step toward the democratization of artificial intelligence and its application in healthcare. Public Library of Science 2021-11-16 /pmc/articles/PMC8594842/ /pubmed/34784378 http://dx.doi.org/10.1371/journal.pone.0259916 Text en © 2021 Bahrami Rad et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Bahrami Rad, Ali
Galloway, Conner
Treiman, Daniel
Xue, Joel
Li, Qiao
Sameni, Reza
Albert, Dave
Clifford, Gari D.
Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach
title Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach
title_full Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach
title_fullStr Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach
title_full_unstemmed Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach
title_short Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach
title_sort atrial fibrillation detection in outpatient electrocardiogram monitoring: an algorithmic crowdsourcing approach
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8594842/
https://www.ncbi.nlm.nih.gov/pubmed/34784378
http://dx.doi.org/10.1371/journal.pone.0259916
work_keys_str_mv AT bahramiradali atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach
AT gallowayconner atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach
AT treimandaniel atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach
AT xuejoel atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach
AT liqiao atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach
AT samenireza atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach
AT albertdave atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach
AT cliffordgarid atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach