Cargando…
Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach
BACKGROUND: Atrial fibrillation (AFib) is the most common cardiac arrhythmia associated with stroke, blood clots, heart failure, coronary artery disease, and/or death. Multiple methods have been proposed for AFib detection, with varying performances, but no single approach appears to be optimal. We...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8594842/ https://www.ncbi.nlm.nih.gov/pubmed/34784378 http://dx.doi.org/10.1371/journal.pone.0259916 |
_version_ | 1784600069576589312 |
---|---|
author | Bahrami Rad, Ali Galloway, Conner Treiman, Daniel Xue, Joel Li, Qiao Sameni, Reza Albert, Dave Clifford, Gari D. |
author_facet | Bahrami Rad, Ali Galloway, Conner Treiman, Daniel Xue, Joel Li, Qiao Sameni, Reza Albert, Dave Clifford, Gari D. |
author_sort | Bahrami Rad, Ali |
collection | PubMed |
description | BACKGROUND: Atrial fibrillation (AFib) is the most common cardiac arrhythmia associated with stroke, blood clots, heart failure, coronary artery disease, and/or death. Multiple methods have been proposed for AFib detection, with varying performances, but no single approach appears to be optimal. We hypothesized that each state-of-the-art algorithm is appropriate for different subsets of patients and provides some independent information. Therefore, a set of suitably chosen algorithms, combined in a weighted voting framework, will provide a superior performance to any single algorithm. METHODS: We investigate and modify 38 state-of-the-art AFib classification algorithms for a single-lead ambulatory electrocardiogram (ECG) monitoring device. All algorithms are ranked using a random forest classifier and an expert-labeled training dataset of 2,532 recordings. The seven top-ranked algorithms are combined by using an optimized weighting approach. RESULTS: The proposed fusion algorithm, when validated on a separate test dataset consisting of 4,644 recordings, resulted in an area under the receiver operating characteristic (ROC) curve of 0.99. The sensitivity, specificity, positive-predictive-value (PPV), negative-predictive-value (NPV), and F1-score of the proposed algorithm were 0.93, 0.97, 0.87, 0.99, and 0.90, respectively, which were all superior to any single algorithm or any previously published. CONCLUSION: This study demonstrates how a set of well-chosen independent algorithms and a voting mechanism to fuse the outputs of the algorithms, outperforms any single state-of-the-art algorithm for AFib detection. The proposed framework is a case study for the general notion of crowdsourcing between open-source algorithms in healthcare applications. The extension of this framework to similar applications may significantly save time, effort, and resources, by combining readily existing algorithms. It is also a step toward the democratization of artificial intelligence and its application in healthcare. |
format | Online Article Text |
id | pubmed-8594842 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-85948422021-11-17 Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach Bahrami Rad, Ali Galloway, Conner Treiman, Daniel Xue, Joel Li, Qiao Sameni, Reza Albert, Dave Clifford, Gari D. PLoS One Research Article BACKGROUND: Atrial fibrillation (AFib) is the most common cardiac arrhythmia associated with stroke, blood clots, heart failure, coronary artery disease, and/or death. Multiple methods have been proposed for AFib detection, with varying performances, but no single approach appears to be optimal. We hypothesized that each state-of-the-art algorithm is appropriate for different subsets of patients and provides some independent information. Therefore, a set of suitably chosen algorithms, combined in a weighted voting framework, will provide a superior performance to any single algorithm. METHODS: We investigate and modify 38 state-of-the-art AFib classification algorithms for a single-lead ambulatory electrocardiogram (ECG) monitoring device. All algorithms are ranked using a random forest classifier and an expert-labeled training dataset of 2,532 recordings. The seven top-ranked algorithms are combined by using an optimized weighting approach. RESULTS: The proposed fusion algorithm, when validated on a separate test dataset consisting of 4,644 recordings, resulted in an area under the receiver operating characteristic (ROC) curve of 0.99. The sensitivity, specificity, positive-predictive-value (PPV), negative-predictive-value (NPV), and F1-score of the proposed algorithm were 0.93, 0.97, 0.87, 0.99, and 0.90, respectively, which were all superior to any single algorithm or any previously published. CONCLUSION: This study demonstrates how a set of well-chosen independent algorithms and a voting mechanism to fuse the outputs of the algorithms, outperforms any single state-of-the-art algorithm for AFib detection. The proposed framework is a case study for the general notion of crowdsourcing between open-source algorithms in healthcare applications. The extension of this framework to similar applications may significantly save time, effort, and resources, by combining readily existing algorithms. It is also a step toward the democratization of artificial intelligence and its application in healthcare. Public Library of Science 2021-11-16 /pmc/articles/PMC8594842/ /pubmed/34784378 http://dx.doi.org/10.1371/journal.pone.0259916 Text en © 2021 Bahrami Rad et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Bahrami Rad, Ali Galloway, Conner Treiman, Daniel Xue, Joel Li, Qiao Sameni, Reza Albert, Dave Clifford, Gari D. Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach |
title | Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach |
title_full | Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach |
title_fullStr | Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach |
title_full_unstemmed | Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach |
title_short | Atrial fibrillation detection in outpatient electrocardiogram monitoring: An algorithmic crowdsourcing approach |
title_sort | atrial fibrillation detection in outpatient electrocardiogram monitoring: an algorithmic crowdsourcing approach |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8594842/ https://www.ncbi.nlm.nih.gov/pubmed/34784378 http://dx.doi.org/10.1371/journal.pone.0259916 |
work_keys_str_mv | AT bahramiradali atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach AT gallowayconner atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach AT treimandaniel atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach AT xuejoel atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach AT liqiao atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach AT samenireza atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach AT albertdave atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach AT cliffordgarid atrialfibrillationdetectioninoutpatientelectrocardiogrammonitoringanalgorithmiccrowdsourcingapproach |