Cargando…

Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED)

BACKGROUND: Many patients with atrial fibrillation (AF) remain undiagnosed despite availability of interventions to reduce stroke risk. Predictive models to date are limited by data requirements and theoretical usage. We aimed to develop a model for predicting the 2-year probability of AF diagnosis...

Descripción completa

Detalles Bibliográficos
Autores principales: Grout, Randall W., Hui, Siu L., Imler, Timothy D., El-Azab, Sarah, Baker, Jarod, Sands, George H., Ateya, Mohammad, Pike, Francis
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8019173/
https://www.ncbi.nlm.nih.gov/pubmed/33812369
http://dx.doi.org/10.1186/s12911-021-01482-1
_version_ 1783674326139011072
author Grout, Randall W.
Hui, Siu L.
Imler, Timothy D.
El-Azab, Sarah
Baker, Jarod
Sands, George H.
Ateya, Mohammad
Pike, Francis
author_facet Grout, Randall W.
Hui, Siu L.
Imler, Timothy D.
El-Azab, Sarah
Baker, Jarod
Sands, George H.
Ateya, Mohammad
Pike, Francis
author_sort Grout, Randall W.
collection PubMed
description BACKGROUND: Many patients with atrial fibrillation (AF) remain undiagnosed despite availability of interventions to reduce stroke risk. Predictive models to date are limited by data requirements and theoretical usage. We aimed to develop a model for predicting the 2-year probability of AF diagnosis and implement it as proof-of-concept (POC) in a production electronic health record (EHR). METHODS: We used a nested case–control design using data from the Indiana Network for Patient Care. The development cohort came from 2016 to 2017 (outcome period) and 2014 to 2015 (baseline). A separate validation cohort used outcome and baseline periods shifted 2 years before respective development cohort times. Machine learning approaches were used to build predictive model. Patients ≥ 18 years, later restricted to age ≥ 40 years, with at least two encounters and no AF during baseline, were included. In the 6-week EHR prospective pilot, the model was silently implemented in the production system at a large safety-net urban hospital. Three new and two previous logistic regression models were evaluated using receiver-operating characteristics. Number, characteristics, and CHA(2)DS(2)-VASc scores of patients identified by the model in the pilot are presented. RESULTS: After restricting age to ≥ 40 years, 31,474 AF cases (mean age, 71.5 years; female 49%) and 22,078 controls (mean age, 59.5 years; female 61%) comprised the development cohort. A 10-variable model using age, acute heart disease, albumin, body mass index, chronic obstructive pulmonary disease, gender, heart failure, insurance, kidney disease, and shock yielded the best performance (C-statistic, 0.80 [95% CI 0.79–0.80]). The model performed well in the validation cohort (C-statistic, 0.81 [95% CI 0.8–0.81]). In the EHR pilot, 7916/22,272 (35.5%; mean age, 66 years; female 50%) were identified as higher risk for AF; 5582 (70%) had CHA(2)DS(2)-VASc score ≥ 2. CONCLUSIONS: Using variables commonly available in the EHR, we created a predictive model to identify 2-year risk of developing AF in those previously without diagnosed AF. Successful POC implementation of the model in an EHR provided a practical strategy to identify patients who may benefit from interventions to reduce their stroke risk. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12911-021-01482-1.
format Online
Article
Text
id pubmed-8019173
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-80191732021-04-05 Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED) Grout, Randall W. Hui, Siu L. Imler, Timothy D. El-Azab, Sarah Baker, Jarod Sands, George H. Ateya, Mohammad Pike, Francis BMC Med Inform Decis Mak Research Article BACKGROUND: Many patients with atrial fibrillation (AF) remain undiagnosed despite availability of interventions to reduce stroke risk. Predictive models to date are limited by data requirements and theoretical usage. We aimed to develop a model for predicting the 2-year probability of AF diagnosis and implement it as proof-of-concept (POC) in a production electronic health record (EHR). METHODS: We used a nested case–control design using data from the Indiana Network for Patient Care. The development cohort came from 2016 to 2017 (outcome period) and 2014 to 2015 (baseline). A separate validation cohort used outcome and baseline periods shifted 2 years before respective development cohort times. Machine learning approaches were used to build predictive model. Patients ≥ 18 years, later restricted to age ≥ 40 years, with at least two encounters and no AF during baseline, were included. In the 6-week EHR prospective pilot, the model was silently implemented in the production system at a large safety-net urban hospital. Three new and two previous logistic regression models were evaluated using receiver-operating characteristics. Number, characteristics, and CHA(2)DS(2)-VASc scores of patients identified by the model in the pilot are presented. RESULTS: After restricting age to ≥ 40 years, 31,474 AF cases (mean age, 71.5 years; female 49%) and 22,078 controls (mean age, 59.5 years; female 61%) comprised the development cohort. A 10-variable model using age, acute heart disease, albumin, body mass index, chronic obstructive pulmonary disease, gender, heart failure, insurance, kidney disease, and shock yielded the best performance (C-statistic, 0.80 [95% CI 0.79–0.80]). The model performed well in the validation cohort (C-statistic, 0.81 [95% CI 0.8–0.81]). In the EHR pilot, 7916/22,272 (35.5%; mean age, 66 years; female 50%) were identified as higher risk for AF; 5582 (70%) had CHA(2)DS(2)-VASc score ≥ 2. CONCLUSIONS: Using variables commonly available in the EHR, we created a predictive model to identify 2-year risk of developing AF in those previously without diagnosed AF. Successful POC implementation of the model in an EHR provided a practical strategy to identify patients who may benefit from interventions to reduce their stroke risk. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12911-021-01482-1. BioMed Central 2021-04-03 /pmc/articles/PMC8019173/ /pubmed/33812369 http://dx.doi.org/10.1186/s12911-021-01482-1 Text en © The Author(s) 2021 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research Article
Grout, Randall W.
Hui, Siu L.
Imler, Timothy D.
El-Azab, Sarah
Baker, Jarod
Sands, George H.
Ateya, Mohammad
Pike, Francis
Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED)
title Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED)
title_full Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED)
title_fullStr Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED)
title_full_unstemmed Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED)
title_short Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED)
title_sort development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (unafied)
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8019173/
https://www.ncbi.nlm.nih.gov/pubmed/33812369
http://dx.doi.org/10.1186/s12911-021-01482-1
work_keys_str_mv AT groutrandallw developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied
AT huisiul developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied
AT imlertimothyd developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied
AT elazabsarah developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied
AT bakerjarod developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied
AT sandsgeorgeh developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied
AT ateyamohammad developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied
AT pikefrancis developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied