Cargando…
Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED)
BACKGROUND: Many patients with atrial fibrillation (AF) remain undiagnosed despite availability of interventions to reduce stroke risk. Predictive models to date are limited by data requirements and theoretical usage. We aimed to develop a model for predicting the 2-year probability of AF diagnosis...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8019173/ https://www.ncbi.nlm.nih.gov/pubmed/33812369 http://dx.doi.org/10.1186/s12911-021-01482-1 |
_version_ | 1783674326139011072 |
---|---|
author | Grout, Randall W. Hui, Siu L. Imler, Timothy D. El-Azab, Sarah Baker, Jarod Sands, George H. Ateya, Mohammad Pike, Francis |
author_facet | Grout, Randall W. Hui, Siu L. Imler, Timothy D. El-Azab, Sarah Baker, Jarod Sands, George H. Ateya, Mohammad Pike, Francis |
author_sort | Grout, Randall W. |
collection | PubMed |
description | BACKGROUND: Many patients with atrial fibrillation (AF) remain undiagnosed despite availability of interventions to reduce stroke risk. Predictive models to date are limited by data requirements and theoretical usage. We aimed to develop a model for predicting the 2-year probability of AF diagnosis and implement it as proof-of-concept (POC) in a production electronic health record (EHR). METHODS: We used a nested case–control design using data from the Indiana Network for Patient Care. The development cohort came from 2016 to 2017 (outcome period) and 2014 to 2015 (baseline). A separate validation cohort used outcome and baseline periods shifted 2 years before respective development cohort times. Machine learning approaches were used to build predictive model. Patients ≥ 18 years, later restricted to age ≥ 40 years, with at least two encounters and no AF during baseline, were included. In the 6-week EHR prospective pilot, the model was silently implemented in the production system at a large safety-net urban hospital. Three new and two previous logistic regression models were evaluated using receiver-operating characteristics. Number, characteristics, and CHA(2)DS(2)-VASc scores of patients identified by the model in the pilot are presented. RESULTS: After restricting age to ≥ 40 years, 31,474 AF cases (mean age, 71.5 years; female 49%) and 22,078 controls (mean age, 59.5 years; female 61%) comprised the development cohort. A 10-variable model using age, acute heart disease, albumin, body mass index, chronic obstructive pulmonary disease, gender, heart failure, insurance, kidney disease, and shock yielded the best performance (C-statistic, 0.80 [95% CI 0.79–0.80]). The model performed well in the validation cohort (C-statistic, 0.81 [95% CI 0.8–0.81]). In the EHR pilot, 7916/22,272 (35.5%; mean age, 66 years; female 50%) were identified as higher risk for AF; 5582 (70%) had CHA(2)DS(2)-VASc score ≥ 2. CONCLUSIONS: Using variables commonly available in the EHR, we created a predictive model to identify 2-year risk of developing AF in those previously without diagnosed AF. Successful POC implementation of the model in an EHR provided a practical strategy to identify patients who may benefit from interventions to reduce their stroke risk. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12911-021-01482-1. |
format | Online Article Text |
id | pubmed-8019173 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-80191732021-04-05 Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED) Grout, Randall W. Hui, Siu L. Imler, Timothy D. El-Azab, Sarah Baker, Jarod Sands, George H. Ateya, Mohammad Pike, Francis BMC Med Inform Decis Mak Research Article BACKGROUND: Many patients with atrial fibrillation (AF) remain undiagnosed despite availability of interventions to reduce stroke risk. Predictive models to date are limited by data requirements and theoretical usage. We aimed to develop a model for predicting the 2-year probability of AF diagnosis and implement it as proof-of-concept (POC) in a production electronic health record (EHR). METHODS: We used a nested case–control design using data from the Indiana Network for Patient Care. The development cohort came from 2016 to 2017 (outcome period) and 2014 to 2015 (baseline). A separate validation cohort used outcome and baseline periods shifted 2 years before respective development cohort times. Machine learning approaches were used to build predictive model. Patients ≥ 18 years, later restricted to age ≥ 40 years, with at least two encounters and no AF during baseline, were included. In the 6-week EHR prospective pilot, the model was silently implemented in the production system at a large safety-net urban hospital. Three new and two previous logistic regression models were evaluated using receiver-operating characteristics. Number, characteristics, and CHA(2)DS(2)-VASc scores of patients identified by the model in the pilot are presented. RESULTS: After restricting age to ≥ 40 years, 31,474 AF cases (mean age, 71.5 years; female 49%) and 22,078 controls (mean age, 59.5 years; female 61%) comprised the development cohort. A 10-variable model using age, acute heart disease, albumin, body mass index, chronic obstructive pulmonary disease, gender, heart failure, insurance, kidney disease, and shock yielded the best performance (C-statistic, 0.80 [95% CI 0.79–0.80]). The model performed well in the validation cohort (C-statistic, 0.81 [95% CI 0.8–0.81]). In the EHR pilot, 7916/22,272 (35.5%; mean age, 66 years; female 50%) were identified as higher risk for AF; 5582 (70%) had CHA(2)DS(2)-VASc score ≥ 2. CONCLUSIONS: Using variables commonly available in the EHR, we created a predictive model to identify 2-year risk of developing AF in those previously without diagnosed AF. Successful POC implementation of the model in an EHR provided a practical strategy to identify patients who may benefit from interventions to reduce their stroke risk. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12911-021-01482-1. BioMed Central 2021-04-03 /pmc/articles/PMC8019173/ /pubmed/33812369 http://dx.doi.org/10.1186/s12911-021-01482-1 Text en © The Author(s) 2021 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Research Article Grout, Randall W. Hui, Siu L. Imler, Timothy D. El-Azab, Sarah Baker, Jarod Sands, George H. Ateya, Mohammad Pike, Francis Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED) |
title | Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED) |
title_full | Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED) |
title_fullStr | Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED) |
title_full_unstemmed | Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED) |
title_short | Development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (UNAFIED) |
title_sort | development, validation, and proof-of-concept implementation of a two-year risk prediction model for undiagnosed atrial fibrillation using common electronic health data (unafied) |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8019173/ https://www.ncbi.nlm.nih.gov/pubmed/33812369 http://dx.doi.org/10.1186/s12911-021-01482-1 |
work_keys_str_mv | AT groutrandallw developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied AT huisiul developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied AT imlertimothyd developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied AT elazabsarah developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied AT bakerjarod developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied AT sandsgeorgeh developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied AT ateyamohammad developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied AT pikefrancis developmentvalidationandproofofconceptimplementationofatwoyearriskpredictionmodelforundiagnosedatrialfibrillationusingcommonelectronichealthdataunafied |