Cargando…
Accurate Prediction of Coronary Heart Disease for Patients With Hypertension From Electronic Health Records With Big Data and Machine-Learning Methods: Model Development and Performance Evaluation
BACKGROUND: Predictions of cardiovascular disease risks based on health records have long attracted broad research interests. Despite extensive efforts, the prediction accuracy has remained unsatisfactory. This raises the question as to whether the data insufficiency, statistical and machine-learnin...
Autores principales: | , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7381262/ https://www.ncbi.nlm.nih.gov/pubmed/32628616 http://dx.doi.org/10.2196/17257 |
_version_ | 1783563012103208960 |
---|---|
author | Du, Zhenzhen Yang, Yujie Zheng, Jing Li, Qi Lin, Denan Li, Ye Fan, Jianping Cheng, Wen Chen, Xie-Hui Cai, Yunpeng |
author_facet | Du, Zhenzhen Yang, Yujie Zheng, Jing Li, Qi Lin, Denan Li, Ye Fan, Jianping Cheng, Wen Chen, Xie-Hui Cai, Yunpeng |
author_sort | Du, Zhenzhen |
collection | PubMed |
description | BACKGROUND: Predictions of cardiovascular disease risks based on health records have long attracted broad research interests. Despite extensive efforts, the prediction accuracy has remained unsatisfactory. This raises the question as to whether the data insufficiency, statistical and machine-learning methods, or intrinsic noise have hindered the performance of previous approaches, and how these issues can be alleviated. OBJECTIVE: Based on a large population of patients with hypertension in Shenzhen, China, we aimed to establish a high-precision coronary heart disease (CHD) prediction model through big data and machine-learning METHODS: Data from a large cohort of 42,676 patients with hypertension, including 20,156 patients with CHD onset, were investigated from electronic health records (EHRs) 1-3 years prior to CHD onset (for CHD-positive cases) or during a disease-free follow-up period of more than 3 years (for CHD-negative cases). The population was divided evenly into independent training and test datasets. Various machine-learning methods were adopted on the training set to achieve high-accuracy prediction models and the results were compared with traditional statistical methods and well-known risk scales. Comparison analyses were performed to investigate the effects of training sample size, factor sets, and modeling approaches on the prediction performance. RESULTS: An ensemble method, XGBoost, achieved high accuracy in predicting 3-year CHD onset for the independent test dataset with an area under the receiver operating characteristic curve (AUC) value of 0.943. Comparison analysis showed that nonlinear models (K-nearest neighbor AUC 0.908, random forest AUC 0.938) outperform linear models (logistic regression AUC 0.865) on the same datasets, and machine-learning methods significantly surpassed traditional risk scales or fixed models (eg, Framingham cardiovascular disease risk models). Further analyses revealed that using time-dependent features obtained from multiple records, including both statistical variables and changing-trend variables, helped to improve the performance compared to using only static features. Subpopulation analysis showed that the impact of feature design had a more significant effect on model accuracy than the population size. Marginal effect analysis showed that both traditional and EHR factors exhibited highly nonlinear characteristics with respect to the risk scores. CONCLUSIONS: We demonstrated that accurate risk prediction of CHD from EHRs is possible given a sufficiently large population of training data. Sophisticated machine-learning methods played an important role in tackling the heterogeneity and nonlinear nature of disease prediction. Moreover, accumulated EHR data over multiple time points provided additional features that were valuable for risk prediction. Our study highlights the importance of accumulating big data from EHRs for accurate disease predictions. |
format | Online Article Text |
id | pubmed-7381262 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-73812622020-08-07 Accurate Prediction of Coronary Heart Disease for Patients With Hypertension From Electronic Health Records With Big Data and Machine-Learning Methods: Model Development and Performance Evaluation Du, Zhenzhen Yang, Yujie Zheng, Jing Li, Qi Lin, Denan Li, Ye Fan, Jianping Cheng, Wen Chen, Xie-Hui Cai, Yunpeng JMIR Med Inform Original Paper BACKGROUND: Predictions of cardiovascular disease risks based on health records have long attracted broad research interests. Despite extensive efforts, the prediction accuracy has remained unsatisfactory. This raises the question as to whether the data insufficiency, statistical and machine-learning methods, or intrinsic noise have hindered the performance of previous approaches, and how these issues can be alleviated. OBJECTIVE: Based on a large population of patients with hypertension in Shenzhen, China, we aimed to establish a high-precision coronary heart disease (CHD) prediction model through big data and machine-learning METHODS: Data from a large cohort of 42,676 patients with hypertension, including 20,156 patients with CHD onset, were investigated from electronic health records (EHRs) 1-3 years prior to CHD onset (for CHD-positive cases) or during a disease-free follow-up period of more than 3 years (for CHD-negative cases). The population was divided evenly into independent training and test datasets. Various machine-learning methods were adopted on the training set to achieve high-accuracy prediction models and the results were compared with traditional statistical methods and well-known risk scales. Comparison analyses were performed to investigate the effects of training sample size, factor sets, and modeling approaches on the prediction performance. RESULTS: An ensemble method, XGBoost, achieved high accuracy in predicting 3-year CHD onset for the independent test dataset with an area under the receiver operating characteristic curve (AUC) value of 0.943. Comparison analysis showed that nonlinear models (K-nearest neighbor AUC 0.908, random forest AUC 0.938) outperform linear models (logistic regression AUC 0.865) on the same datasets, and machine-learning methods significantly surpassed traditional risk scales or fixed models (eg, Framingham cardiovascular disease risk models). Further analyses revealed that using time-dependent features obtained from multiple records, including both statistical variables and changing-trend variables, helped to improve the performance compared to using only static features. Subpopulation analysis showed that the impact of feature design had a more significant effect on model accuracy than the population size. Marginal effect analysis showed that both traditional and EHR factors exhibited highly nonlinear characteristics with respect to the risk scores. CONCLUSIONS: We demonstrated that accurate risk prediction of CHD from EHRs is possible given a sufficiently large population of training data. Sophisticated machine-learning methods played an important role in tackling the heterogeneity and nonlinear nature of disease prediction. Moreover, accumulated EHR data over multiple time points provided additional features that were valuable for risk prediction. Our study highlights the importance of accumulating big data from EHRs for accurate disease predictions. JMIR Publications 2020-07-06 /pmc/articles/PMC7381262/ /pubmed/32628616 http://dx.doi.org/10.2196/17257 Text en ©Zhenzhen Du, Yujie Yang, Jing Zheng, Qi Li, Denan Lin, Ye Li, Jianping Fan, Wen Cheng, Xie-Hui Chen, Yunpeng Cai. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 06.07.2020. https://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Du, Zhenzhen Yang, Yujie Zheng, Jing Li, Qi Lin, Denan Li, Ye Fan, Jianping Cheng, Wen Chen, Xie-Hui Cai, Yunpeng Accurate Prediction of Coronary Heart Disease for Patients With Hypertension From Electronic Health Records With Big Data and Machine-Learning Methods: Model Development and Performance Evaluation |
title | Accurate Prediction of Coronary Heart Disease for Patients With Hypertension From Electronic Health Records With Big Data and Machine-Learning Methods: Model Development and Performance Evaluation |
title_full | Accurate Prediction of Coronary Heart Disease for Patients With Hypertension From Electronic Health Records With Big Data and Machine-Learning Methods: Model Development and Performance Evaluation |
title_fullStr | Accurate Prediction of Coronary Heart Disease for Patients With Hypertension From Electronic Health Records With Big Data and Machine-Learning Methods: Model Development and Performance Evaluation |
title_full_unstemmed | Accurate Prediction of Coronary Heart Disease for Patients With Hypertension From Electronic Health Records With Big Data and Machine-Learning Methods: Model Development and Performance Evaluation |
title_short | Accurate Prediction of Coronary Heart Disease for Patients With Hypertension From Electronic Health Records With Big Data and Machine-Learning Methods: Model Development and Performance Evaluation |
title_sort | accurate prediction of coronary heart disease for patients with hypertension from electronic health records with big data and machine-learning methods: model development and performance evaluation |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7381262/ https://www.ncbi.nlm.nih.gov/pubmed/32628616 http://dx.doi.org/10.2196/17257 |
work_keys_str_mv | AT duzhenzhen accuratepredictionofcoronaryheartdiseaseforpatientswithhypertensionfromelectronichealthrecordswithbigdataandmachinelearningmethodsmodeldevelopmentandperformanceevaluation AT yangyujie accuratepredictionofcoronaryheartdiseaseforpatientswithhypertensionfromelectronichealthrecordswithbigdataandmachinelearningmethodsmodeldevelopmentandperformanceevaluation AT zhengjing accuratepredictionofcoronaryheartdiseaseforpatientswithhypertensionfromelectronichealthrecordswithbigdataandmachinelearningmethodsmodeldevelopmentandperformanceevaluation AT liqi accuratepredictionofcoronaryheartdiseaseforpatientswithhypertensionfromelectronichealthrecordswithbigdataandmachinelearningmethodsmodeldevelopmentandperformanceevaluation AT lindenan accuratepredictionofcoronaryheartdiseaseforpatientswithhypertensionfromelectronichealthrecordswithbigdataandmachinelearningmethodsmodeldevelopmentandperformanceevaluation AT liye accuratepredictionofcoronaryheartdiseaseforpatientswithhypertensionfromelectronichealthrecordswithbigdataandmachinelearningmethodsmodeldevelopmentandperformanceevaluation AT fanjianping accuratepredictionofcoronaryheartdiseaseforpatientswithhypertensionfromelectronichealthrecordswithbigdataandmachinelearningmethodsmodeldevelopmentandperformanceevaluation AT chengwen accuratepredictionofcoronaryheartdiseaseforpatientswithhypertensionfromelectronichealthrecordswithbigdataandmachinelearningmethodsmodeldevelopmentandperformanceevaluation AT chenxiehui accuratepredictionofcoronaryheartdiseaseforpatientswithhypertensionfromelectronichealthrecordswithbigdataandmachinelearningmethodsmodeldevelopmentandperformanceevaluation AT caiyunpeng accuratepredictionofcoronaryheartdiseaseforpatientswithhypertensionfromelectronichealthrecordswithbigdataandmachinelearningmethodsmodeldevelopmentandperformanceevaluation |