Cargando…
Machine Learning to Dynamically Predict In-Hospital Venous Thromboembolism After Inguinal Hernia Surgery: Results From the CHAT-1 Study
BACKGROUND: The accuracy of current prediction tools for venous thromboembolism (VTE) events following hernia surgery remains insufficient for individualized patient management strategies. To address this issue, we have developed a machine learning (ML)-based model to dynamically predict in-hospital...
Autores principales: | , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
SAGE Publications
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10134160/ https://www.ncbi.nlm.nih.gov/pubmed/37094089 http://dx.doi.org/10.1177/10760296231171082 |
_version_ | 1785031699278594048 |
---|---|
author | Yan, Yi–Dan Yu, Ze Ding, Lan-Ping Zhou, Min Zhang, Chi Pan, Mang-Mang Zhang, Jin-Yuan Wang, Ze-Yuan Gao, Fei Li, Hang-Yu Zhang, Guang-Yong Lin, Hou-Wen Wang, Ming-Gang Gu, Zhi–Chun |
author_facet | Yan, Yi–Dan Yu, Ze Ding, Lan-Ping Zhou, Min Zhang, Chi Pan, Mang-Mang Zhang, Jin-Yuan Wang, Ze-Yuan Gao, Fei Li, Hang-Yu Zhang, Guang-Yong Lin, Hou-Wen Wang, Ming-Gang Gu, Zhi–Chun |
author_sort | Yan, Yi–Dan |
collection | PubMed |
description | BACKGROUND: The accuracy of current prediction tools for venous thromboembolism (VTE) events following hernia surgery remains insufficient for individualized patient management strategies. To address this issue, we have developed a machine learning (ML)-based model to dynamically predict in-hospital VTE in Chinese patients after hernia surgery. METHODS: ML models for the prediction of postoperative VTE were trained on a cohort of 11 305 adult patients with hernia from the CHAT-1 trial, which included patients across 58 institutions in China. In data processing, data imputation was conducted using random forest (RF) algorithm, and balanced sampling was done by adaptive synthetic sampling algorithm. Data were split into a training cohort (80%) and internal validation cohort (20%) prior to oversampling. Clinical features available pre-operatively and postoperatively were separately selected using the Sequence Forward Selection algorithm. Nine-candidate ML models were applied to the pre-operative and combined datasets, and their performance was evaluated using various metrics, including area under the receiver operating characteristic curve (AUROC). Model interpretations were generated using importance scores, which were calculated by transforming model features into scaled variables and representing them in radar plots. RESULTS: The modeling cohort included 2856 patients, divided into 2536 cases for derivation and 320 cases for validation. Eleven pre-operative variables and 15 combined variables were explored as predictors related to in-hospital VTE. Acceptable-performing models for pre-operative data had an AUROC ≥ 0.60, including logistic regression, support vector machine with linear kernel (SVM_Linear), attentive interpretable Tabular learning (TabNet), and RF. For combined data, logistic regression, SVM_Linear, and TabNet had better performance, with an AUROC ≥ 0.65 for each model. Based on these models, 7 pre-operative predictors and 10 combined predictors were depicted in radar plots. CONCLUSIONS: A ML-based approach for the identification of in-hospital VTE events after hernia surgery is feasible. TabNet showed acceptable performance, and might be useful to guide clinical decision making and VTE prevention. Further validated study will strengthen this finding. |
format | Online Article Text |
id | pubmed-10134160 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | SAGE Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-101341602023-04-28 Machine Learning to Dynamically Predict In-Hospital Venous Thromboembolism After Inguinal Hernia Surgery: Results From the CHAT-1 Study Yan, Yi–Dan Yu, Ze Ding, Lan-Ping Zhou, Min Zhang, Chi Pan, Mang-Mang Zhang, Jin-Yuan Wang, Ze-Yuan Gao, Fei Li, Hang-Yu Zhang, Guang-Yong Lin, Hou-Wen Wang, Ming-Gang Gu, Zhi–Chun Clin Appl Thromb Hemost Original Manuscript BACKGROUND: The accuracy of current prediction tools for venous thromboembolism (VTE) events following hernia surgery remains insufficient for individualized patient management strategies. To address this issue, we have developed a machine learning (ML)-based model to dynamically predict in-hospital VTE in Chinese patients after hernia surgery. METHODS: ML models for the prediction of postoperative VTE were trained on a cohort of 11 305 adult patients with hernia from the CHAT-1 trial, which included patients across 58 institutions in China. In data processing, data imputation was conducted using random forest (RF) algorithm, and balanced sampling was done by adaptive synthetic sampling algorithm. Data were split into a training cohort (80%) and internal validation cohort (20%) prior to oversampling. Clinical features available pre-operatively and postoperatively were separately selected using the Sequence Forward Selection algorithm. Nine-candidate ML models were applied to the pre-operative and combined datasets, and their performance was evaluated using various metrics, including area under the receiver operating characteristic curve (AUROC). Model interpretations were generated using importance scores, which were calculated by transforming model features into scaled variables and representing them in radar plots. RESULTS: The modeling cohort included 2856 patients, divided into 2536 cases for derivation and 320 cases for validation. Eleven pre-operative variables and 15 combined variables were explored as predictors related to in-hospital VTE. Acceptable-performing models for pre-operative data had an AUROC ≥ 0.60, including logistic regression, support vector machine with linear kernel (SVM_Linear), attentive interpretable Tabular learning (TabNet), and RF. For combined data, logistic regression, SVM_Linear, and TabNet had better performance, with an AUROC ≥ 0.65 for each model. Based on these models, 7 pre-operative predictors and 10 combined predictors were depicted in radar plots. CONCLUSIONS: A ML-based approach for the identification of in-hospital VTE events after hernia surgery is feasible. TabNet showed acceptable performance, and might be useful to guide clinical decision making and VTE prevention. Further validated study will strengthen this finding. SAGE Publications 2023-04-24 /pmc/articles/PMC10134160/ /pubmed/37094089 http://dx.doi.org/10.1177/10760296231171082 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by-nc/4.0/This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage). |
spellingShingle | Original Manuscript Yan, Yi–Dan Yu, Ze Ding, Lan-Ping Zhou, Min Zhang, Chi Pan, Mang-Mang Zhang, Jin-Yuan Wang, Ze-Yuan Gao, Fei Li, Hang-Yu Zhang, Guang-Yong Lin, Hou-Wen Wang, Ming-Gang Gu, Zhi–Chun Machine Learning to Dynamically Predict In-Hospital Venous Thromboembolism After Inguinal Hernia Surgery: Results From the CHAT-1 Study |
title | Machine Learning to Dynamically Predict
In-Hospital Venous Thromboembolism
After Inguinal Hernia Surgery: Results
From the CHAT-1 Study |
title_full | Machine Learning to Dynamically Predict
In-Hospital Venous Thromboembolism
After Inguinal Hernia Surgery: Results
From the CHAT-1 Study |
title_fullStr | Machine Learning to Dynamically Predict
In-Hospital Venous Thromboembolism
After Inguinal Hernia Surgery: Results
From the CHAT-1 Study |
title_full_unstemmed | Machine Learning to Dynamically Predict
In-Hospital Venous Thromboembolism
After Inguinal Hernia Surgery: Results
From the CHAT-1 Study |
title_short | Machine Learning to Dynamically Predict
In-Hospital Venous Thromboembolism
After Inguinal Hernia Surgery: Results
From the CHAT-1 Study |
title_sort | machine learning to dynamically predict
in-hospital venous thromboembolism
after inguinal hernia surgery: results
from the chat-1 study |
topic | Original Manuscript |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10134160/ https://www.ncbi.nlm.nih.gov/pubmed/37094089 http://dx.doi.org/10.1177/10760296231171082 |
work_keys_str_mv | AT yanyidan machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT yuze machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT dinglanping machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT zhoumin machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT zhangchi machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT panmangmang machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT zhangjinyuan machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT wangzeyuan machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT gaofei machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT lihangyu machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT zhangguangyong machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT linhouwen machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT wangminggang machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study AT guzhichun machinelearningtodynamicallypredictinhospitalvenousthromboembolismafteringuinalherniasurgeryresultsfromthechat1study |