Cargando…

A hybrid stacked ensemble and Kernel SHAP-based model for intelligent cardiotocography classification and interpretability

BACKGROUND: Intelligent cardiotocography (CTG) classification can assist obstetricians in evaluating fetal health. However, high classification performance is often achieved by complex machine learning (ML)-based models, which causes interpretability concerns. The trade-off between accuracy and inte...

Descripción completa

Detalles Bibliográficos
Autores principales: Feng, Junyuan, Liang, Jincheng, Qiang, Zihan, Hao, Yuexing, Li, Xia, Li, Li, Chen, Qinqun, Liu, Guiqing, Wei, Hang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10685618/
https://www.ncbi.nlm.nih.gov/pubmed/38017460
http://dx.doi.org/10.1186/s12911-023-02378-y
_version_ 1785151673887358976
author Feng, Junyuan
Liang, Jincheng
Qiang, Zihan
Hao, Yuexing
Li, Xia
Li, Li
Chen, Qinqun
Liu, Guiqing
Wei, Hang
author_facet Feng, Junyuan
Liang, Jincheng
Qiang, Zihan
Hao, Yuexing
Li, Xia
Li, Li
Chen, Qinqun
Liu, Guiqing
Wei, Hang
author_sort Feng, Junyuan
collection PubMed
description BACKGROUND: Intelligent cardiotocography (CTG) classification can assist obstetricians in evaluating fetal health. However, high classification performance is often achieved by complex machine learning (ML)-based models, which causes interpretability concerns. The trade-off between accuracy and interpretability makes it challenging for most existing ML-based CTG classification models to popularize in prenatal clinical applications. METHODS: Aiming to improve CTG classification performance and prediction interpretability, a hybrid model was proposed using a stacked ensemble strategy with mixed features and Kernel SHapley Additive exPlanations (SHAP) framework. Firstly, the stacked ensemble classifier was established by employing support vector machines (SVM), extreme gradient boosting (XGB), and random forests (RF) as base learners, and backpropagation (BP) as a meta learner whose input was mixed with the CTG features and the probability value of each category output by base learners. Then, the public and private CTG datasets were used to verify the discriminative performance. Furthermore, Kernel SHAP was applied to estimate the contribution values of features and their relationships to the fetal states. RESULTS: For intelligent CTG classification using 10-fold cross-validation, the accuracy and average F1 score were 0.9539 and 0.9249 in the public dataset, respectively; and those were 0.9201 and 0.8926 in the private dataset, respectively. For interpretability, the explanation results indicated that accelerations (AC) and the percentage of time with abnormal short-term variability (ASTV) were the key determinants. Specifically, the probability of abnormality increased and that of the normal state decreased as the value of ASTV grew. In addition, the likelihood of the normal status rose with the increase of AC. CONCLUSIONS: The proposed model has high classification performance and reasonable interpretability for intelligent fetal monitoring.
format Online
Article
Text
id pubmed-10685618
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-106856182023-11-30 A hybrid stacked ensemble and Kernel SHAP-based model for intelligent cardiotocography classification and interpretability Feng, Junyuan Liang, Jincheng Qiang, Zihan Hao, Yuexing Li, Xia Li, Li Chen, Qinqun Liu, Guiqing Wei, Hang BMC Med Inform Decis Mak Research Article BACKGROUND: Intelligent cardiotocography (CTG) classification can assist obstetricians in evaluating fetal health. However, high classification performance is often achieved by complex machine learning (ML)-based models, which causes interpretability concerns. The trade-off between accuracy and interpretability makes it challenging for most existing ML-based CTG classification models to popularize in prenatal clinical applications. METHODS: Aiming to improve CTG classification performance and prediction interpretability, a hybrid model was proposed using a stacked ensemble strategy with mixed features and Kernel SHapley Additive exPlanations (SHAP) framework. Firstly, the stacked ensemble classifier was established by employing support vector machines (SVM), extreme gradient boosting (XGB), and random forests (RF) as base learners, and backpropagation (BP) as a meta learner whose input was mixed with the CTG features and the probability value of each category output by base learners. Then, the public and private CTG datasets were used to verify the discriminative performance. Furthermore, Kernel SHAP was applied to estimate the contribution values of features and their relationships to the fetal states. RESULTS: For intelligent CTG classification using 10-fold cross-validation, the accuracy and average F1 score were 0.9539 and 0.9249 in the public dataset, respectively; and those were 0.9201 and 0.8926 in the private dataset, respectively. For interpretability, the explanation results indicated that accelerations (AC) and the percentage of time with abnormal short-term variability (ASTV) were the key determinants. Specifically, the probability of abnormality increased and that of the normal state decreased as the value of ASTV grew. In addition, the likelihood of the normal status rose with the increase of AC. CONCLUSIONS: The proposed model has high classification performance and reasonable interpretability for intelligent fetal monitoring. BioMed Central 2023-11-28 /pmc/articles/PMC10685618/ /pubmed/38017460 http://dx.doi.org/10.1186/s12911-023-02378-y Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research Article
Feng, Junyuan
Liang, Jincheng
Qiang, Zihan
Hao, Yuexing
Li, Xia
Li, Li
Chen, Qinqun
Liu, Guiqing
Wei, Hang
A hybrid stacked ensemble and Kernel SHAP-based model for intelligent cardiotocography classification and interpretability
title A hybrid stacked ensemble and Kernel SHAP-based model for intelligent cardiotocography classification and interpretability
title_full A hybrid stacked ensemble and Kernel SHAP-based model for intelligent cardiotocography classification and interpretability
title_fullStr A hybrid stacked ensemble and Kernel SHAP-based model for intelligent cardiotocography classification and interpretability
title_full_unstemmed A hybrid stacked ensemble and Kernel SHAP-based model for intelligent cardiotocography classification and interpretability
title_short A hybrid stacked ensemble and Kernel SHAP-based model for intelligent cardiotocography classification and interpretability
title_sort hybrid stacked ensemble and kernel shap-based model for intelligent cardiotocography classification and interpretability
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10685618/
https://www.ncbi.nlm.nih.gov/pubmed/38017460
http://dx.doi.org/10.1186/s12911-023-02378-y
work_keys_str_mv AT fengjunyuan ahybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT liangjincheng ahybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT qiangzihan ahybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT haoyuexing ahybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT lixia ahybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT lili ahybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT chenqinqun ahybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT liuguiqing ahybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT weihang ahybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT fengjunyuan hybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT liangjincheng hybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT qiangzihan hybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT haoyuexing hybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT lixia hybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT lili hybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT chenqinqun hybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT liuguiqing hybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability
AT weihang hybridstackedensembleandkernelshapbasedmodelforintelligentcardiotocographyclassificationandinterpretability