Cargando…
Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer
BACKGROUND: Skeletal muscle loss during treatment is associated with poor survival outcomes in patients with ovarian cancer. Although changes in muscle mass can be assessed on computed tomography (CT) scans, this labour‐intensive process can impair its utility in clinical practice. This study aimed...
Autores principales: | , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley and Sons Inc.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10570082/ https://www.ncbi.nlm.nih.gov/pubmed/37435785 http://dx.doi.org/10.1002/jcsm.13282 |
_version_ | 1785119685805604864 |
---|---|
author | Hsu, Wen‐Han Ko, Ai‐Tung Weng, Chia‐Sui Chang, Chih‐Long Jan, Ya‐Ting Lin, Jhen‐Bin Chien, Hung‐Ju Lin, Wan‐Chun Sun, Fang‐Ju Wu, Kun‐Pin Lee, Jie |
author_facet | Hsu, Wen‐Han Ko, Ai‐Tung Weng, Chia‐Sui Chang, Chih‐Long Jan, Ya‐Ting Lin, Jhen‐Bin Chien, Hung‐Ju Lin, Wan‐Chun Sun, Fang‐Ju Wu, Kun‐Pin Lee, Jie |
author_sort | Hsu, Wen‐Han |
collection | PubMed |
description | BACKGROUND: Skeletal muscle loss during treatment is associated with poor survival outcomes in patients with ovarian cancer. Although changes in muscle mass can be assessed on computed tomography (CT) scans, this labour‐intensive process can impair its utility in clinical practice. This study aimed to develop a machine learning (ML) model to predict muscle loss based on clinical data and to interpret the ML model by applying SHapley Additive exPlanations (SHAP) method. METHODS: This study included the data of 617 patients with ovarian cancer who underwent primary debulking surgery and platinum‐based chemotherapy at a tertiary centre between 2010 and 2019. The cohort data were split into training and test sets based on the treatment time. External validation was performed using 140 patients from a different tertiary centre. The skeletal muscle index (SMI) was measured from pre‐ and post‐treatment CT scans, and a decrease in SMI ≥ 5% was defined as muscle loss. We evaluated five ML models to predict muscle loss, and their performance was determined using the area under the receiver operating characteristic curve (AUC) and F1 score. The features for analysis included demographic and disease‐specific characteristics and relative changes in body mass index (BMI), albumin, neutrophil‐to‐lymphocyte ratio (NLR), and platelet‐to‐lymphocyte ratio (PLR). The SHAP method was applied to determine the importance of the features and interpret the ML models. RESULTS: The median (inter‐quartile range) age of the cohort was 52 (46–59) years. After treatment, 204 patients (33.1%) experienced muscle loss in the training and test datasets, while 44 (31.4%) patients experienced muscle loss in the external validation dataset. Among the five evaluated ML models, the random forest model achieved the highest AUC (0.856, 95% confidence interval: 0.854–0.859) and F1 score (0.726, 95% confidence interval: 0.722–0.730). In the external validation, the random forest model outperformed all ML models with an AUC of 0.874 and an F1 score of 0.741. The results of the SHAP method showed that the albumin change, BMI change, malignant ascites, NLR change, and PLR change were the most important factors in muscle loss. At the patient level, SHAP force plots demonstrated insightful interpretation of our random forest model to predict muscle loss. CONCLUSIONS: Explainable ML model was developed using clinical data to identify patients experiencing muscle loss after treatment and provide information of feature contribution. Using the SHAP method, clinicians may better understand the contributors to muscle loss and target interventions to counteract muscle loss. |
format | Online Article Text |
id | pubmed-10570082 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | John Wiley and Sons Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-105700822023-10-14 Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer Hsu, Wen‐Han Ko, Ai‐Tung Weng, Chia‐Sui Chang, Chih‐Long Jan, Ya‐Ting Lin, Jhen‐Bin Chien, Hung‐Ju Lin, Wan‐Chun Sun, Fang‐Ju Wu, Kun‐Pin Lee, Jie J Cachexia Sarcopenia Muscle Original Articles BACKGROUND: Skeletal muscle loss during treatment is associated with poor survival outcomes in patients with ovarian cancer. Although changes in muscle mass can be assessed on computed tomography (CT) scans, this labour‐intensive process can impair its utility in clinical practice. This study aimed to develop a machine learning (ML) model to predict muscle loss based on clinical data and to interpret the ML model by applying SHapley Additive exPlanations (SHAP) method. METHODS: This study included the data of 617 patients with ovarian cancer who underwent primary debulking surgery and platinum‐based chemotherapy at a tertiary centre between 2010 and 2019. The cohort data were split into training and test sets based on the treatment time. External validation was performed using 140 patients from a different tertiary centre. The skeletal muscle index (SMI) was measured from pre‐ and post‐treatment CT scans, and a decrease in SMI ≥ 5% was defined as muscle loss. We evaluated five ML models to predict muscle loss, and their performance was determined using the area under the receiver operating characteristic curve (AUC) and F1 score. The features for analysis included demographic and disease‐specific characteristics and relative changes in body mass index (BMI), albumin, neutrophil‐to‐lymphocyte ratio (NLR), and platelet‐to‐lymphocyte ratio (PLR). The SHAP method was applied to determine the importance of the features and interpret the ML models. RESULTS: The median (inter‐quartile range) age of the cohort was 52 (46–59) years. After treatment, 204 patients (33.1%) experienced muscle loss in the training and test datasets, while 44 (31.4%) patients experienced muscle loss in the external validation dataset. Among the five evaluated ML models, the random forest model achieved the highest AUC (0.856, 95% confidence interval: 0.854–0.859) and F1 score (0.726, 95% confidence interval: 0.722–0.730). In the external validation, the random forest model outperformed all ML models with an AUC of 0.874 and an F1 score of 0.741. The results of the SHAP method showed that the albumin change, BMI change, malignant ascites, NLR change, and PLR change were the most important factors in muscle loss. At the patient level, SHAP force plots demonstrated insightful interpretation of our random forest model to predict muscle loss. CONCLUSIONS: Explainable ML model was developed using clinical data to identify patients experiencing muscle loss after treatment and provide information of feature contribution. Using the SHAP method, clinicians may better understand the contributors to muscle loss and target interventions to counteract muscle loss. John Wiley and Sons Inc. 2023-07-12 /pmc/articles/PMC10570082/ /pubmed/37435785 http://dx.doi.org/10.1002/jcsm.13282 Text en © 2023 The Authors. Journal of Cachexia, Sarcopenia and Muscle published by John Wiley & Sons Ltd on behalf of Society on Sarcopenia, Cachexia and Wasting Disorders. https://creativecommons.org/licenses/by-nc/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes. |
spellingShingle | Original Articles Hsu, Wen‐Han Ko, Ai‐Tung Weng, Chia‐Sui Chang, Chih‐Long Jan, Ya‐Ting Lin, Jhen‐Bin Chien, Hung‐Ju Lin, Wan‐Chun Sun, Fang‐Ju Wu, Kun‐Pin Lee, Jie Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer |
title | Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer |
title_full | Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer |
title_fullStr | Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer |
title_full_unstemmed | Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer |
title_short | Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer |
title_sort | explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer |
topic | Original Articles |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10570082/ https://www.ncbi.nlm.nih.gov/pubmed/37435785 http://dx.doi.org/10.1002/jcsm.13282 |
work_keys_str_mv | AT hsuwenhan explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer AT koaitung explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer AT wengchiasui explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer AT changchihlong explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer AT janyating explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer AT linjhenbin explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer AT chienhungju explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer AT linwanchun explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer AT sunfangju explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer AT wukunpin explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer AT leejie explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer |