Cargando…

Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer

BACKGROUND: Skeletal muscle loss during treatment is associated with poor survival outcomes in patients with ovarian cancer. Although changes in muscle mass can be assessed on computed tomography (CT) scans, this labour‐intensive process can impair its utility in clinical practice. This study aimed...

Descripción completa

Detalles Bibliográficos
Autores principales: Hsu, Wen‐Han, Ko, Ai‐Tung, Weng, Chia‐Sui, Chang, Chih‐Long, Jan, Ya‐Ting, Lin, Jhen‐Bin, Chien, Hung‐Ju, Lin, Wan‐Chun, Sun, Fang‐Ju, Wu, Kun‐Pin, Lee, Jie
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10570082/
https://www.ncbi.nlm.nih.gov/pubmed/37435785
http://dx.doi.org/10.1002/jcsm.13282
_version_ 1785119685805604864
author Hsu, Wen‐Han
Ko, Ai‐Tung
Weng, Chia‐Sui
Chang, Chih‐Long
Jan, Ya‐Ting
Lin, Jhen‐Bin
Chien, Hung‐Ju
Lin, Wan‐Chun
Sun, Fang‐Ju
Wu, Kun‐Pin
Lee, Jie
author_facet Hsu, Wen‐Han
Ko, Ai‐Tung
Weng, Chia‐Sui
Chang, Chih‐Long
Jan, Ya‐Ting
Lin, Jhen‐Bin
Chien, Hung‐Ju
Lin, Wan‐Chun
Sun, Fang‐Ju
Wu, Kun‐Pin
Lee, Jie
author_sort Hsu, Wen‐Han
collection PubMed
description BACKGROUND: Skeletal muscle loss during treatment is associated with poor survival outcomes in patients with ovarian cancer. Although changes in muscle mass can be assessed on computed tomography (CT) scans, this labour‐intensive process can impair its utility in clinical practice. This study aimed to develop a machine learning (ML) model to predict muscle loss based on clinical data and to interpret the ML model by applying SHapley Additive exPlanations (SHAP) method. METHODS: This study included the data of 617 patients with ovarian cancer who underwent primary debulking surgery and platinum‐based chemotherapy at a tertiary centre between 2010 and 2019. The cohort data were split into training and test sets based on the treatment time. External validation was performed using 140 patients from a different tertiary centre. The skeletal muscle index (SMI) was measured from pre‐ and post‐treatment CT scans, and a decrease in SMI ≥ 5% was defined as muscle loss. We evaluated five ML models to predict muscle loss, and their performance was determined using the area under the receiver operating characteristic curve (AUC) and F1 score. The features for analysis included demographic and disease‐specific characteristics and relative changes in body mass index (BMI), albumin, neutrophil‐to‐lymphocyte ratio (NLR), and platelet‐to‐lymphocyte ratio (PLR). The SHAP method was applied to determine the importance of the features and interpret the ML models. RESULTS: The median (inter‐quartile range) age of the cohort was 52 (46–59) years. After treatment, 204 patients (33.1%) experienced muscle loss in the training and test datasets, while 44 (31.4%) patients experienced muscle loss in the external validation dataset. Among the five evaluated ML models, the random forest model achieved the highest AUC (0.856, 95% confidence interval: 0.854–0.859) and F1 score (0.726, 95% confidence interval: 0.722–0.730). In the external validation, the random forest model outperformed all ML models with an AUC of 0.874 and an F1 score of 0.741. The results of the SHAP method showed that the albumin change, BMI change, malignant ascites, NLR change, and PLR change were the most important factors in muscle loss. At the patient level, SHAP force plots demonstrated insightful interpretation of our random forest model to predict muscle loss. CONCLUSIONS: Explainable ML model was developed using clinical data to identify patients experiencing muscle loss after treatment and provide information of feature contribution. Using the SHAP method, clinicians may better understand the contributors to muscle loss and target interventions to counteract muscle loss.
format Online
Article
Text
id pubmed-10570082
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-105700822023-10-14 Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer Hsu, Wen‐Han Ko, Ai‐Tung Weng, Chia‐Sui Chang, Chih‐Long Jan, Ya‐Ting Lin, Jhen‐Bin Chien, Hung‐Ju Lin, Wan‐Chun Sun, Fang‐Ju Wu, Kun‐Pin Lee, Jie J Cachexia Sarcopenia Muscle Original Articles BACKGROUND: Skeletal muscle loss during treatment is associated with poor survival outcomes in patients with ovarian cancer. Although changes in muscle mass can be assessed on computed tomography (CT) scans, this labour‐intensive process can impair its utility in clinical practice. This study aimed to develop a machine learning (ML) model to predict muscle loss based on clinical data and to interpret the ML model by applying SHapley Additive exPlanations (SHAP) method. METHODS: This study included the data of 617 patients with ovarian cancer who underwent primary debulking surgery and platinum‐based chemotherapy at a tertiary centre between 2010 and 2019. The cohort data were split into training and test sets based on the treatment time. External validation was performed using 140 patients from a different tertiary centre. The skeletal muscle index (SMI) was measured from pre‐ and post‐treatment CT scans, and a decrease in SMI ≥ 5% was defined as muscle loss. We evaluated five ML models to predict muscle loss, and their performance was determined using the area under the receiver operating characteristic curve (AUC) and F1 score. The features for analysis included demographic and disease‐specific characteristics and relative changes in body mass index (BMI), albumin, neutrophil‐to‐lymphocyte ratio (NLR), and platelet‐to‐lymphocyte ratio (PLR). The SHAP method was applied to determine the importance of the features and interpret the ML models. RESULTS: The median (inter‐quartile range) age of the cohort was 52 (46–59) years. After treatment, 204 patients (33.1%) experienced muscle loss in the training and test datasets, while 44 (31.4%) patients experienced muscle loss in the external validation dataset. Among the five evaluated ML models, the random forest model achieved the highest AUC (0.856, 95% confidence interval: 0.854–0.859) and F1 score (0.726, 95% confidence interval: 0.722–0.730). In the external validation, the random forest model outperformed all ML models with an AUC of 0.874 and an F1 score of 0.741. The results of the SHAP method showed that the albumin change, BMI change, malignant ascites, NLR change, and PLR change were the most important factors in muscle loss. At the patient level, SHAP force plots demonstrated insightful interpretation of our random forest model to predict muscle loss. CONCLUSIONS: Explainable ML model was developed using clinical data to identify patients experiencing muscle loss after treatment and provide information of feature contribution. Using the SHAP method, clinicians may better understand the contributors to muscle loss and target interventions to counteract muscle loss. John Wiley and Sons Inc. 2023-07-12 /pmc/articles/PMC10570082/ /pubmed/37435785 http://dx.doi.org/10.1002/jcsm.13282 Text en © 2023 The Authors. Journal of Cachexia, Sarcopenia and Muscle published by John Wiley & Sons Ltd on behalf of Society on Sarcopenia, Cachexia and Wasting Disorders. https://creativecommons.org/licenses/by-nc/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes.
spellingShingle Original Articles
Hsu, Wen‐Han
Ko, Ai‐Tung
Weng, Chia‐Sui
Chang, Chih‐Long
Jan, Ya‐Ting
Lin, Jhen‐Bin
Chien, Hung‐Ju
Lin, Wan‐Chun
Sun, Fang‐Ju
Wu, Kun‐Pin
Lee, Jie
Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer
title Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer
title_full Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer
title_fullStr Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer
title_full_unstemmed Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer
title_short Explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer
title_sort explainable machine learning model for predicting skeletal muscle loss during surgery and adjuvant chemotherapy in ovarian cancer
topic Original Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10570082/
https://www.ncbi.nlm.nih.gov/pubmed/37435785
http://dx.doi.org/10.1002/jcsm.13282
work_keys_str_mv AT hsuwenhan explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer
AT koaitung explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer
AT wengchiasui explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer
AT changchihlong explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer
AT janyating explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer
AT linjhenbin explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer
AT chienhungju explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer
AT linwanchun explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer
AT sunfangju explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer
AT wukunpin explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer
AT leejie explainablemachinelearningmodelforpredictingskeletalmusclelossduringsurgeryandadjuvantchemotherapyinovariancancer