Cargando…

Machine learning explainability in nasopharyngeal cancer survival using LIME and SHAP

Nasopharyngeal cancer (NPC) has a unique histopathology compared with other head and neck cancers. Individual NPC patients may attain different outcomes. This study aims to build a prognostic system by combining a highly accurate machine learning model (ML) model with explainable artificial intellig...

Descripción completa

Detalles Bibliográficos
Autores principales: Alabi, Rasheed Omobolaji, Elmusrati, Mohammed, Leivo, Ilmo, Almangush, Alhadi, Mäkitie, Antti A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10238539/
https://www.ncbi.nlm.nih.gov/pubmed/37268685
http://dx.doi.org/10.1038/s41598-023-35795-0
_version_ 1785053316765450240
author Alabi, Rasheed Omobolaji
Elmusrati, Mohammed
Leivo, Ilmo
Almangush, Alhadi
Mäkitie, Antti A.
author_facet Alabi, Rasheed Omobolaji
Elmusrati, Mohammed
Leivo, Ilmo
Almangush, Alhadi
Mäkitie, Antti A.
author_sort Alabi, Rasheed Omobolaji
collection PubMed
description Nasopharyngeal cancer (NPC) has a unique histopathology compared with other head and neck cancers. Individual NPC patients may attain different outcomes. This study aims to build a prognostic system by combining a highly accurate machine learning model (ML) model with explainable artificial intelligence to stratify NPC patients into low and high chance of survival groups. Explainability is provided using Local Interpretable Model Agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP) techniques. A total of 1094 NPC patients were retrieved from the Surveillance, Epidemiology, and End Results (SEER) database for model training and internal validation. We combined five different ML algorithms to form a uniquely stacked algorithm. The predictive performance of the stacked algorithm was compared with a state-of-the-art algorithm—extreme gradient boosting (XGBoost) to stratify the NPC patients into chance of survival groups. We validated our model with temporal validation (n = 547) and geographic external validation (Helsinki University Hospital NPC cohort, n = 60). The developed stacked predictive ML model showed an accuracy of 85.9% while the XGBoost had 84.5% after the training and testing phases. This demonstrated that both XGBoost and the stacked model showed comparable performance. External geographic validation of XGBoost model showed a c-index of 0.74, accuracy of 76.7%, and area under curve of 0.76. The SHAP technique revealed that age of the patient at diagnosis, T-stage, ethnicity, M-stage, marital status, and grade were among the prominent input variables in decreasing order of significance for the overall survival of NPC patients. LIME showed the degree of reliability of the prediction made by the model. In addition, both techniques showed how each feature contributed to the prediction made by the model. LIME and SHAP techniques provided personalized protective and risk factors for each NPC patient and unraveled some novel non-linear relationships between input features and survival chance. The examined ML approach showed the ability to predict the chance of overall survival of NPC patients. This is important for effective treatment planning care and informed clinical decisions. To enhance outcome results, including survival in NPC, ML may aid in planning individualized therapy for this patient population.
format Online
Article
Text
id pubmed-10238539
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-102385392023-06-04 Machine learning explainability in nasopharyngeal cancer survival using LIME and SHAP Alabi, Rasheed Omobolaji Elmusrati, Mohammed Leivo, Ilmo Almangush, Alhadi Mäkitie, Antti A. Sci Rep Article Nasopharyngeal cancer (NPC) has a unique histopathology compared with other head and neck cancers. Individual NPC patients may attain different outcomes. This study aims to build a prognostic system by combining a highly accurate machine learning model (ML) model with explainable artificial intelligence to stratify NPC patients into low and high chance of survival groups. Explainability is provided using Local Interpretable Model Agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP) techniques. A total of 1094 NPC patients were retrieved from the Surveillance, Epidemiology, and End Results (SEER) database for model training and internal validation. We combined five different ML algorithms to form a uniquely stacked algorithm. The predictive performance of the stacked algorithm was compared with a state-of-the-art algorithm—extreme gradient boosting (XGBoost) to stratify the NPC patients into chance of survival groups. We validated our model with temporal validation (n = 547) and geographic external validation (Helsinki University Hospital NPC cohort, n = 60). The developed stacked predictive ML model showed an accuracy of 85.9% while the XGBoost had 84.5% after the training and testing phases. This demonstrated that both XGBoost and the stacked model showed comparable performance. External geographic validation of XGBoost model showed a c-index of 0.74, accuracy of 76.7%, and area under curve of 0.76. The SHAP technique revealed that age of the patient at diagnosis, T-stage, ethnicity, M-stage, marital status, and grade were among the prominent input variables in decreasing order of significance for the overall survival of NPC patients. LIME showed the degree of reliability of the prediction made by the model. In addition, both techniques showed how each feature contributed to the prediction made by the model. LIME and SHAP techniques provided personalized protective and risk factors for each NPC patient and unraveled some novel non-linear relationships between input features and survival chance. The examined ML approach showed the ability to predict the chance of overall survival of NPC patients. This is important for effective treatment planning care and informed clinical decisions. To enhance outcome results, including survival in NPC, ML may aid in planning individualized therapy for this patient population. Nature Publishing Group UK 2023-06-02 /pmc/articles/PMC10238539/ /pubmed/37268685 http://dx.doi.org/10.1038/s41598-023-35795-0 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Alabi, Rasheed Omobolaji
Elmusrati, Mohammed
Leivo, Ilmo
Almangush, Alhadi
Mäkitie, Antti A.
Machine learning explainability in nasopharyngeal cancer survival using LIME and SHAP
title Machine learning explainability in nasopharyngeal cancer survival using LIME and SHAP
title_full Machine learning explainability in nasopharyngeal cancer survival using LIME and SHAP
title_fullStr Machine learning explainability in nasopharyngeal cancer survival using LIME and SHAP
title_full_unstemmed Machine learning explainability in nasopharyngeal cancer survival using LIME and SHAP
title_short Machine learning explainability in nasopharyngeal cancer survival using LIME and SHAP
title_sort machine learning explainability in nasopharyngeal cancer survival using lime and shap
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10238539/
https://www.ncbi.nlm.nih.gov/pubmed/37268685
http://dx.doi.org/10.1038/s41598-023-35795-0
work_keys_str_mv AT alabirasheedomobolaji machinelearningexplainabilityinnasopharyngealcancersurvivalusinglimeandshap
AT elmusratimohammed machinelearningexplainabilityinnasopharyngealcancersurvivalusinglimeandshap
AT leivoilmo machinelearningexplainabilityinnasopharyngealcancersurvivalusinglimeandshap
AT almangushalhadi machinelearningexplainabilityinnasopharyngealcancersurvivalusinglimeandshap
AT makitieanttia machinelearningexplainabilityinnasopharyngealcancersurvivalusinglimeandshap