Cargando…

Predicting overall survival in chordoma patients using machine learning models: a web-app application

OBJECTIVE: The goal of this study was to evaluate the efficacy of machine learning (ML) techniques in predicting survival for chordoma patients in comparison with the standard Cox proportional hazards (CoxPH) model. METHODS: Using a Surveillance, Epidemiology, and End Results database of consecutive...

Descripción completa

Detalles Bibliográficos
Autores principales: Cheng, Peng, Xie, Xudong, Knoedler, Samuel, Mi, Bobin, Liu, Guohui
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10474690/
https://www.ncbi.nlm.nih.gov/pubmed/37660044
http://dx.doi.org/10.1186/s13018-023-04105-9
_version_ 1785100555274682368
author Cheng, Peng
Xie, Xudong
Knoedler, Samuel
Mi, Bobin
Liu, Guohui
author_facet Cheng, Peng
Xie, Xudong
Knoedler, Samuel
Mi, Bobin
Liu, Guohui
author_sort Cheng, Peng
collection PubMed
description OBJECTIVE: The goal of this study was to evaluate the efficacy of machine learning (ML) techniques in predicting survival for chordoma patients in comparison with the standard Cox proportional hazards (CoxPH) model. METHODS: Using a Surveillance, Epidemiology, and End Results database of consecutive newly diagnosed chordoma cases between January 2000 and December 2018, we created and validated three ML survival models as well as a traditional CoxPH model in this population-based cohort study. Randomly, the dataset was divided into training and validation datasets. Tuning hyperparameters on the training dataset involved a 1000-iteration random search with fivefold cross-validation. Concordance index (C-index), Brier score, and integrated Brier score were used to evaluate the performance of the model. The receiver operating characteristic (ROC) curves, calibration curves, and area under the ROC curves (AUC) were used to assess the reliability of the models by predicting 5- and 10-year survival probabilities. RESULTS: A total of 724 chordoma patients were divided into training (n = 508) and validation (n = 216) cohorts. Cox regression identified nine significant prognostic factors (p < 0.05). ML models showed superior performance over CoxPH model, with DeepSurv having the highest C-index (0.795) and the best discrimination for 5- and 10-year survival (AUC 0.84 and 0.88). Calibration curves revealed strong correlation between DeepSurv predictions and actual survival. Risk stratification by DeepSurv model effectively discriminated high- and low-risk groups (p < 0.01). The optimized DeepSurv model was implemented into a web application for clinical use that can be found at https://hust-chengp-ml-chordoma-app-19rjyr.streamlitapp.com/. CONCLUSION: ML algorithms based on time-to-event results are effective in chordoma prediction, with DeepSurv having the best discrimination performance and calibration. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13018-023-04105-9.
format Online
Article
Text
id pubmed-10474690
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-104746902023-09-03 Predicting overall survival in chordoma patients using machine learning models: a web-app application Cheng, Peng Xie, Xudong Knoedler, Samuel Mi, Bobin Liu, Guohui J Orthop Surg Res Research Article OBJECTIVE: The goal of this study was to evaluate the efficacy of machine learning (ML) techniques in predicting survival for chordoma patients in comparison with the standard Cox proportional hazards (CoxPH) model. METHODS: Using a Surveillance, Epidemiology, and End Results database of consecutive newly diagnosed chordoma cases between January 2000 and December 2018, we created and validated three ML survival models as well as a traditional CoxPH model in this population-based cohort study. Randomly, the dataset was divided into training and validation datasets. Tuning hyperparameters on the training dataset involved a 1000-iteration random search with fivefold cross-validation. Concordance index (C-index), Brier score, and integrated Brier score were used to evaluate the performance of the model. The receiver operating characteristic (ROC) curves, calibration curves, and area under the ROC curves (AUC) were used to assess the reliability of the models by predicting 5- and 10-year survival probabilities. RESULTS: A total of 724 chordoma patients were divided into training (n = 508) and validation (n = 216) cohorts. Cox regression identified nine significant prognostic factors (p < 0.05). ML models showed superior performance over CoxPH model, with DeepSurv having the highest C-index (0.795) and the best discrimination for 5- and 10-year survival (AUC 0.84 and 0.88). Calibration curves revealed strong correlation between DeepSurv predictions and actual survival. Risk stratification by DeepSurv model effectively discriminated high- and low-risk groups (p < 0.01). The optimized DeepSurv model was implemented into a web application for clinical use that can be found at https://hust-chengp-ml-chordoma-app-19rjyr.streamlitapp.com/. CONCLUSION: ML algorithms based on time-to-event results are effective in chordoma prediction, with DeepSurv having the best discrimination performance and calibration. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13018-023-04105-9. BioMed Central 2023-09-02 /pmc/articles/PMC10474690/ /pubmed/37660044 http://dx.doi.org/10.1186/s13018-023-04105-9 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research Article
Cheng, Peng
Xie, Xudong
Knoedler, Samuel
Mi, Bobin
Liu, Guohui
Predicting overall survival in chordoma patients using machine learning models: a web-app application
title Predicting overall survival in chordoma patients using machine learning models: a web-app application
title_full Predicting overall survival in chordoma patients using machine learning models: a web-app application
title_fullStr Predicting overall survival in chordoma patients using machine learning models: a web-app application
title_full_unstemmed Predicting overall survival in chordoma patients using machine learning models: a web-app application
title_short Predicting overall survival in chordoma patients using machine learning models: a web-app application
title_sort predicting overall survival in chordoma patients using machine learning models: a web-app application
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10474690/
https://www.ncbi.nlm.nih.gov/pubmed/37660044
http://dx.doi.org/10.1186/s13018-023-04105-9
work_keys_str_mv AT chengpeng predictingoverallsurvivalinchordomapatientsusingmachinelearningmodelsawebappapplication
AT xiexudong predictingoverallsurvivalinchordomapatientsusingmachinelearningmodelsawebappapplication
AT knoedlersamuel predictingoverallsurvivalinchordomapatientsusingmachinelearningmodelsawebappapplication
AT mibobin predictingoverallsurvivalinchordomapatientsusingmachinelearningmodelsawebappapplication
AT liuguohui predictingoverallsurvivalinchordomapatientsusingmachinelearningmodelsawebappapplication