Cargando…
Predicting overall survival in chordoma patients using machine learning models: a web-app application
OBJECTIVE: The goal of this study was to evaluate the efficacy of machine learning (ML) techniques in predicting survival for chordoma patients in comparison with the standard Cox proportional hazards (CoxPH) model. METHODS: Using a Surveillance, Epidemiology, and End Results database of consecutive...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10474690/ https://www.ncbi.nlm.nih.gov/pubmed/37660044 http://dx.doi.org/10.1186/s13018-023-04105-9 |
_version_ | 1785100555274682368 |
---|---|
author | Cheng, Peng Xie, Xudong Knoedler, Samuel Mi, Bobin Liu, Guohui |
author_facet | Cheng, Peng Xie, Xudong Knoedler, Samuel Mi, Bobin Liu, Guohui |
author_sort | Cheng, Peng |
collection | PubMed |
description | OBJECTIVE: The goal of this study was to evaluate the efficacy of machine learning (ML) techniques in predicting survival for chordoma patients in comparison with the standard Cox proportional hazards (CoxPH) model. METHODS: Using a Surveillance, Epidemiology, and End Results database of consecutive newly diagnosed chordoma cases between January 2000 and December 2018, we created and validated three ML survival models as well as a traditional CoxPH model in this population-based cohort study. Randomly, the dataset was divided into training and validation datasets. Tuning hyperparameters on the training dataset involved a 1000-iteration random search with fivefold cross-validation. Concordance index (C-index), Brier score, and integrated Brier score were used to evaluate the performance of the model. The receiver operating characteristic (ROC) curves, calibration curves, and area under the ROC curves (AUC) were used to assess the reliability of the models by predicting 5- and 10-year survival probabilities. RESULTS: A total of 724 chordoma patients were divided into training (n = 508) and validation (n = 216) cohorts. Cox regression identified nine significant prognostic factors (p < 0.05). ML models showed superior performance over CoxPH model, with DeepSurv having the highest C-index (0.795) and the best discrimination for 5- and 10-year survival (AUC 0.84 and 0.88). Calibration curves revealed strong correlation between DeepSurv predictions and actual survival. Risk stratification by DeepSurv model effectively discriminated high- and low-risk groups (p < 0.01). The optimized DeepSurv model was implemented into a web application for clinical use that can be found at https://hust-chengp-ml-chordoma-app-19rjyr.streamlitapp.com/. CONCLUSION: ML algorithms based on time-to-event results are effective in chordoma prediction, with DeepSurv having the best discrimination performance and calibration. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13018-023-04105-9. |
format | Online Article Text |
id | pubmed-10474690 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-104746902023-09-03 Predicting overall survival in chordoma patients using machine learning models: a web-app application Cheng, Peng Xie, Xudong Knoedler, Samuel Mi, Bobin Liu, Guohui J Orthop Surg Res Research Article OBJECTIVE: The goal of this study was to evaluate the efficacy of machine learning (ML) techniques in predicting survival for chordoma patients in comparison with the standard Cox proportional hazards (CoxPH) model. METHODS: Using a Surveillance, Epidemiology, and End Results database of consecutive newly diagnosed chordoma cases between January 2000 and December 2018, we created and validated three ML survival models as well as a traditional CoxPH model in this population-based cohort study. Randomly, the dataset was divided into training and validation datasets. Tuning hyperparameters on the training dataset involved a 1000-iteration random search with fivefold cross-validation. Concordance index (C-index), Brier score, and integrated Brier score were used to evaluate the performance of the model. The receiver operating characteristic (ROC) curves, calibration curves, and area under the ROC curves (AUC) were used to assess the reliability of the models by predicting 5- and 10-year survival probabilities. RESULTS: A total of 724 chordoma patients were divided into training (n = 508) and validation (n = 216) cohorts. Cox regression identified nine significant prognostic factors (p < 0.05). ML models showed superior performance over CoxPH model, with DeepSurv having the highest C-index (0.795) and the best discrimination for 5- and 10-year survival (AUC 0.84 and 0.88). Calibration curves revealed strong correlation between DeepSurv predictions and actual survival. Risk stratification by DeepSurv model effectively discriminated high- and low-risk groups (p < 0.01). The optimized DeepSurv model was implemented into a web application for clinical use that can be found at https://hust-chengp-ml-chordoma-app-19rjyr.streamlitapp.com/. CONCLUSION: ML algorithms based on time-to-event results are effective in chordoma prediction, with DeepSurv having the best discrimination performance and calibration. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13018-023-04105-9. BioMed Central 2023-09-02 /pmc/articles/PMC10474690/ /pubmed/37660044 http://dx.doi.org/10.1186/s13018-023-04105-9 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Research Article Cheng, Peng Xie, Xudong Knoedler, Samuel Mi, Bobin Liu, Guohui Predicting overall survival in chordoma patients using machine learning models: a web-app application |
title | Predicting overall survival in chordoma patients using machine learning models: a web-app application |
title_full | Predicting overall survival in chordoma patients using machine learning models: a web-app application |
title_fullStr | Predicting overall survival in chordoma patients using machine learning models: a web-app application |
title_full_unstemmed | Predicting overall survival in chordoma patients using machine learning models: a web-app application |
title_short | Predicting overall survival in chordoma patients using machine learning models: a web-app application |
title_sort | predicting overall survival in chordoma patients using machine learning models: a web-app application |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10474690/ https://www.ncbi.nlm.nih.gov/pubmed/37660044 http://dx.doi.org/10.1186/s13018-023-04105-9 |
work_keys_str_mv | AT chengpeng predictingoverallsurvivalinchordomapatientsusingmachinelearningmodelsawebappapplication AT xiexudong predictingoverallsurvivalinchordomapatientsusingmachinelearningmodelsawebappapplication AT knoedlersamuel predictingoverallsurvivalinchordomapatientsusingmachinelearningmodelsawebappapplication AT mibobin predictingoverallsurvivalinchordomapatientsusingmachinelearningmodelsawebappapplication AT liuguohui predictingoverallsurvivalinchordomapatientsusingmachinelearningmodelsawebappapplication |