Cargando…

Review of Statistical Methods for Evaluating the Performance of Survival or Other Time-to-Event Prediction Models (from Conventional to Deep Learning Approaches)

The recent introduction of various high-dimensional modeling methods, such as radiomics and deep learning, has created a much greater diversity in modeling approaches for survival prediction (or, more generally, time-to-event prediction). The newness of the recent modeling approaches and unfamiliari...

Descripción completa

Detalles Bibliográficos
Autores principales: Park, Seo Young, Park, Ji Eun, Kim, Hyungjin, Park, Seong Ho
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Korean Society of Radiology 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8484151/
https://www.ncbi.nlm.nih.gov/pubmed/34269532
http://dx.doi.org/10.3348/kjr.2021.0223
_version_ 1784577258163273728
author Park, Seo Young
Park, Ji Eun
Kim, Hyungjin
Park, Seong Ho
author_facet Park, Seo Young
Park, Ji Eun
Kim, Hyungjin
Park, Seong Ho
author_sort Park, Seo Young
collection PubMed
description The recent introduction of various high-dimensional modeling methods, such as radiomics and deep learning, has created a much greater diversity in modeling approaches for survival prediction (or, more generally, time-to-event prediction). The newness of the recent modeling approaches and unfamiliarity with the model outputs may confuse some researchers and practitioners about the evaluation of the performance of such models. Methodological literacy to critically appraise the performance evaluation of the models and, ideally, the ability to conduct such an evaluation would be needed for those who want to develop models or apply them in practice. This article intends to provide intuitive, conceptual, and practical explanations of the statistical methods for evaluating the performance of survival prediction models with minimal usage of mathematical descriptions. It covers from conventional to deep learning methods, and emphasis has been placed on recent modeling approaches. This review article includes straightforward explanations of C indices (Harrell's C index, etc.), time-dependent receiver operating characteristic curve analysis, calibration plot, other methods for evaluating the calibration performance, and Brier score.
format Online
Article
Text
id pubmed-8484151
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher The Korean Society of Radiology
record_format MEDLINE/PubMed
spelling pubmed-84841512021-10-01 Review of Statistical Methods for Evaluating the Performance of Survival or Other Time-to-Event Prediction Models (from Conventional to Deep Learning Approaches) Park, Seo Young Park, Ji Eun Kim, Hyungjin Park, Seong Ho Korean J Radiol Technology, Experiment, and Physics The recent introduction of various high-dimensional modeling methods, such as radiomics and deep learning, has created a much greater diversity in modeling approaches for survival prediction (or, more generally, time-to-event prediction). The newness of the recent modeling approaches and unfamiliarity with the model outputs may confuse some researchers and practitioners about the evaluation of the performance of such models. Methodological literacy to critically appraise the performance evaluation of the models and, ideally, the ability to conduct such an evaluation would be needed for those who want to develop models or apply them in practice. This article intends to provide intuitive, conceptual, and practical explanations of the statistical methods for evaluating the performance of survival prediction models with minimal usage of mathematical descriptions. It covers from conventional to deep learning methods, and emphasis has been placed on recent modeling approaches. This review article includes straightforward explanations of C indices (Harrell's C index, etc.), time-dependent receiver operating characteristic curve analysis, calibration plot, other methods for evaluating the calibration performance, and Brier score. The Korean Society of Radiology 2021-10 2021-07-01 /pmc/articles/PMC8484151/ /pubmed/34269532 http://dx.doi.org/10.3348/kjr.2021.0223 Text en Copyright © 2021 The Korean Society of Radiology https://creativecommons.org/licenses/by-nc/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) ) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Technology, Experiment, and Physics
Park, Seo Young
Park, Ji Eun
Kim, Hyungjin
Park, Seong Ho
Review of Statistical Methods for Evaluating the Performance of Survival or Other Time-to-Event Prediction Models (from Conventional to Deep Learning Approaches)
title Review of Statistical Methods for Evaluating the Performance of Survival or Other Time-to-Event Prediction Models (from Conventional to Deep Learning Approaches)
title_full Review of Statistical Methods for Evaluating the Performance of Survival or Other Time-to-Event Prediction Models (from Conventional to Deep Learning Approaches)
title_fullStr Review of Statistical Methods for Evaluating the Performance of Survival or Other Time-to-Event Prediction Models (from Conventional to Deep Learning Approaches)
title_full_unstemmed Review of Statistical Methods for Evaluating the Performance of Survival or Other Time-to-Event Prediction Models (from Conventional to Deep Learning Approaches)
title_short Review of Statistical Methods for Evaluating the Performance of Survival or Other Time-to-Event Prediction Models (from Conventional to Deep Learning Approaches)
title_sort review of statistical methods for evaluating the performance of survival or other time-to-event prediction models (from conventional to deep learning approaches)
topic Technology, Experiment, and Physics
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8484151/
https://www.ncbi.nlm.nih.gov/pubmed/34269532
http://dx.doi.org/10.3348/kjr.2021.0223
work_keys_str_mv AT parkseoyoung reviewofstatisticalmethodsforevaluatingtheperformanceofsurvivalorothertimetoeventpredictionmodelsfromconventionaltodeeplearningapproaches
AT parkjieun reviewofstatisticalmethodsforevaluatingtheperformanceofsurvivalorothertimetoeventpredictionmodelsfromconventionaltodeeplearningapproaches
AT kimhyungjin reviewofstatisticalmethodsforevaluatingtheperformanceofsurvivalorothertimetoeventpredictionmodelsfromconventionaltodeeplearningapproaches
AT parkseongho reviewofstatisticalmethodsforevaluatingtheperformanceofsurvivalorothertimetoeventpredictionmodelsfromconventionaltodeeplearningapproaches