Cargando…

Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved

OBJECTIVE: Evaluate the completeness of reporting of prognostic prediction models developed using machine learning methods in the field of oncology. STUDY DESIGN AND SETTING: We conducted a systematic review, searching the MEDLINE and Embase databases between 01/01/2019 and 05/09/2019, for non-imagi...

Descripción completa

Detalles Bibliográficos
Autores principales: Dhiman, Paula, Ma, Jie, Navarro, Constanza Andaur, Speich, Benjamin, Bullock, Garrett, Damen, Johanna AA, Kirtley, Shona, Hooft, Lotty, Riley, Richard D, Van Calster, Ben, Moons, Karel G.M., Collins, Gary S.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8592577/
https://www.ncbi.nlm.nih.gov/pubmed/34214626
http://dx.doi.org/10.1016/j.jclinepi.2021.06.024
_version_ 1784599491044704256
author Dhiman, Paula
Ma, Jie
Navarro, Constanza Andaur
Speich, Benjamin
Bullock, Garrett
Damen, Johanna AA
Kirtley, Shona
Hooft, Lotty
Riley, Richard D
Van Calster, Ben
Moons, Karel G.M.
Collins, Gary S.
author_facet Dhiman, Paula
Ma, Jie
Navarro, Constanza Andaur
Speich, Benjamin
Bullock, Garrett
Damen, Johanna AA
Kirtley, Shona
Hooft, Lotty
Riley, Richard D
Van Calster, Ben
Moons, Karel G.M.
Collins, Gary S.
author_sort Dhiman, Paula
collection PubMed
description OBJECTIVE: Evaluate the completeness of reporting of prognostic prediction models developed using machine learning methods in the field of oncology. STUDY DESIGN AND SETTING: We conducted a systematic review, searching the MEDLINE and Embase databases between 01/01/2019 and 05/09/2019, for non-imaging studies developing a prognostic clinical prediction model using machine learning methods (as defined by primary study authors) in oncology. We used the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement to assess the reporting quality of included publications. We described overall reporting adherence of included publications and by each section of TRIPOD. RESULTS: Sixty-two publications met the inclusion criteria. 48 were development studies and 14 were development with validation studies. 152 models were developed across all publications. Median adherence to TRIPOD reporting items was 41% [range: 10%-67%] and at least 50% adherence was found in 19% (n=12/62) of publications. Adherence was lower in development only studies (median: 38% [range: 10%-67%]); and higher in development with validation studies (median: 49% [range: 33%-59%]). CONCLUSION: Reporting of clinical prediction models using machine learning in oncology is poor and needs urgent improvement, so readers and stakeholders can appraise the study methods, understand study findings, and reduce research waste.
format Online
Article
Text
id pubmed-8592577
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-85925772021-11-22 Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved Dhiman, Paula Ma, Jie Navarro, Constanza Andaur Speich, Benjamin Bullock, Garrett Damen, Johanna AA Kirtley, Shona Hooft, Lotty Riley, Richard D Van Calster, Ben Moons, Karel G.M. Collins, Gary S. J Clin Epidemiol Original Article OBJECTIVE: Evaluate the completeness of reporting of prognostic prediction models developed using machine learning methods in the field of oncology. STUDY DESIGN AND SETTING: We conducted a systematic review, searching the MEDLINE and Embase databases between 01/01/2019 and 05/09/2019, for non-imaging studies developing a prognostic clinical prediction model using machine learning methods (as defined by primary study authors) in oncology. We used the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement to assess the reporting quality of included publications. We described overall reporting adherence of included publications and by each section of TRIPOD. RESULTS: Sixty-two publications met the inclusion criteria. 48 were development studies and 14 were development with validation studies. 152 models were developed across all publications. Median adherence to TRIPOD reporting items was 41% [range: 10%-67%] and at least 50% adherence was found in 19% (n=12/62) of publications. Adherence was lower in development only studies (median: 38% [range: 10%-67%]); and higher in development with validation studies (median: 49% [range: 33%-59%]). CONCLUSION: Reporting of clinical prediction models using machine learning in oncology is poor and needs urgent improvement, so readers and stakeholders can appraise the study methods, understand study findings, and reduce research waste. Elsevier 2021-10 /pmc/articles/PMC8592577/ /pubmed/34214626 http://dx.doi.org/10.1016/j.jclinepi.2021.06.024 Text en © 2021 The Authors https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Original Article
Dhiman, Paula
Ma, Jie
Navarro, Constanza Andaur
Speich, Benjamin
Bullock, Garrett
Damen, Johanna AA
Kirtley, Shona
Hooft, Lotty
Riley, Richard D
Van Calster, Ben
Moons, Karel G.M.
Collins, Gary S.
Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved
title Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved
title_full Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved
title_fullStr Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved
title_full_unstemmed Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved
title_short Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved
title_sort reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8592577/
https://www.ncbi.nlm.nih.gov/pubmed/34214626
http://dx.doi.org/10.1016/j.jclinepi.2021.06.024
work_keys_str_mv AT dhimanpaula reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved
AT majie reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved
AT navarroconstanzaandaur reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved
AT speichbenjamin reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved
AT bullockgarrett reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved
AT damenjohannaaa reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved
AT kirtleyshona reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved
AT hooftlotty reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved
AT rileyrichardd reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved
AT vancalsterben reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved
AT moonskarelgm reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved
AT collinsgarys reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved