Cargando…
Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved
OBJECTIVE: Evaluate the completeness of reporting of prognostic prediction models developed using machine learning methods in the field of oncology. STUDY DESIGN AND SETTING: We conducted a systematic review, searching the MEDLINE and Embase databases between 01/01/2019 and 05/09/2019, for non-imagi...
Autores principales: | , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Elsevier
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8592577/ https://www.ncbi.nlm.nih.gov/pubmed/34214626 http://dx.doi.org/10.1016/j.jclinepi.2021.06.024 |
_version_ | 1784599491044704256 |
---|---|
author | Dhiman, Paula Ma, Jie Navarro, Constanza Andaur Speich, Benjamin Bullock, Garrett Damen, Johanna AA Kirtley, Shona Hooft, Lotty Riley, Richard D Van Calster, Ben Moons, Karel G.M. Collins, Gary S. |
author_facet | Dhiman, Paula Ma, Jie Navarro, Constanza Andaur Speich, Benjamin Bullock, Garrett Damen, Johanna AA Kirtley, Shona Hooft, Lotty Riley, Richard D Van Calster, Ben Moons, Karel G.M. Collins, Gary S. |
author_sort | Dhiman, Paula |
collection | PubMed |
description | OBJECTIVE: Evaluate the completeness of reporting of prognostic prediction models developed using machine learning methods in the field of oncology. STUDY DESIGN AND SETTING: We conducted a systematic review, searching the MEDLINE and Embase databases between 01/01/2019 and 05/09/2019, for non-imaging studies developing a prognostic clinical prediction model using machine learning methods (as defined by primary study authors) in oncology. We used the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement to assess the reporting quality of included publications. We described overall reporting adherence of included publications and by each section of TRIPOD. RESULTS: Sixty-two publications met the inclusion criteria. 48 were development studies and 14 were development with validation studies. 152 models were developed across all publications. Median adherence to TRIPOD reporting items was 41% [range: 10%-67%] and at least 50% adherence was found in 19% (n=12/62) of publications. Adherence was lower in development only studies (median: 38% [range: 10%-67%]); and higher in development with validation studies (median: 49% [range: 33%-59%]). CONCLUSION: Reporting of clinical prediction models using machine learning in oncology is poor and needs urgent improvement, so readers and stakeholders can appraise the study methods, understand study findings, and reduce research waste. |
format | Online Article Text |
id | pubmed-8592577 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Elsevier |
record_format | MEDLINE/PubMed |
spelling | pubmed-85925772021-11-22 Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved Dhiman, Paula Ma, Jie Navarro, Constanza Andaur Speich, Benjamin Bullock, Garrett Damen, Johanna AA Kirtley, Shona Hooft, Lotty Riley, Richard D Van Calster, Ben Moons, Karel G.M. Collins, Gary S. J Clin Epidemiol Original Article OBJECTIVE: Evaluate the completeness of reporting of prognostic prediction models developed using machine learning methods in the field of oncology. STUDY DESIGN AND SETTING: We conducted a systematic review, searching the MEDLINE and Embase databases between 01/01/2019 and 05/09/2019, for non-imaging studies developing a prognostic clinical prediction model using machine learning methods (as defined by primary study authors) in oncology. We used the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement to assess the reporting quality of included publications. We described overall reporting adherence of included publications and by each section of TRIPOD. RESULTS: Sixty-two publications met the inclusion criteria. 48 were development studies and 14 were development with validation studies. 152 models were developed across all publications. Median adherence to TRIPOD reporting items was 41% [range: 10%-67%] and at least 50% adherence was found in 19% (n=12/62) of publications. Adherence was lower in development only studies (median: 38% [range: 10%-67%]); and higher in development with validation studies (median: 49% [range: 33%-59%]). CONCLUSION: Reporting of clinical prediction models using machine learning in oncology is poor and needs urgent improvement, so readers and stakeholders can appraise the study methods, understand study findings, and reduce research waste. Elsevier 2021-10 /pmc/articles/PMC8592577/ /pubmed/34214626 http://dx.doi.org/10.1016/j.jclinepi.2021.06.024 Text en © 2021 The Authors https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Original Article Dhiman, Paula Ma, Jie Navarro, Constanza Andaur Speich, Benjamin Bullock, Garrett Damen, Johanna AA Kirtley, Shona Hooft, Lotty Riley, Richard D Van Calster, Ben Moons, Karel G.M. Collins, Gary S. Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved |
title | Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved |
title_full | Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved |
title_fullStr | Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved |
title_full_unstemmed | Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved |
title_short | Reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved |
title_sort | reporting of prognostic clinical prediction models based on machine learning methods in oncology needs to be improved |
topic | Original Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8592577/ https://www.ncbi.nlm.nih.gov/pubmed/34214626 http://dx.doi.org/10.1016/j.jclinepi.2021.06.024 |
work_keys_str_mv | AT dhimanpaula reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved AT majie reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved AT navarroconstanzaandaur reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved AT speichbenjamin reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved AT bullockgarrett reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved AT damenjohannaaa reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved AT kirtleyshona reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved AT hooftlotty reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved AT rileyrichardd reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved AT vancalsterben reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved AT moonskarelgm reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved AT collinsgarys reportingofprognosticclinicalpredictionmodelsbasedonmachinelearningmethodsinoncologyneedstobeimproved |