Cargando…

Development and validation of multivariable machine learning algorithms to predict risk of cancer in symptomatic patients referred urgently from primary care: a diagnostic accuracy study

OBJECTIVES: To develop and validate tests to assess the risk of any cancer for patients referred to the NHS Urgent Suspected Cancer (2-week wait, 2WW) clinical pathways. SETTING: Primary and secondary care, one participating regional centre. PARTICIPANTS: Retrospective analysis of data from 371 799...

Descripción completa

Detalles Bibliográficos
Autores principales: Savage, Richard, Messenger, Mike, Neal, Richard D, Ferguson, Rosie, Johnston, Colin, Lloyd, Katherine L, Neal, Matthew D, Sansom, Nigel, Selby, Peter, Sharma, Nisha, Shinkins, Bethany, Skinner, Jim R, Tully, Giles, Duffy, Sean, Hall, Geoff
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BMJ Publishing Group 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8977764/
https://www.ncbi.nlm.nih.gov/pubmed/35365520
http://dx.doi.org/10.1136/bmjopen-2021-053590
_version_ 1784680833974534144
author Savage, Richard
Messenger, Mike
Neal, Richard D
Ferguson, Rosie
Johnston, Colin
Lloyd, Katherine L
Neal, Matthew D
Sansom, Nigel
Selby, Peter
Sharma, Nisha
Shinkins, Bethany
Skinner, Jim R
Tully, Giles
Duffy, Sean
Hall, Geoff
author_facet Savage, Richard
Messenger, Mike
Neal, Richard D
Ferguson, Rosie
Johnston, Colin
Lloyd, Katherine L
Neal, Matthew D
Sansom, Nigel
Selby, Peter
Sharma, Nisha
Shinkins, Bethany
Skinner, Jim R
Tully, Giles
Duffy, Sean
Hall, Geoff
author_sort Savage, Richard
collection PubMed
description OBJECTIVES: To develop and validate tests to assess the risk of any cancer for patients referred to the NHS Urgent Suspected Cancer (2-week wait, 2WW) clinical pathways. SETTING: Primary and secondary care, one participating regional centre. PARTICIPANTS: Retrospective analysis of data from 371 799 consecutive 2WW referrals in the Leeds region from 2011 to 2019. The development cohort was composed of 224 669 consecutive patients with an urgent suspected cancer referral in Leeds between January 2011 and December 2016. The diagnostic algorithms developed were then externally validated on a similar consecutive sample of 147 130 patients (between January 2017 and December 2019). All such patients over the age of 18 with a minimum set of blood counts and biochemistry measurements available were included in the cohort. PRIMARY AND SECONDARY OUTCOME MEASURES: sensitivity, specificity, negative predictive value, positive predictive value, Receiver Operating Characteristic (ROC) curve Area Under Curve (AUC), calibration curves RESULTS: We present results for two clinical use-cases. In use-case 1, the algorithms identify 20% of patients who do not have cancer and may not need an urgent 2WW referral. In use-case 2, they identify 90% of cancer cases with a high probability of cancer that could be prioritised for review. CONCLUSIONS: Combining a panel of widely available blood markers produces effective blood tests for cancer for NHS 2WW patients. The tests are affordable, and can be deployed rapidly to any NHS pathology laboratory with no additional hardware requirements.
format Online
Article
Text
id pubmed-8977764
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher BMJ Publishing Group
record_format MEDLINE/PubMed
spelling pubmed-89777642022-04-20 Development and validation of multivariable machine learning algorithms to predict risk of cancer in symptomatic patients referred urgently from primary care: a diagnostic accuracy study Savage, Richard Messenger, Mike Neal, Richard D Ferguson, Rosie Johnston, Colin Lloyd, Katherine L Neal, Matthew D Sansom, Nigel Selby, Peter Sharma, Nisha Shinkins, Bethany Skinner, Jim R Tully, Giles Duffy, Sean Hall, Geoff BMJ Open Oncology OBJECTIVES: To develop and validate tests to assess the risk of any cancer for patients referred to the NHS Urgent Suspected Cancer (2-week wait, 2WW) clinical pathways. SETTING: Primary and secondary care, one participating regional centre. PARTICIPANTS: Retrospective analysis of data from 371 799 consecutive 2WW referrals in the Leeds region from 2011 to 2019. The development cohort was composed of 224 669 consecutive patients with an urgent suspected cancer referral in Leeds between January 2011 and December 2016. The diagnostic algorithms developed were then externally validated on a similar consecutive sample of 147 130 patients (between January 2017 and December 2019). All such patients over the age of 18 with a minimum set of blood counts and biochemistry measurements available were included in the cohort. PRIMARY AND SECONDARY OUTCOME MEASURES: sensitivity, specificity, negative predictive value, positive predictive value, Receiver Operating Characteristic (ROC) curve Area Under Curve (AUC), calibration curves RESULTS: We present results for two clinical use-cases. In use-case 1, the algorithms identify 20% of patients who do not have cancer and may not need an urgent 2WW referral. In use-case 2, they identify 90% of cancer cases with a high probability of cancer that could be prioritised for review. CONCLUSIONS: Combining a panel of widely available blood markers produces effective blood tests for cancer for NHS 2WW patients. The tests are affordable, and can be deployed rapidly to any NHS pathology laboratory with no additional hardware requirements. BMJ Publishing Group 2022-04-01 /pmc/articles/PMC8977764/ /pubmed/35365520 http://dx.doi.org/10.1136/bmjopen-2021-053590 Text en © Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY. Published by BMJ. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.
spellingShingle Oncology
Savage, Richard
Messenger, Mike
Neal, Richard D
Ferguson, Rosie
Johnston, Colin
Lloyd, Katherine L
Neal, Matthew D
Sansom, Nigel
Selby, Peter
Sharma, Nisha
Shinkins, Bethany
Skinner, Jim R
Tully, Giles
Duffy, Sean
Hall, Geoff
Development and validation of multivariable machine learning algorithms to predict risk of cancer in symptomatic patients referred urgently from primary care: a diagnostic accuracy study
title Development and validation of multivariable machine learning algorithms to predict risk of cancer in symptomatic patients referred urgently from primary care: a diagnostic accuracy study
title_full Development and validation of multivariable machine learning algorithms to predict risk of cancer in symptomatic patients referred urgently from primary care: a diagnostic accuracy study
title_fullStr Development and validation of multivariable machine learning algorithms to predict risk of cancer in symptomatic patients referred urgently from primary care: a diagnostic accuracy study
title_full_unstemmed Development and validation of multivariable machine learning algorithms to predict risk of cancer in symptomatic patients referred urgently from primary care: a diagnostic accuracy study
title_short Development and validation of multivariable machine learning algorithms to predict risk of cancer in symptomatic patients referred urgently from primary care: a diagnostic accuracy study
title_sort development and validation of multivariable machine learning algorithms to predict risk of cancer in symptomatic patients referred urgently from primary care: a diagnostic accuracy study
topic Oncology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8977764/
https://www.ncbi.nlm.nih.gov/pubmed/35365520
http://dx.doi.org/10.1136/bmjopen-2021-053590
work_keys_str_mv AT savagerichard developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT messengermike developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT nealrichardd developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT fergusonrosie developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT johnstoncolin developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT lloydkatherinel developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT nealmatthewd developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT sansomnigel developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT selbypeter developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT sharmanisha developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT shinkinsbethany developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT skinnerjimr developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT tullygiles developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT duffysean developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy
AT hallgeoff developmentandvalidationofmultivariablemachinelearningalgorithmstopredictriskofcancerinsymptomaticpatientsreferredurgentlyfromprimarycareadiagnosticaccuracystudy