Cargando…

Recalibration of a Deep Learning Model for Low-Dose Computed Tomographic Images to Inform Lung Cancer Screening Intervals

IMPORTANCE: Annual low-dose computed tomographic (LDCT) screening reduces lung cancer mortality, but harms could be reduced and cost-effectiveness improved by reusing the LDCT image in conjunction with deep learning or statistical models to identify low-risk individuals for biennial screening. OBJEC...

Descripción completa

Detalles Bibliográficos
Autores principales: Landy, Rebecca, Wang, Vivian L., Baldwin, David R., Pinsky, Paul F., Cheung, Li C., Castle, Philip E., Skarzynski, Martin, Robbins, Hilary A., Katki, Hormuzd A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Medical Association 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10020880/
https://www.ncbi.nlm.nih.gov/pubmed/36929398
http://dx.doi.org/10.1001/jamanetworkopen.2023.3273
_version_ 1784908359551418368
author Landy, Rebecca
Wang, Vivian L.
Baldwin, David R.
Pinsky, Paul F.
Cheung, Li C.
Castle, Philip E.
Skarzynski, Martin
Robbins, Hilary A.
Katki, Hormuzd A.
author_facet Landy, Rebecca
Wang, Vivian L.
Baldwin, David R.
Pinsky, Paul F.
Cheung, Li C.
Castle, Philip E.
Skarzynski, Martin
Robbins, Hilary A.
Katki, Hormuzd A.
author_sort Landy, Rebecca
collection PubMed
description IMPORTANCE: Annual low-dose computed tomographic (LDCT) screening reduces lung cancer mortality, but harms could be reduced and cost-effectiveness improved by reusing the LDCT image in conjunction with deep learning or statistical models to identify low-risk individuals for biennial screening. OBJECTIVE: To identify low-risk individuals in the National Lung Screening Trial (NLST) and estimate, had they been assigned a biennial screening, how many lung cancers would have been delayed 1 year in diagnosis. DESIGN, SETTING, AND PARTICIPANTS: This diagnostic study included participants with a presumed nonmalignant lung nodule in the NLST between January 1, 2002, and December 31, 2004, with follow-up completed on December 31, 2009. Data were analyzed for this study from September 11, 2019, to March 15, 2022. EXPOSURES: An externally validated deep learning algorithm that predicts malignancy in current lung nodules using LDCT images (Lung Cancer Prediction Convolutional Neural Network [LCP-CNN]; Optellum Ltd) was recalibrated to predict 1-year lung cancer detection by LDCT for presumed nonmalignant nodules. Individuals with presumed nonmalignant lung nodules were hypothetically assigned annual vs biennial screening based on the recalibrated LCP-CNN model, Lung Cancer Risk Assessment Tool (LCRAT + CT [a statistical model combining individual risk factors and LDCT image features]), and the American College of Radiology recommendations for lung nodules, version 1.1 (Lung-RADS). MAIN OUTCOMES AND MEASURES: Primary outcomes included model prediction performance, the absolute risk of a 1-year delay in cancer diagnosis, and the proportion of people without lung cancer assigned a biennial screening interval vs the proportion of cancer diagnoses delayed. RESULTS: The study included 10 831 LDCT images from patients with presumed nonmalignant lung nodules (58.7% men; mean [SD] age, 61.9 [5.0] years), of whom 195 were diagnosed with lung cancer from the subsequent screen. The recalibrated LCP-CNN had substantially higher area under the curve (0.87) than LCRAT + CT (0.79) or Lung-RADS (0.69) to predict 1-year lung cancer risk (P < .001). If 66% of screens with nodules were assigned to biennial screening, the absolute risk of a 1-year delay in cancer diagnosis would have been lower for recalibrated LCP-CNN (0.28%) than LCRAT + CT (0.60%; P = .001) or Lung-RADS (0.97%; P < .001). To delay only 10% of cancer diagnoses at 1 year, more people would have been safely assigned biennial screening under LCP-CNN than LCRAT + CT (66.4% vs 40.3%; P < .001). CONCLUSIONS AND RELEVANCE: In this diagnostic study evaluating models of lung cancer risk, a recalibrated deep learning algorithm was most predictive of 1-year lung cancer risk and had least risk of 1-year delay in cancer diagnosis among people assigned biennial screening. Deep learning algorithms could prioritize people for workup of suspicious nodules and decrease screening intensity for people with low-risk nodules, which may be vital for implementation in health care systems.
format Online
Article
Text
id pubmed-10020880
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher American Medical Association
record_format MEDLINE/PubMed
spelling pubmed-100208802023-03-18 Recalibration of a Deep Learning Model for Low-Dose Computed Tomographic Images to Inform Lung Cancer Screening Intervals Landy, Rebecca Wang, Vivian L. Baldwin, David R. Pinsky, Paul F. Cheung, Li C. Castle, Philip E. Skarzynski, Martin Robbins, Hilary A. Katki, Hormuzd A. JAMA Netw Open Original Investigation IMPORTANCE: Annual low-dose computed tomographic (LDCT) screening reduces lung cancer mortality, but harms could be reduced and cost-effectiveness improved by reusing the LDCT image in conjunction with deep learning or statistical models to identify low-risk individuals for biennial screening. OBJECTIVE: To identify low-risk individuals in the National Lung Screening Trial (NLST) and estimate, had they been assigned a biennial screening, how many lung cancers would have been delayed 1 year in diagnosis. DESIGN, SETTING, AND PARTICIPANTS: This diagnostic study included participants with a presumed nonmalignant lung nodule in the NLST between January 1, 2002, and December 31, 2004, with follow-up completed on December 31, 2009. Data were analyzed for this study from September 11, 2019, to March 15, 2022. EXPOSURES: An externally validated deep learning algorithm that predicts malignancy in current lung nodules using LDCT images (Lung Cancer Prediction Convolutional Neural Network [LCP-CNN]; Optellum Ltd) was recalibrated to predict 1-year lung cancer detection by LDCT for presumed nonmalignant nodules. Individuals with presumed nonmalignant lung nodules were hypothetically assigned annual vs biennial screening based on the recalibrated LCP-CNN model, Lung Cancer Risk Assessment Tool (LCRAT + CT [a statistical model combining individual risk factors and LDCT image features]), and the American College of Radiology recommendations for lung nodules, version 1.1 (Lung-RADS). MAIN OUTCOMES AND MEASURES: Primary outcomes included model prediction performance, the absolute risk of a 1-year delay in cancer diagnosis, and the proportion of people without lung cancer assigned a biennial screening interval vs the proportion of cancer diagnoses delayed. RESULTS: The study included 10 831 LDCT images from patients with presumed nonmalignant lung nodules (58.7% men; mean [SD] age, 61.9 [5.0] years), of whom 195 were diagnosed with lung cancer from the subsequent screen. The recalibrated LCP-CNN had substantially higher area under the curve (0.87) than LCRAT + CT (0.79) or Lung-RADS (0.69) to predict 1-year lung cancer risk (P < .001). If 66% of screens with nodules were assigned to biennial screening, the absolute risk of a 1-year delay in cancer diagnosis would have been lower for recalibrated LCP-CNN (0.28%) than LCRAT + CT (0.60%; P = .001) or Lung-RADS (0.97%; P < .001). To delay only 10% of cancer diagnoses at 1 year, more people would have been safely assigned biennial screening under LCP-CNN than LCRAT + CT (66.4% vs 40.3%; P < .001). CONCLUSIONS AND RELEVANCE: In this diagnostic study evaluating models of lung cancer risk, a recalibrated deep learning algorithm was most predictive of 1-year lung cancer risk and had least risk of 1-year delay in cancer diagnosis among people assigned biennial screening. Deep learning algorithms could prioritize people for workup of suspicious nodules and decrease screening intensity for people with low-risk nodules, which may be vital for implementation in health care systems. American Medical Association 2023-03-16 /pmc/articles/PMC10020880/ /pubmed/36929398 http://dx.doi.org/10.1001/jamanetworkopen.2023.3273 Text en Copyright 2023 Landy R et al. JAMA Network Open. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the CC-BY License.
spellingShingle Original Investigation
Landy, Rebecca
Wang, Vivian L.
Baldwin, David R.
Pinsky, Paul F.
Cheung, Li C.
Castle, Philip E.
Skarzynski, Martin
Robbins, Hilary A.
Katki, Hormuzd A.
Recalibration of a Deep Learning Model for Low-Dose Computed Tomographic Images to Inform Lung Cancer Screening Intervals
title Recalibration of a Deep Learning Model for Low-Dose Computed Tomographic Images to Inform Lung Cancer Screening Intervals
title_full Recalibration of a Deep Learning Model for Low-Dose Computed Tomographic Images to Inform Lung Cancer Screening Intervals
title_fullStr Recalibration of a Deep Learning Model for Low-Dose Computed Tomographic Images to Inform Lung Cancer Screening Intervals
title_full_unstemmed Recalibration of a Deep Learning Model for Low-Dose Computed Tomographic Images to Inform Lung Cancer Screening Intervals
title_short Recalibration of a Deep Learning Model for Low-Dose Computed Tomographic Images to Inform Lung Cancer Screening Intervals
title_sort recalibration of a deep learning model for low-dose computed tomographic images to inform lung cancer screening intervals
topic Original Investigation
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10020880/
https://www.ncbi.nlm.nih.gov/pubmed/36929398
http://dx.doi.org/10.1001/jamanetworkopen.2023.3273
work_keys_str_mv AT landyrebecca recalibrationofadeeplearningmodelforlowdosecomputedtomographicimagestoinformlungcancerscreeningintervals
AT wangvivianl recalibrationofadeeplearningmodelforlowdosecomputedtomographicimagestoinformlungcancerscreeningintervals
AT baldwindavidr recalibrationofadeeplearningmodelforlowdosecomputedtomographicimagestoinformlungcancerscreeningintervals
AT pinskypaulf recalibrationofadeeplearningmodelforlowdosecomputedtomographicimagestoinformlungcancerscreeningintervals
AT cheunglic recalibrationofadeeplearningmodelforlowdosecomputedtomographicimagestoinformlungcancerscreeningintervals
AT castlephilipe recalibrationofadeeplearningmodelforlowdosecomputedtomographicimagestoinformlungcancerscreeningintervals
AT skarzynskimartin recalibrationofadeeplearningmodelforlowdosecomputedtomographicimagestoinformlungcancerscreeningintervals
AT robbinshilarya recalibrationofadeeplearningmodelforlowdosecomputedtomographicimagestoinformlungcancerscreeningintervals
AT katkihormuzda recalibrationofadeeplearningmodelforlowdosecomputedtomographicimagestoinformlungcancerscreeningintervals