Cargando…
Single Modality vs. Multimodality: What Works Best for Lung Cancer Screening?
In a clinical context, physicians usually take into account information from more than one data modality when making decisions regarding cancer diagnosis and treatment planning. Artificial intelligence-based methods should mimic the clinical method and take into consideration different sources of da...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10301640/ https://www.ncbi.nlm.nih.gov/pubmed/37420765 http://dx.doi.org/10.3390/s23125597 |
_version_ | 1785064860591063040 |
---|---|
author | Sousa, Joana Vale Matos, Pedro Silva, Francisco Freitas, Pedro Oliveira, Hélder P. Pereira, Tania |
author_facet | Sousa, Joana Vale Matos, Pedro Silva, Francisco Freitas, Pedro Oliveira, Hélder P. Pereira, Tania |
author_sort | Sousa, Joana Vale |
collection | PubMed |
description | In a clinical context, physicians usually take into account information from more than one data modality when making decisions regarding cancer diagnosis and treatment planning. Artificial intelligence-based methods should mimic the clinical method and take into consideration different sources of data that allow a more comprehensive analysis of the patient and, as a consequence, a more accurate diagnosis. Lung cancer evaluation, in particular, can benefit from this approach since this pathology presents high mortality rates due to its late diagnosis. However, many related works make use of a single data source, namely imaging data. Therefore, this work aims to study the prediction of lung cancer when using more than one data modality. The National Lung Screening Trial dataset that contains data from different sources, specifically, computed tomography (CT) scans and clinical data, was used for the study, the development and comparison of single-modality and multimodality models, that may explore the predictive capability of these two types of data to their full potential. A ResNet18 network was trained to classify 3D CT nodule regions of interest (ROI), whereas a random forest algorithm was used to classify the clinical data, with the former achieving an area under the ROC curve (AUC) of 0.7897 and the latter 0.5241. Regarding the multimodality approaches, three strategies, based on intermediate and late fusion, were implemented to combine the information from the 3D CT nodule ROIs and the clinical data. From those, the best model—a fully connected layer that receives as input a combination of clinical data and deep imaging features, given by a ResNet18 inference model—presented an AUC of 0.8021. Lung cancer is a complex disease, characterized by a multitude of biological and physiological phenomena and influenced by multiple factors. It is thus imperative that the models are capable of responding to that need. The results obtained showed that the combination of different types may have the potential to produce more comprehensive analyses of the disease by the models. |
format | Online Article Text |
id | pubmed-10301640 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-103016402023-06-29 Single Modality vs. Multimodality: What Works Best for Lung Cancer Screening? Sousa, Joana Vale Matos, Pedro Silva, Francisco Freitas, Pedro Oliveira, Hélder P. Pereira, Tania Sensors (Basel) Article In a clinical context, physicians usually take into account information from more than one data modality when making decisions regarding cancer diagnosis and treatment planning. Artificial intelligence-based methods should mimic the clinical method and take into consideration different sources of data that allow a more comprehensive analysis of the patient and, as a consequence, a more accurate diagnosis. Lung cancer evaluation, in particular, can benefit from this approach since this pathology presents high mortality rates due to its late diagnosis. However, many related works make use of a single data source, namely imaging data. Therefore, this work aims to study the prediction of lung cancer when using more than one data modality. The National Lung Screening Trial dataset that contains data from different sources, specifically, computed tomography (CT) scans and clinical data, was used for the study, the development and comparison of single-modality and multimodality models, that may explore the predictive capability of these two types of data to their full potential. A ResNet18 network was trained to classify 3D CT nodule regions of interest (ROI), whereas a random forest algorithm was used to classify the clinical data, with the former achieving an area under the ROC curve (AUC) of 0.7897 and the latter 0.5241. Regarding the multimodality approaches, three strategies, based on intermediate and late fusion, were implemented to combine the information from the 3D CT nodule ROIs and the clinical data. From those, the best model—a fully connected layer that receives as input a combination of clinical data and deep imaging features, given by a ResNet18 inference model—presented an AUC of 0.8021. Lung cancer is a complex disease, characterized by a multitude of biological and physiological phenomena and influenced by multiple factors. It is thus imperative that the models are capable of responding to that need. The results obtained showed that the combination of different types may have the potential to produce more comprehensive analyses of the disease by the models. MDPI 2023-06-15 /pmc/articles/PMC10301640/ /pubmed/37420765 http://dx.doi.org/10.3390/s23125597 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Sousa, Joana Vale Matos, Pedro Silva, Francisco Freitas, Pedro Oliveira, Hélder P. Pereira, Tania Single Modality vs. Multimodality: What Works Best for Lung Cancer Screening? |
title | Single Modality vs. Multimodality: What Works Best for Lung Cancer Screening? |
title_full | Single Modality vs. Multimodality: What Works Best for Lung Cancer Screening? |
title_fullStr | Single Modality vs. Multimodality: What Works Best for Lung Cancer Screening? |
title_full_unstemmed | Single Modality vs. Multimodality: What Works Best for Lung Cancer Screening? |
title_short | Single Modality vs. Multimodality: What Works Best for Lung Cancer Screening? |
title_sort | single modality vs. multimodality: what works best for lung cancer screening? |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10301640/ https://www.ncbi.nlm.nih.gov/pubmed/37420765 http://dx.doi.org/10.3390/s23125597 |
work_keys_str_mv | AT sousajoanavale singlemodalityvsmultimodalitywhatworksbestforlungcancerscreening AT matospedro singlemodalityvsmultimodalitywhatworksbestforlungcancerscreening AT silvafrancisco singlemodalityvsmultimodalitywhatworksbestforlungcancerscreening AT freitaspedro singlemodalityvsmultimodalitywhatworksbestforlungcancerscreening AT oliveirahelderp singlemodalityvsmultimodalitywhatworksbestforlungcancerscreening AT pereiratania singlemodalityvsmultimodalitywhatworksbestforlungcancerscreening |