Cargando…

Improving the detection of new lesions in multiple sclerosis with a cascaded 3D fully convolutional neural network approach

Longitudinal magnetic resonance imaging (MRI) has an important role in multiple sclerosis (MS) diagnosis and follow-up. Specifically, the presence of new lesions on brain MRI scans is considered a robust predictive biomarker for the disease progression. New lesions are a high-impact prognostic facto...

Descripción completa

Detalles Bibliográficos
Autores principales: Salem, Mostafa, Ryan, Marwa Ahmed, Oliver, Arnau, Hussain, Khaled Fathy, Lladó, Xavier
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9730806/
https://www.ncbi.nlm.nih.gov/pubmed/36507318
http://dx.doi.org/10.3389/fnins.2022.1007619
_version_ 1784845763089530880
author Salem, Mostafa
Ryan, Marwa Ahmed
Oliver, Arnau
Hussain, Khaled Fathy
Lladó, Xavier
author_facet Salem, Mostafa
Ryan, Marwa Ahmed
Oliver, Arnau
Hussain, Khaled Fathy
Lladó, Xavier
author_sort Salem, Mostafa
collection PubMed
description Longitudinal magnetic resonance imaging (MRI) has an important role in multiple sclerosis (MS) diagnosis and follow-up. Specifically, the presence of new lesions on brain MRI scans is considered a robust predictive biomarker for the disease progression. New lesions are a high-impact prognostic factor to predict evolution to MS or risk of disability accumulation over time. However, the detection of this disease activity is performed visually by comparing the follow-up and baseline scans. Due to the presence of small lesions, misregistration, and high inter-/intra-observer variability, this detection of new lesions is prone to errors. In this direction, one of the last Medical Image Computing and Computer Assisted Intervention (MICCAI) challenges was dealing with this automatic new lesion quantification. The MSSEG-2: MS new lesions segmentation challenge offers an evaluation framework for this new lesion segmentation task with a large database (100 patients, each with two-time points) compiled from the OFSEP (Observatoire français de la sclérose en plaques) cohort, the French MS registry, including 3D T2-w fluid-attenuated inversion recovery (T2-FLAIR) images from different centers and scanners. Apart from a change in centers, MRI scanners, and acquisition protocols, there are more challenges that hinder the automated detection process of new lesions such as the need for large annotated datasets, which may be not easily available, or the fact that new lesions are small areas producing a class imbalance problem that could bias trained models toward the non-lesion class. In this article, we present a novel automated method for new lesion detection of MS patient images. Our approach is based on a cascade of two 3D patch-wise fully convolutional neural networks (FCNNs). The first FCNN is trained to be more sensitive revealing possible candidate new lesion voxels, while the second FCNN is trained to reduce the number of misclassified voxels coming from the first network. 3D T2-FLAIR images from the two-time points were pre-processed and linearly co-registered. Afterward, a fully CNN, where its inputs were only the baseline and follow-up images, was trained to detect new MS lesions. Our approach obtained a mean segmentation dice similarity coefficient of 0.42 with a detection F1-score of 0.5. Compared to the challenge participants, we obtained one of the highest precision scores (PPVL = 0.52), the best PPVL rate (0.53), and a lesion detection sensitivity (SensL of 0.53).
format Online
Article
Text
id pubmed-9730806
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-97308062022-12-09 Improving the detection of new lesions in multiple sclerosis with a cascaded 3D fully convolutional neural network approach Salem, Mostafa Ryan, Marwa Ahmed Oliver, Arnau Hussain, Khaled Fathy Lladó, Xavier Front Neurosci Neuroscience Longitudinal magnetic resonance imaging (MRI) has an important role in multiple sclerosis (MS) diagnosis and follow-up. Specifically, the presence of new lesions on brain MRI scans is considered a robust predictive biomarker for the disease progression. New lesions are a high-impact prognostic factor to predict evolution to MS or risk of disability accumulation over time. However, the detection of this disease activity is performed visually by comparing the follow-up and baseline scans. Due to the presence of small lesions, misregistration, and high inter-/intra-observer variability, this detection of new lesions is prone to errors. In this direction, one of the last Medical Image Computing and Computer Assisted Intervention (MICCAI) challenges was dealing with this automatic new lesion quantification. The MSSEG-2: MS new lesions segmentation challenge offers an evaluation framework for this new lesion segmentation task with a large database (100 patients, each with two-time points) compiled from the OFSEP (Observatoire français de la sclérose en plaques) cohort, the French MS registry, including 3D T2-w fluid-attenuated inversion recovery (T2-FLAIR) images from different centers and scanners. Apart from a change in centers, MRI scanners, and acquisition protocols, there are more challenges that hinder the automated detection process of new lesions such as the need for large annotated datasets, which may be not easily available, or the fact that new lesions are small areas producing a class imbalance problem that could bias trained models toward the non-lesion class. In this article, we present a novel automated method for new lesion detection of MS patient images. Our approach is based on a cascade of two 3D patch-wise fully convolutional neural networks (FCNNs). The first FCNN is trained to be more sensitive revealing possible candidate new lesion voxels, while the second FCNN is trained to reduce the number of misclassified voxels coming from the first network. 3D T2-FLAIR images from the two-time points were pre-processed and linearly co-registered. Afterward, a fully CNN, where its inputs were only the baseline and follow-up images, was trained to detect new MS lesions. Our approach obtained a mean segmentation dice similarity coefficient of 0.42 with a detection F1-score of 0.5. Compared to the challenge participants, we obtained one of the highest precision scores (PPVL = 0.52), the best PPVL rate (0.53), and a lesion detection sensitivity (SensL of 0.53). Frontiers Media S.A. 2022-11-24 /pmc/articles/PMC9730806/ /pubmed/36507318 http://dx.doi.org/10.3389/fnins.2022.1007619 Text en Copyright © 2022 Salem, Ryan, Oliver, Hussain and Lladó. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Salem, Mostafa
Ryan, Marwa Ahmed
Oliver, Arnau
Hussain, Khaled Fathy
Lladó, Xavier
Improving the detection of new lesions in multiple sclerosis with a cascaded 3D fully convolutional neural network approach
title Improving the detection of new lesions in multiple sclerosis with a cascaded 3D fully convolutional neural network approach
title_full Improving the detection of new lesions in multiple sclerosis with a cascaded 3D fully convolutional neural network approach
title_fullStr Improving the detection of new lesions in multiple sclerosis with a cascaded 3D fully convolutional neural network approach
title_full_unstemmed Improving the detection of new lesions in multiple sclerosis with a cascaded 3D fully convolutional neural network approach
title_short Improving the detection of new lesions in multiple sclerosis with a cascaded 3D fully convolutional neural network approach
title_sort improving the detection of new lesions in multiple sclerosis with a cascaded 3d fully convolutional neural network approach
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9730806/
https://www.ncbi.nlm.nih.gov/pubmed/36507318
http://dx.doi.org/10.3389/fnins.2022.1007619
work_keys_str_mv AT salemmostafa improvingthedetectionofnewlesionsinmultiplesclerosiswithacascaded3dfullyconvolutionalneuralnetworkapproach
AT ryanmarwaahmed improvingthedetectionofnewlesionsinmultiplesclerosiswithacascaded3dfullyconvolutionalneuralnetworkapproach
AT oliverarnau improvingthedetectionofnewlesionsinmultiplesclerosiswithacascaded3dfullyconvolutionalneuralnetworkapproach
AT hussainkhaledfathy improvingthedetectionofnewlesionsinmultiplesclerosiswithacascaded3dfullyconvolutionalneuralnetworkapproach
AT lladoxavier improvingthedetectionofnewlesionsinmultiplesclerosiswithacascaded3dfullyconvolutionalneuralnetworkapproach