Cargando…

A Theoretical Framework for Self-Supervised MR Image Reconstruction Using Sub-Sampling via Variable Density Noisier2Noise

In recent years, there has been attention on leveraging the statistical modeling capabilities of neural networks for reconstructing sub-sampled Magnetic Resonance Imaging (MRI) data. Most proposed methods assume the existence of a representative fully-sampled dataset and use fully-supervised trainin...

Descripción completa

Detalles Bibliográficos
Autores principales: Millard, Charles, Chiew, Mark
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7614963/
https://www.ncbi.nlm.nih.gov/pubmed/37600280
http://dx.doi.org/10.1109/TCI.2023.3299212
_version_ 1783605675870388224
author Millard, Charles
Chiew, Mark
author_facet Millard, Charles
Chiew, Mark
author_sort Millard, Charles
collection PubMed
description In recent years, there has been attention on leveraging the statistical modeling capabilities of neural networks for reconstructing sub-sampled Magnetic Resonance Imaging (MRI) data. Most proposed methods assume the existence of a representative fully-sampled dataset and use fully-supervised training. However, for many applications, fully sampled training data is not available, and may be highly impractical to acquire. The development and understanding of self-supervised methods, which use only sub-sampled data for training, are therefore highly desirable. This work extends the Noisier2Noise framework, which was originally constructed for self-supervised denoising tasks, to variable density sub-sampled MRI data. We use the Noisier2Noise framework to analytically explain the performance of Self-Supervised Learning via Data Undersampling (SSDU), a recently proposed method that performs well in practice but until now lacked theoretical justification. Further, we propose two modifications of SSDU that arise as a consequence of the theoretical developments. Firstly, we propose partitioning the sampling set so that the subsets have the same type of distribution as the original sampling mask. Secondly, we propose a loss weighting that compensates for the sampling and partitioning densities. On the fastMRI dataset we show that these changes significantly improve SSDU’s image restoration quality and robustness to the partitioning parameters.
format Online
Article
Text
id pubmed-7614963
institution National Center for Biotechnology Information
language English
publishDate 2023
record_format MEDLINE/PubMed
spelling pubmed-76149632023-08-18 A Theoretical Framework for Self-Supervised MR Image Reconstruction Using Sub-Sampling via Variable Density Noisier2Noise Millard, Charles Chiew, Mark IEEE Trans Comput Imaging Article In recent years, there has been attention on leveraging the statistical modeling capabilities of neural networks for reconstructing sub-sampled Magnetic Resonance Imaging (MRI) data. Most proposed methods assume the existence of a representative fully-sampled dataset and use fully-supervised training. However, for many applications, fully sampled training data is not available, and may be highly impractical to acquire. The development and understanding of self-supervised methods, which use only sub-sampled data for training, are therefore highly desirable. This work extends the Noisier2Noise framework, which was originally constructed for self-supervised denoising tasks, to variable density sub-sampled MRI data. We use the Noisier2Noise framework to analytically explain the performance of Self-Supervised Learning via Data Undersampling (SSDU), a recently proposed method that performs well in practice but until now lacked theoretical justification. Further, we propose two modifications of SSDU that arise as a consequence of the theoretical developments. Firstly, we propose partitioning the sampling set so that the subsets have the same type of distribution as the original sampling mask. Secondly, we propose a loss weighting that compensates for the sampling and partitioning densities. On the fastMRI dataset we show that these changes significantly improve SSDU’s image restoration quality and robustness to the partitioning parameters. 2023-07-26 /pmc/articles/PMC7614963/ /pubmed/37600280 http://dx.doi.org/10.1109/TCI.2023.3299212 Text en https://creativecommons.org/licenses/by/4.0/This work is licensed under a BY 4.0 (https://creativecommons.org/licenses/by/4.0/) International license.
spellingShingle Article
Millard, Charles
Chiew, Mark
A Theoretical Framework for Self-Supervised MR Image Reconstruction Using Sub-Sampling via Variable Density Noisier2Noise
title A Theoretical Framework for Self-Supervised MR Image Reconstruction Using Sub-Sampling via Variable Density Noisier2Noise
title_full A Theoretical Framework for Self-Supervised MR Image Reconstruction Using Sub-Sampling via Variable Density Noisier2Noise
title_fullStr A Theoretical Framework for Self-Supervised MR Image Reconstruction Using Sub-Sampling via Variable Density Noisier2Noise
title_full_unstemmed A Theoretical Framework for Self-Supervised MR Image Reconstruction Using Sub-Sampling via Variable Density Noisier2Noise
title_short A Theoretical Framework for Self-Supervised MR Image Reconstruction Using Sub-Sampling via Variable Density Noisier2Noise
title_sort theoretical framework for self-supervised mr image reconstruction using sub-sampling via variable density noisier2noise
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7614963/
https://www.ncbi.nlm.nih.gov/pubmed/37600280
http://dx.doi.org/10.1109/TCI.2023.3299212
work_keys_str_mv AT millardcharles atheoreticalframeworkforselfsupervisedmrimagereconstructionusingsubsamplingviavariabledensitynoisier2noise
AT chiewmark atheoreticalframeworkforselfsupervisedmrimagereconstructionusingsubsamplingviavariabledensitynoisier2noise
AT millardcharles theoreticalframeworkforselfsupervisedmrimagereconstructionusingsubsamplingviavariabledensitynoisier2noise
AT chiewmark theoreticalframeworkforselfsupervisedmrimagereconstructionusingsubsamplingviavariabledensitynoisier2noise