Cargando…

3D MRI Reconstruction Based on 2D Generative Adversarial Network Super-Resolution

The diagnosis of brain pathologies usually involves imaging to analyze the condition of the brain. Magnetic resonance imaging (MRI) technology is widely used in brain disorder diagnosis. The image quality of MRI depends on the magnetostatic field strength and scanning time. Scanners with lower field...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Hongtao, Shinomiya, Yuki, Yoshida, Shinichi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8122986/
https://www.ncbi.nlm.nih.gov/pubmed/33922811
http://dx.doi.org/10.3390/s21092978
_version_ 1783692773334974464
author Zhang, Hongtao
Shinomiya, Yuki
Yoshida, Shinichi
author_facet Zhang, Hongtao
Shinomiya, Yuki
Yoshida, Shinichi
author_sort Zhang, Hongtao
collection PubMed
description The diagnosis of brain pathologies usually involves imaging to analyze the condition of the brain. Magnetic resonance imaging (MRI) technology is widely used in brain disorder diagnosis. The image quality of MRI depends on the magnetostatic field strength and scanning time. Scanners with lower field strengths have the disadvantages of a low resolution and high imaging cost, and scanning takes a long time. The traditional super-resolution reconstruction method based on MRI generally states an optimization problem in terms of prior information. It solves the problem using an iterative approach with a large time cost. Many methods based on deep learning have emerged to replace traditional methods. MRI super-resolution technology based on deep learning can effectively improve MRI resolution through a three-dimensional convolutional neural network; however, the training costs are relatively high. In this paper, we propose the use of two-dimensional super-resolution technology for the super-resolution reconstruction of MRI images. In the first reconstruction, we choose a scale factor of 2 and simulate half the volume of MRI slices as input. We utilize a receiving field block enhanced super-resolution generative adversarial network (RFB-ESRGAN), which is superior to other super-resolution technologies in terms of texture and frequency information. We then rebuild the super-resolution reconstructed slices in the MRI. In the second reconstruction, the image after the first reconstruction is composed of only half of the slices, and there are still missing values. In our previous work, we adopted the traditional interpolation method, and there was still a gap in the visual effect of the reconstructed images. Therefore, we propose a noise-based super-resolution network (nESRGAN). The noise addition to the network can provide additional texture restoration possibilities. We use nESRGAN to further restore MRI resolution and high-frequency information. Finally, we achieve the 3D reconstruction of brain MRI images through two super-resolution reconstructions. Our proposed method is superior to 3D super-resolution technology based on deep learning in terms of perception range and image quality evaluation standards.
format Online
Article
Text
id pubmed-8122986
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-81229862021-05-16 3D MRI Reconstruction Based on 2D Generative Adversarial Network Super-Resolution Zhang, Hongtao Shinomiya, Yuki Yoshida, Shinichi Sensors (Basel) Article The diagnosis of brain pathologies usually involves imaging to analyze the condition of the brain. Magnetic resonance imaging (MRI) technology is widely used in brain disorder diagnosis. The image quality of MRI depends on the magnetostatic field strength and scanning time. Scanners with lower field strengths have the disadvantages of a low resolution and high imaging cost, and scanning takes a long time. The traditional super-resolution reconstruction method based on MRI generally states an optimization problem in terms of prior information. It solves the problem using an iterative approach with a large time cost. Many methods based on deep learning have emerged to replace traditional methods. MRI super-resolution technology based on deep learning can effectively improve MRI resolution through a three-dimensional convolutional neural network; however, the training costs are relatively high. In this paper, we propose the use of two-dimensional super-resolution technology for the super-resolution reconstruction of MRI images. In the first reconstruction, we choose a scale factor of 2 and simulate half the volume of MRI slices as input. We utilize a receiving field block enhanced super-resolution generative adversarial network (RFB-ESRGAN), which is superior to other super-resolution technologies in terms of texture and frequency information. We then rebuild the super-resolution reconstructed slices in the MRI. In the second reconstruction, the image after the first reconstruction is composed of only half of the slices, and there are still missing values. In our previous work, we adopted the traditional interpolation method, and there was still a gap in the visual effect of the reconstructed images. Therefore, we propose a noise-based super-resolution network (nESRGAN). The noise addition to the network can provide additional texture restoration possibilities. We use nESRGAN to further restore MRI resolution and high-frequency information. Finally, we achieve the 3D reconstruction of brain MRI images through two super-resolution reconstructions. Our proposed method is superior to 3D super-resolution technology based on deep learning in terms of perception range and image quality evaluation standards. MDPI 2021-04-23 /pmc/articles/PMC8122986/ /pubmed/33922811 http://dx.doi.org/10.3390/s21092978 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhang, Hongtao
Shinomiya, Yuki
Yoshida, Shinichi
3D MRI Reconstruction Based on 2D Generative Adversarial Network Super-Resolution
title 3D MRI Reconstruction Based on 2D Generative Adversarial Network Super-Resolution
title_full 3D MRI Reconstruction Based on 2D Generative Adversarial Network Super-Resolution
title_fullStr 3D MRI Reconstruction Based on 2D Generative Adversarial Network Super-Resolution
title_full_unstemmed 3D MRI Reconstruction Based on 2D Generative Adversarial Network Super-Resolution
title_short 3D MRI Reconstruction Based on 2D Generative Adversarial Network Super-Resolution
title_sort 3d mri reconstruction based on 2d generative adversarial network super-resolution
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8122986/
https://www.ncbi.nlm.nih.gov/pubmed/33922811
http://dx.doi.org/10.3390/s21092978
work_keys_str_mv AT zhanghongtao 3dmrireconstructionbasedon2dgenerativeadversarialnetworksuperresolution
AT shinomiyayuki 3dmrireconstructionbasedon2dgenerativeadversarialnetworksuperresolution
AT yoshidashinichi 3dmrireconstructionbasedon2dgenerativeadversarialnetworksuperresolution