Cargando…

Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction †

Fourier ptychographic microscopy (FPM) is a potential imaging technique, which is used to achieve wide field-of-view (FOV), high-resolution and quantitative phase information. The LED array is used to irradiate the samples from different angles to obtain the corresponding low-resolution intensity im...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Xiaoli, Piao, Yan, Yu, Jinyang, Li, Jie, Sun, Haixin, Jin, Yuanshang, Liu, Limin, Xu, Tingfa
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8840603/
https://www.ncbi.nlm.nih.gov/pubmed/35161982
http://dx.doi.org/10.3390/s22031237
_version_ 1784650660999856128
author Wang, Xiaoli
Piao, Yan
Yu, Jinyang
Li, Jie
Sun, Haixin
Jin, Yuanshang
Liu, Limin
Xu, Tingfa
author_facet Wang, Xiaoli
Piao, Yan
Yu, Jinyang
Li, Jie
Sun, Haixin
Jin, Yuanshang
Liu, Limin
Xu, Tingfa
author_sort Wang, Xiaoli
collection PubMed
description Fourier ptychographic microscopy (FPM) is a potential imaging technique, which is used to achieve wide field-of-view (FOV), high-resolution and quantitative phase information. The LED array is used to irradiate the samples from different angles to obtain the corresponding low-resolution intensity images. However, the performance of reconstruction still suffers from noise and image data redundancy, which needs to be considered. In this paper, we present a novel Fourier ptychographic microscopy imaging reconstruction method based on a deep multi-feature transfer network, which can achieve good anti-noise performance and realize high-resolution reconstruction with reduced image data. First, in this paper, the image features are deeply extracted through transfer learning ResNet50, Xception and DenseNet121 networks, and utilize the complementarity of deep multiple features and adopt cascaded feature fusion strategy for channel merging to improve the quality of image reconstruction; then the pre-upsampling is used to reconstruct the network to improve the texture details of the high-resolution reconstructed image. We validate the performance of the reported method via both simulation and experiment. The model has good robustness to noise and blurred images. Better reconstruction results are obtained under the conditions of short time and low resolution. We hope that the end-to-end mapping method of neural network can provide a neural-network perspective to solve the FPM reconstruction.
format Online
Article
Text
id pubmed-8840603
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-88406032022-02-13 Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction † Wang, Xiaoli Piao, Yan Yu, Jinyang Li, Jie Sun, Haixin Jin, Yuanshang Liu, Limin Xu, Tingfa Sensors (Basel) Article Fourier ptychographic microscopy (FPM) is a potential imaging technique, which is used to achieve wide field-of-view (FOV), high-resolution and quantitative phase information. The LED array is used to irradiate the samples from different angles to obtain the corresponding low-resolution intensity images. However, the performance of reconstruction still suffers from noise and image data redundancy, which needs to be considered. In this paper, we present a novel Fourier ptychographic microscopy imaging reconstruction method based on a deep multi-feature transfer network, which can achieve good anti-noise performance and realize high-resolution reconstruction with reduced image data. First, in this paper, the image features are deeply extracted through transfer learning ResNet50, Xception and DenseNet121 networks, and utilize the complementarity of deep multiple features and adopt cascaded feature fusion strategy for channel merging to improve the quality of image reconstruction; then the pre-upsampling is used to reconstruct the network to improve the texture details of the high-resolution reconstructed image. We validate the performance of the reported method via both simulation and experiment. The model has good robustness to noise and blurred images. Better reconstruction results are obtained under the conditions of short time and low resolution. We hope that the end-to-end mapping method of neural network can provide a neural-network perspective to solve the FPM reconstruction. MDPI 2022-02-06 /pmc/articles/PMC8840603/ /pubmed/35161982 http://dx.doi.org/10.3390/s22031237 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Xiaoli
Piao, Yan
Yu, Jinyang
Li, Jie
Sun, Haixin
Jin, Yuanshang
Liu, Limin
Xu, Tingfa
Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction †
title Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction †
title_full Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction †
title_fullStr Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction †
title_full_unstemmed Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction †
title_short Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction †
title_sort deep multi-feature transfer network for fourier ptychographic microscopy imaging reconstruction †
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8840603/
https://www.ncbi.nlm.nih.gov/pubmed/35161982
http://dx.doi.org/10.3390/s22031237
work_keys_str_mv AT wangxiaoli deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction
AT piaoyan deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction
AT yujinyang deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction
AT lijie deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction
AT sunhaixin deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction
AT jinyuanshang deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction
AT liulimin deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction
AT xutingfa deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction