Cargando…
Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction †
Fourier ptychographic microscopy (FPM) is a potential imaging technique, which is used to achieve wide field-of-view (FOV), high-resolution and quantitative phase information. The LED array is used to irradiate the samples from different angles to obtain the corresponding low-resolution intensity im...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8840603/ https://www.ncbi.nlm.nih.gov/pubmed/35161982 http://dx.doi.org/10.3390/s22031237 |
_version_ | 1784650660999856128 |
---|---|
author | Wang, Xiaoli Piao, Yan Yu, Jinyang Li, Jie Sun, Haixin Jin, Yuanshang Liu, Limin Xu, Tingfa |
author_facet | Wang, Xiaoli Piao, Yan Yu, Jinyang Li, Jie Sun, Haixin Jin, Yuanshang Liu, Limin Xu, Tingfa |
author_sort | Wang, Xiaoli |
collection | PubMed |
description | Fourier ptychographic microscopy (FPM) is a potential imaging technique, which is used to achieve wide field-of-view (FOV), high-resolution and quantitative phase information. The LED array is used to irradiate the samples from different angles to obtain the corresponding low-resolution intensity images. However, the performance of reconstruction still suffers from noise and image data redundancy, which needs to be considered. In this paper, we present a novel Fourier ptychographic microscopy imaging reconstruction method based on a deep multi-feature transfer network, which can achieve good anti-noise performance and realize high-resolution reconstruction with reduced image data. First, in this paper, the image features are deeply extracted through transfer learning ResNet50, Xception and DenseNet121 networks, and utilize the complementarity of deep multiple features and adopt cascaded feature fusion strategy for channel merging to improve the quality of image reconstruction; then the pre-upsampling is used to reconstruct the network to improve the texture details of the high-resolution reconstructed image. We validate the performance of the reported method via both simulation and experiment. The model has good robustness to noise and blurred images. Better reconstruction results are obtained under the conditions of short time and low resolution. We hope that the end-to-end mapping method of neural network can provide a neural-network perspective to solve the FPM reconstruction. |
format | Online Article Text |
id | pubmed-8840603 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-88406032022-02-13 Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction † Wang, Xiaoli Piao, Yan Yu, Jinyang Li, Jie Sun, Haixin Jin, Yuanshang Liu, Limin Xu, Tingfa Sensors (Basel) Article Fourier ptychographic microscopy (FPM) is a potential imaging technique, which is used to achieve wide field-of-view (FOV), high-resolution and quantitative phase information. The LED array is used to irradiate the samples from different angles to obtain the corresponding low-resolution intensity images. However, the performance of reconstruction still suffers from noise and image data redundancy, which needs to be considered. In this paper, we present a novel Fourier ptychographic microscopy imaging reconstruction method based on a deep multi-feature transfer network, which can achieve good anti-noise performance and realize high-resolution reconstruction with reduced image data. First, in this paper, the image features are deeply extracted through transfer learning ResNet50, Xception and DenseNet121 networks, and utilize the complementarity of deep multiple features and adopt cascaded feature fusion strategy for channel merging to improve the quality of image reconstruction; then the pre-upsampling is used to reconstruct the network to improve the texture details of the high-resolution reconstructed image. We validate the performance of the reported method via both simulation and experiment. The model has good robustness to noise and blurred images. Better reconstruction results are obtained under the conditions of short time and low resolution. We hope that the end-to-end mapping method of neural network can provide a neural-network perspective to solve the FPM reconstruction. MDPI 2022-02-06 /pmc/articles/PMC8840603/ /pubmed/35161982 http://dx.doi.org/10.3390/s22031237 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Wang, Xiaoli Piao, Yan Yu, Jinyang Li, Jie Sun, Haixin Jin, Yuanshang Liu, Limin Xu, Tingfa Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction † |
title | Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction † |
title_full | Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction † |
title_fullStr | Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction † |
title_full_unstemmed | Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction † |
title_short | Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction † |
title_sort | deep multi-feature transfer network for fourier ptychographic microscopy imaging reconstruction † |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8840603/ https://www.ncbi.nlm.nih.gov/pubmed/35161982 http://dx.doi.org/10.3390/s22031237 |
work_keys_str_mv | AT wangxiaoli deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction AT piaoyan deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction AT yujinyang deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction AT lijie deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction AT sunhaixin deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction AT jinyuanshang deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction AT liulimin deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction AT xutingfa deepmultifeaturetransfernetworkforfourierptychographicmicroscopyimagingreconstruction |