Cargando…
A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions
Two-dimensional observation of biological samples at hundreds of nanometers resolution or even below is of high interest for many sensitive medical applications. Recent advances have been obtained over the last ten years with computational imaging. Among them, Fourier Ptychographic Microscopy is of...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422347/ https://www.ncbi.nlm.nih.gov/pubmed/37571611 http://dx.doi.org/10.3390/s23156829 |
_version_ | 1785089187027877888 |
---|---|
author | Bouchama, Lyes Dorizzi, Bernadette Klossa, Jacques Gottesman, Yaneck |
author_facet | Bouchama, Lyes Dorizzi, Bernadette Klossa, Jacques Gottesman, Yaneck |
author_sort | Bouchama, Lyes |
collection | PubMed |
description | Two-dimensional observation of biological samples at hundreds of nanometers resolution or even below is of high interest for many sensitive medical applications. Recent advances have been obtained over the last ten years with computational imaging. Among them, Fourier Ptychographic Microscopy is of particular interest because of its important super-resolution factor. In complement to traditional intensity images, phase images are also produced. A large set of [Formula: see text] raw images (with typically [Formula: see text] = 225) is, however, required because of the reconstruction process that is involved. In this paper, we address the problem of FPM image reconstruction using a few raw images only (here, [Formula: see text] = 37) as is highly desirable to increase microscope throughput. In contrast to previous approaches, we develop an algorithmic approach based on a physics-informed optimization deep neural network and statistical reconstruction learning. We demonstrate its efficiency with the help of simulations. The forward microscope image formation model is explicitly introduced in the deep neural network model to optimize its weights starting from an initialization that is based on statistical learning. The simulation results that are presented demonstrate the conceptual benefits of the approach. We show that high-quality images are effectively reconstructed without any appreciable resolution degradation. The learning step is also shown to be mandatory. |
format | Online Article Text |
id | pubmed-10422347 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-104223472023-08-13 A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions Bouchama, Lyes Dorizzi, Bernadette Klossa, Jacques Gottesman, Yaneck Sensors (Basel) Article Two-dimensional observation of biological samples at hundreds of nanometers resolution or even below is of high interest for many sensitive medical applications. Recent advances have been obtained over the last ten years with computational imaging. Among them, Fourier Ptychographic Microscopy is of particular interest because of its important super-resolution factor. In complement to traditional intensity images, phase images are also produced. A large set of [Formula: see text] raw images (with typically [Formula: see text] = 225) is, however, required because of the reconstruction process that is involved. In this paper, we address the problem of FPM image reconstruction using a few raw images only (here, [Formula: see text] = 37) as is highly desirable to increase microscope throughput. In contrast to previous approaches, we develop an algorithmic approach based on a physics-informed optimization deep neural network and statistical reconstruction learning. We demonstrate its efficiency with the help of simulations. The forward microscope image formation model is explicitly introduced in the deep neural network model to optimize its weights starting from an initialization that is based on statistical learning. The simulation results that are presented demonstrate the conceptual benefits of the approach. We show that high-quality images are effectively reconstructed without any appreciable resolution degradation. The learning step is also shown to be mandatory. MDPI 2023-07-31 /pmc/articles/PMC10422347/ /pubmed/37571611 http://dx.doi.org/10.3390/s23156829 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Bouchama, Lyes Dorizzi, Bernadette Klossa, Jacques Gottesman, Yaneck A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions |
title | A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions |
title_full | A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions |
title_fullStr | A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions |
title_full_unstemmed | A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions |
title_short | A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions |
title_sort | physics-inspired deep learning framework for an efficient fourier ptychographic microscopy reconstruction under low overlap conditions |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422347/ https://www.ncbi.nlm.nih.gov/pubmed/37571611 http://dx.doi.org/10.3390/s23156829 |
work_keys_str_mv | AT bouchamalyes aphysicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions AT dorizzibernadette aphysicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions AT klossajacques aphysicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions AT gottesmanyaneck aphysicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions AT bouchamalyes physicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions AT dorizzibernadette physicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions AT klossajacques physicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions AT gottesmanyaneck physicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions |