Cargando…

A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions

Two-dimensional observation of biological samples at hundreds of nanometers resolution or even below is of high interest for many sensitive medical applications. Recent advances have been obtained over the last ten years with computational imaging. Among them, Fourier Ptychographic Microscopy is of...

Descripción completa

Detalles Bibliográficos
Autores principales: Bouchama, Lyes, Dorizzi, Bernadette, Klossa, Jacques, Gottesman, Yaneck
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422347/
https://www.ncbi.nlm.nih.gov/pubmed/37571611
http://dx.doi.org/10.3390/s23156829
_version_ 1785089187027877888
author Bouchama, Lyes
Dorizzi, Bernadette
Klossa, Jacques
Gottesman, Yaneck
author_facet Bouchama, Lyes
Dorizzi, Bernadette
Klossa, Jacques
Gottesman, Yaneck
author_sort Bouchama, Lyes
collection PubMed
description Two-dimensional observation of biological samples at hundreds of nanometers resolution or even below is of high interest for many sensitive medical applications. Recent advances have been obtained over the last ten years with computational imaging. Among them, Fourier Ptychographic Microscopy is of particular interest because of its important super-resolution factor. In complement to traditional intensity images, phase images are also produced. A large set of [Formula: see text] raw images (with typically [Formula: see text] = 225) is, however, required because of the reconstruction process that is involved. In this paper, we address the problem of FPM image reconstruction using a few raw images only (here, [Formula: see text] = 37) as is highly desirable to increase microscope throughput. In contrast to previous approaches, we develop an algorithmic approach based on a physics-informed optimization deep neural network and statistical reconstruction learning. We demonstrate its efficiency with the help of simulations. The forward microscope image formation model is explicitly introduced in the deep neural network model to optimize its weights starting from an initialization that is based on statistical learning. The simulation results that are presented demonstrate the conceptual benefits of the approach. We show that high-quality images are effectively reconstructed without any appreciable resolution degradation. The learning step is also shown to be mandatory.
format Online
Article
Text
id pubmed-10422347
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104223472023-08-13 A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions Bouchama, Lyes Dorizzi, Bernadette Klossa, Jacques Gottesman, Yaneck Sensors (Basel) Article Two-dimensional observation of biological samples at hundreds of nanometers resolution or even below is of high interest for many sensitive medical applications. Recent advances have been obtained over the last ten years with computational imaging. Among them, Fourier Ptychographic Microscopy is of particular interest because of its important super-resolution factor. In complement to traditional intensity images, phase images are also produced. A large set of [Formula: see text] raw images (with typically [Formula: see text] = 225) is, however, required because of the reconstruction process that is involved. In this paper, we address the problem of FPM image reconstruction using a few raw images only (here, [Formula: see text] = 37) as is highly desirable to increase microscope throughput. In contrast to previous approaches, we develop an algorithmic approach based on a physics-informed optimization deep neural network and statistical reconstruction learning. We demonstrate its efficiency with the help of simulations. The forward microscope image formation model is explicitly introduced in the deep neural network model to optimize its weights starting from an initialization that is based on statistical learning. The simulation results that are presented demonstrate the conceptual benefits of the approach. We show that high-quality images are effectively reconstructed without any appreciable resolution degradation. The learning step is also shown to be mandatory. MDPI 2023-07-31 /pmc/articles/PMC10422347/ /pubmed/37571611 http://dx.doi.org/10.3390/s23156829 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Bouchama, Lyes
Dorizzi, Bernadette
Klossa, Jacques
Gottesman, Yaneck
A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions
title A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions
title_full A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions
title_fullStr A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions
title_full_unstemmed A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions
title_short A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions
title_sort physics-inspired deep learning framework for an efficient fourier ptychographic microscopy reconstruction under low overlap conditions
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422347/
https://www.ncbi.nlm.nih.gov/pubmed/37571611
http://dx.doi.org/10.3390/s23156829
work_keys_str_mv AT bouchamalyes aphysicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions
AT dorizzibernadette aphysicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions
AT klossajacques aphysicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions
AT gottesmanyaneck aphysicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions
AT bouchamalyes physicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions
AT dorizzibernadette physicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions
AT klossajacques physicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions
AT gottesmanyaneck physicsinspireddeeplearningframeworkforanefficientfourierptychographicmicroscopyreconstructionunderlowoverlapconditions