Cargando…

Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction

A lens-free microscope is a simple imaging device performing in-line holographic measurements. In the absence of focusing optics, a reconstruction algorithm is used to retrieve the sample image by solving the inverse problem. This is usually performed by optimization algorithms relying on gradient c...

Descripción completa

Detalles Bibliográficos
Autores principales: Hervé, L., Kraemer, D. C. A., Cioni, O., Mandula, O., Menneteau, M., Morales, S., Allier, C.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7678858/
https://www.ncbi.nlm.nih.gov/pubmed/33214618
http://dx.doi.org/10.1038/s41598-020-76411-9
_version_ 1783612239264088064
author Hervé, L.
Kraemer, D. C. A.
Cioni, O.
Mandula, O.
Menneteau, M.
Morales, S.
Allier, C.
author_facet Hervé, L.
Kraemer, D. C. A.
Cioni, O.
Mandula, O.
Menneteau, M.
Morales, S.
Allier, C.
author_sort Hervé, L.
collection PubMed
description A lens-free microscope is a simple imaging device performing in-line holographic measurements. In the absence of focusing optics, a reconstruction algorithm is used to retrieve the sample image by solving the inverse problem. This is usually performed by optimization algorithms relying on gradient computation. However the presence of local minima leads to unsatisfactory convergence when phase wrapping errors occur. This is particularly the case in large optical thickness samples, for example cells in suspension and cells undergoing mitosis. To date, the occurrence of phase wrapping errors in the holographic reconstruction limits the application of lens-free microscopy in live cell imaging. To overcome this issue, we propose a novel approach in which the reconstruction alternates between two approaches, an inverse problem optimization and deep learning. The computation starts with a first reconstruction guess of the cell sample image. The result is then fed into a neural network, which is trained to correct phase wrapping errors. The neural network prediction is next used as the initialization of a second and last reconstruction step, which corrects to a certain extent the neural network prediction errors. We demonstrate the applicability of this approach in solving the phase wrapping problem occurring with cells in suspension at large densities. This is a challenging sample that typically cannot be reconstructed without phase wrapping errors, when using inverse problem optimization alone.
format Online
Article
Text
id pubmed-7678858
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-76788582020-11-23 Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction Hervé, L. Kraemer, D. C. A. Cioni, O. Mandula, O. Menneteau, M. Morales, S. Allier, C. Sci Rep Article A lens-free microscope is a simple imaging device performing in-line holographic measurements. In the absence of focusing optics, a reconstruction algorithm is used to retrieve the sample image by solving the inverse problem. This is usually performed by optimization algorithms relying on gradient computation. However the presence of local minima leads to unsatisfactory convergence when phase wrapping errors occur. This is particularly the case in large optical thickness samples, for example cells in suspension and cells undergoing mitosis. To date, the occurrence of phase wrapping errors in the holographic reconstruction limits the application of lens-free microscopy in live cell imaging. To overcome this issue, we propose a novel approach in which the reconstruction alternates between two approaches, an inverse problem optimization and deep learning. The computation starts with a first reconstruction guess of the cell sample image. The result is then fed into a neural network, which is trained to correct phase wrapping errors. The neural network prediction is next used as the initialization of a second and last reconstruction step, which corrects to a certain extent the neural network prediction errors. We demonstrate the applicability of this approach in solving the phase wrapping problem occurring with cells in suspension at large densities. This is a challenging sample that typically cannot be reconstructed without phase wrapping errors, when using inverse problem optimization alone. Nature Publishing Group UK 2020-11-19 /pmc/articles/PMC7678858/ /pubmed/33214618 http://dx.doi.org/10.1038/s41598-020-76411-9 Text en © The Author(s) 2020 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Hervé, L.
Kraemer, D. C. A.
Cioni, O.
Mandula, O.
Menneteau, M.
Morales, S.
Allier, C.
Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction
title Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction
title_full Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction
title_fullStr Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction
title_full_unstemmed Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction
title_short Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction
title_sort alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7678858/
https://www.ncbi.nlm.nih.gov/pubmed/33214618
http://dx.doi.org/10.1038/s41598-020-76411-9
work_keys_str_mv AT hervel alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction
AT kraemerdca alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction
AT cionio alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction
AT mandulao alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction
AT menneteaum alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction
AT moraless alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction
AT allierc alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction