Cargando…
Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction
A lens-free microscope is a simple imaging device performing in-line holographic measurements. In the absence of focusing optics, a reconstruction algorithm is used to retrieve the sample image by solving the inverse problem. This is usually performed by optimization algorithms relying on gradient c...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7678858/ https://www.ncbi.nlm.nih.gov/pubmed/33214618 http://dx.doi.org/10.1038/s41598-020-76411-9 |
_version_ | 1783612239264088064 |
---|---|
author | Hervé, L. Kraemer, D. C. A. Cioni, O. Mandula, O. Menneteau, M. Morales, S. Allier, C. |
author_facet | Hervé, L. Kraemer, D. C. A. Cioni, O. Mandula, O. Menneteau, M. Morales, S. Allier, C. |
author_sort | Hervé, L. |
collection | PubMed |
description | A lens-free microscope is a simple imaging device performing in-line holographic measurements. In the absence of focusing optics, a reconstruction algorithm is used to retrieve the sample image by solving the inverse problem. This is usually performed by optimization algorithms relying on gradient computation. However the presence of local minima leads to unsatisfactory convergence when phase wrapping errors occur. This is particularly the case in large optical thickness samples, for example cells in suspension and cells undergoing mitosis. To date, the occurrence of phase wrapping errors in the holographic reconstruction limits the application of lens-free microscopy in live cell imaging. To overcome this issue, we propose a novel approach in which the reconstruction alternates between two approaches, an inverse problem optimization and deep learning. The computation starts with a first reconstruction guess of the cell sample image. The result is then fed into a neural network, which is trained to correct phase wrapping errors. The neural network prediction is next used as the initialization of a second and last reconstruction step, which corrects to a certain extent the neural network prediction errors. We demonstrate the applicability of this approach in solving the phase wrapping problem occurring with cells in suspension at large densities. This is a challenging sample that typically cannot be reconstructed without phase wrapping errors, when using inverse problem optimization alone. |
format | Online Article Text |
id | pubmed-7678858 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-76788582020-11-23 Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction Hervé, L. Kraemer, D. C. A. Cioni, O. Mandula, O. Menneteau, M. Morales, S. Allier, C. Sci Rep Article A lens-free microscope is a simple imaging device performing in-line holographic measurements. In the absence of focusing optics, a reconstruction algorithm is used to retrieve the sample image by solving the inverse problem. This is usually performed by optimization algorithms relying on gradient computation. However the presence of local minima leads to unsatisfactory convergence when phase wrapping errors occur. This is particularly the case in large optical thickness samples, for example cells in suspension and cells undergoing mitosis. To date, the occurrence of phase wrapping errors in the holographic reconstruction limits the application of lens-free microscopy in live cell imaging. To overcome this issue, we propose a novel approach in which the reconstruction alternates between two approaches, an inverse problem optimization and deep learning. The computation starts with a first reconstruction guess of the cell sample image. The result is then fed into a neural network, which is trained to correct phase wrapping errors. The neural network prediction is next used as the initialization of a second and last reconstruction step, which corrects to a certain extent the neural network prediction errors. We demonstrate the applicability of this approach in solving the phase wrapping problem occurring with cells in suspension at large densities. This is a challenging sample that typically cannot be reconstructed without phase wrapping errors, when using inverse problem optimization alone. Nature Publishing Group UK 2020-11-19 /pmc/articles/PMC7678858/ /pubmed/33214618 http://dx.doi.org/10.1038/s41598-020-76411-9 Text en © The Author(s) 2020 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Hervé, L. Kraemer, D. C. A. Cioni, O. Mandula, O. Menneteau, M. Morales, S. Allier, C. Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction |
title | Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction |
title_full | Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction |
title_fullStr | Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction |
title_full_unstemmed | Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction |
title_short | Alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction |
title_sort | alternation of inverse problem approach and deep learning for lens-free microscopy image reconstruction |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7678858/ https://www.ncbi.nlm.nih.gov/pubmed/33214618 http://dx.doi.org/10.1038/s41598-020-76411-9 |
work_keys_str_mv | AT hervel alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction AT kraemerdca alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction AT cionio alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction AT mandulao alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction AT menneteaum alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction AT moraless alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction AT allierc alternationofinverseproblemapproachanddeeplearningforlensfreemicroscopyimagereconstruction |