Cargando…

Phase imaging with an untrained neural network

Most of the neural networks proposed so far for computational imaging (CI) in optics employ a supervised training strategy, and thus need a large training set to optimize their weights and biases. Setting aside the requirements of environmental and system stability during many hours of data acquisit...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Fei, Bian, Yaoming, Wang, Haichao, Lyu, Meng, Pedrini, Giancarlo, Osten, Wolfgang, Barbastathis, George, Situ, Guohai
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7200792/
https://www.ncbi.nlm.nih.gov/pubmed/32411362
http://dx.doi.org/10.1038/s41377-020-0302-3
_version_ 1783529412363288576
author Wang, Fei
Bian, Yaoming
Wang, Haichao
Lyu, Meng
Pedrini, Giancarlo
Osten, Wolfgang
Barbastathis, George
Situ, Guohai
author_facet Wang, Fei
Bian, Yaoming
Wang, Haichao
Lyu, Meng
Pedrini, Giancarlo
Osten, Wolfgang
Barbastathis, George
Situ, Guohai
author_sort Wang, Fei
collection PubMed
description Most of the neural networks proposed so far for computational imaging (CI) in optics employ a supervised training strategy, and thus need a large training set to optimize their weights and biases. Setting aside the requirements of environmental and system stability during many hours of data acquisition, in many practical applications, it is unlikely to be possible to obtain sufficient numbers of ground-truth images for training. Here, we propose to overcome this limitation by incorporating into a conventional deep neural network a complete physical model that represents the process of image formation. The most significant advantage of the resulting physics-enhanced deep neural network (PhysenNet) is that it can be used without training beforehand, thus eliminating the need for tens of thousands of labeled data. We take single-beam phase imaging as an example for demonstration. We experimentally show that one needs only to feed PhysenNet a single diffraction pattern of a phase object, and it can automatically optimize the network and eventually produce the object phase through the interplay between the neural network and the physical model. This opens up a new paradigm of neural network design, in which the concept of incorporating a physical model into a neural network can be generalized to solve many other CI problems.
format Online
Article
Text
id pubmed-7200792
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-72007922020-05-14 Phase imaging with an untrained neural network Wang, Fei Bian, Yaoming Wang, Haichao Lyu, Meng Pedrini, Giancarlo Osten, Wolfgang Barbastathis, George Situ, Guohai Light Sci Appl Letter Most of the neural networks proposed so far for computational imaging (CI) in optics employ a supervised training strategy, and thus need a large training set to optimize their weights and biases. Setting aside the requirements of environmental and system stability during many hours of data acquisition, in many practical applications, it is unlikely to be possible to obtain sufficient numbers of ground-truth images for training. Here, we propose to overcome this limitation by incorporating into a conventional deep neural network a complete physical model that represents the process of image formation. The most significant advantage of the resulting physics-enhanced deep neural network (PhysenNet) is that it can be used without training beforehand, thus eliminating the need for tens of thousands of labeled data. We take single-beam phase imaging as an example for demonstration. We experimentally show that one needs only to feed PhysenNet a single diffraction pattern of a phase object, and it can automatically optimize the network and eventually produce the object phase through the interplay between the neural network and the physical model. This opens up a new paradigm of neural network design, in which the concept of incorporating a physical model into a neural network can be generalized to solve many other CI problems. Nature Publishing Group UK 2020-05-06 /pmc/articles/PMC7200792/ /pubmed/32411362 http://dx.doi.org/10.1038/s41377-020-0302-3 Text en © The Author(s) 2020 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Letter
Wang, Fei
Bian, Yaoming
Wang, Haichao
Lyu, Meng
Pedrini, Giancarlo
Osten, Wolfgang
Barbastathis, George
Situ, Guohai
Phase imaging with an untrained neural network
title Phase imaging with an untrained neural network
title_full Phase imaging with an untrained neural network
title_fullStr Phase imaging with an untrained neural network
title_full_unstemmed Phase imaging with an untrained neural network
title_short Phase imaging with an untrained neural network
title_sort phase imaging with an untrained neural network
topic Letter
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7200792/
https://www.ncbi.nlm.nih.gov/pubmed/32411362
http://dx.doi.org/10.1038/s41377-020-0302-3
work_keys_str_mv AT wangfei phaseimagingwithanuntrainedneuralnetwork
AT bianyaoming phaseimagingwithanuntrainedneuralnetwork
AT wanghaichao phaseimagingwithanuntrainedneuralnetwork
AT lyumeng phaseimagingwithanuntrainedneuralnetwork
AT pedrinigiancarlo phaseimagingwithanuntrainedneuralnetwork
AT ostenwolfgang phaseimagingwithanuntrainedneuralnetwork
AT barbastathisgeorge phaseimagingwithanuntrainedneuralnetwork
AT situguohai phaseimagingwithanuntrainedneuralnetwork