Cargando…
Classification and reconstruction of spatially overlapping phase images using diffractive optical networks
Diffractive optical networks unify wave optics and deep learning to all-optically compute a given machine learning or computational imaging task as the light propagates from the input to the output plane. Here, we report the design of diffractive optical networks for the classification and reconstru...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9120207/ https://www.ncbi.nlm.nih.gov/pubmed/35589729 http://dx.doi.org/10.1038/s41598-022-12020-y |
_version_ | 1784710887126335488 |
---|---|
author | Mengu, Deniz Veli, Muhammed Rivenson, Yair Ozcan, Aydogan |
author_facet | Mengu, Deniz Veli, Muhammed Rivenson, Yair Ozcan, Aydogan |
author_sort | Mengu, Deniz |
collection | PubMed |
description | Diffractive optical networks unify wave optics and deep learning to all-optically compute a given machine learning or computational imaging task as the light propagates from the input to the output plane. Here, we report the design of diffractive optical networks for the classification and reconstruction of spatially overlapping, phase-encoded objects. When two different phase-only objects spatially overlap, the individual object functions are perturbed since their phase patterns are summed up. The retrieval of the underlying phase images from solely the overlapping phase distribution presents a challenging problem, the solution of which is generally not unique. We show that through a task-specific training process, passive diffractive optical networks composed of successive transmissive layers can all-optically and simultaneously classify two different randomly-selected, spatially overlapping phase images at the input. After trained with ~ 550 million unique combinations of phase-encoded handwritten digits from the MNIST dataset, our blind testing results reveal that the diffractive optical network achieves an accuracy of > 85.8% for all-optical classification of two overlapping phase images of new handwritten digits. In addition to all-optical classification of overlapping phase objects, we also demonstrate the reconstruction of these phase images based on a shallow electronic neural network that uses the highly compressed output of the diffractive optical network as its input (with e.g., ~ 20–65 times less number of pixels) to rapidly reconstruct both of the phase images, despite their spatial overlap and related phase ambiguity. The presented phase image classification and reconstruction framework might find applications in e.g., computational imaging, microscopy and quantitative phase imaging fields. |
format | Online Article Text |
id | pubmed-9120207 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-91202072022-05-21 Classification and reconstruction of spatially overlapping phase images using diffractive optical networks Mengu, Deniz Veli, Muhammed Rivenson, Yair Ozcan, Aydogan Sci Rep Article Diffractive optical networks unify wave optics and deep learning to all-optically compute a given machine learning or computational imaging task as the light propagates from the input to the output plane. Here, we report the design of diffractive optical networks for the classification and reconstruction of spatially overlapping, phase-encoded objects. When two different phase-only objects spatially overlap, the individual object functions are perturbed since their phase patterns are summed up. The retrieval of the underlying phase images from solely the overlapping phase distribution presents a challenging problem, the solution of which is generally not unique. We show that through a task-specific training process, passive diffractive optical networks composed of successive transmissive layers can all-optically and simultaneously classify two different randomly-selected, spatially overlapping phase images at the input. After trained with ~ 550 million unique combinations of phase-encoded handwritten digits from the MNIST dataset, our blind testing results reveal that the diffractive optical network achieves an accuracy of > 85.8% for all-optical classification of two overlapping phase images of new handwritten digits. In addition to all-optical classification of overlapping phase objects, we also demonstrate the reconstruction of these phase images based on a shallow electronic neural network that uses the highly compressed output of the diffractive optical network as its input (with e.g., ~ 20–65 times less number of pixels) to rapidly reconstruct both of the phase images, despite their spatial overlap and related phase ambiguity. The presented phase image classification and reconstruction framework might find applications in e.g., computational imaging, microscopy and quantitative phase imaging fields. Nature Publishing Group UK 2022-05-19 /pmc/articles/PMC9120207/ /pubmed/35589729 http://dx.doi.org/10.1038/s41598-022-12020-y Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Mengu, Deniz Veli, Muhammed Rivenson, Yair Ozcan, Aydogan Classification and reconstruction of spatially overlapping phase images using diffractive optical networks |
title | Classification and reconstruction of spatially overlapping phase images using diffractive optical networks |
title_full | Classification and reconstruction of spatially overlapping phase images using diffractive optical networks |
title_fullStr | Classification and reconstruction of spatially overlapping phase images using diffractive optical networks |
title_full_unstemmed | Classification and reconstruction of spatially overlapping phase images using diffractive optical networks |
title_short | Classification and reconstruction of spatially overlapping phase images using diffractive optical networks |
title_sort | classification and reconstruction of spatially overlapping phase images using diffractive optical networks |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9120207/ https://www.ncbi.nlm.nih.gov/pubmed/35589729 http://dx.doi.org/10.1038/s41598-022-12020-y |
work_keys_str_mv | AT mengudeniz classificationandreconstructionofspatiallyoverlappingphaseimagesusingdiffractiveopticalnetworks AT velimuhammed classificationandreconstructionofspatiallyoverlappingphaseimagesusingdiffractiveopticalnetworks AT rivensonyair classificationandreconstructionofspatiallyoverlappingphaseimagesusingdiffractiveopticalnetworks AT ozcanaydogan classificationandreconstructionofspatiallyoverlappingphaseimagesusingdiffractiveopticalnetworks |