Cargando…

All-optical image classification through unknown random diffusers using a single-pixel diffractive network

Classification of an object behind a random and unknown scattering medium sets a challenging task for computational imaging and machine vision fields. Recent deep learning-based approaches demonstrated the classification of objects using diffuser-distorted patterns collected by an image sensor. Thes...

Descripción completa

Detalles Bibliográficos
Autores principales: Bai, Bijie, Li, Yuhang, Luo, Yi, Li, Xurong, Çetintaş, Ege, Jarrahi, Mona, Ozcan, Aydogan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9998891/
https://www.ncbi.nlm.nih.gov/pubmed/36894546
http://dx.doi.org/10.1038/s41377-023-01116-3
_version_ 1784903549481648128
author Bai, Bijie
Li, Yuhang
Luo, Yi
Li, Xurong
Çetintaş, Ege
Jarrahi, Mona
Ozcan, Aydogan
author_facet Bai, Bijie
Li, Yuhang
Luo, Yi
Li, Xurong
Çetintaş, Ege
Jarrahi, Mona
Ozcan, Aydogan
author_sort Bai, Bijie
collection PubMed
description Classification of an object behind a random and unknown scattering medium sets a challenging task for computational imaging and machine vision fields. Recent deep learning-based approaches demonstrated the classification of objects using diffuser-distorted patterns collected by an image sensor. These methods demand relatively large-scale computing using deep neural networks running on digital computers. Here, we present an all-optical processor to directly classify unknown objects through unknown, random phase diffusers using broadband illumination detected with a single pixel. A set of transmissive diffractive layers, optimized using deep learning, forms a physical network that all-optically maps the spatial information of an input object behind a random diffuser into the power spectrum of the output light detected through a single pixel at the output plane of the diffractive network. We numerically demonstrated the accuracy of this framework using broadband radiation to classify unknown handwritten digits through random new diffusers, never used during the training phase, and achieved a blind testing accuracy of 87.74 ± 1.12%. We also experimentally validated our single-pixel broadband diffractive network by classifying handwritten digits “0” and “1” through a random diffuser using terahertz waves and a 3D-printed diffractive network. This single-pixel all-optical object classification system through random diffusers is based on passive diffractive layers that process broadband input light and can operate at any part of the electromagnetic spectrum by simply scaling the diffractive features proportional to the wavelength range of interest. These results have various potential applications in, e.g., biomedical imaging, security, robotics, and autonomous driving.
format Online
Article
Text
id pubmed-9998891
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-99988912023-03-11 All-optical image classification through unknown random diffusers using a single-pixel diffractive network Bai, Bijie Li, Yuhang Luo, Yi Li, Xurong Çetintaş, Ege Jarrahi, Mona Ozcan, Aydogan Light Sci Appl Article Classification of an object behind a random and unknown scattering medium sets a challenging task for computational imaging and machine vision fields. Recent deep learning-based approaches demonstrated the classification of objects using diffuser-distorted patterns collected by an image sensor. These methods demand relatively large-scale computing using deep neural networks running on digital computers. Here, we present an all-optical processor to directly classify unknown objects through unknown, random phase diffusers using broadband illumination detected with a single pixel. A set of transmissive diffractive layers, optimized using deep learning, forms a physical network that all-optically maps the spatial information of an input object behind a random diffuser into the power spectrum of the output light detected through a single pixel at the output plane of the diffractive network. We numerically demonstrated the accuracy of this framework using broadband radiation to classify unknown handwritten digits through random new diffusers, never used during the training phase, and achieved a blind testing accuracy of 87.74 ± 1.12%. We also experimentally validated our single-pixel broadband diffractive network by classifying handwritten digits “0” and “1” through a random diffuser using terahertz waves and a 3D-printed diffractive network. This single-pixel all-optical object classification system through random diffusers is based on passive diffractive layers that process broadband input light and can operate at any part of the electromagnetic spectrum by simply scaling the diffractive features proportional to the wavelength range of interest. These results have various potential applications in, e.g., biomedical imaging, security, robotics, and autonomous driving. Nature Publishing Group UK 2023-03-09 /pmc/articles/PMC9998891/ /pubmed/36894546 http://dx.doi.org/10.1038/s41377-023-01116-3 Text en © The Author(s) 2023, corrected publication 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Bai, Bijie
Li, Yuhang
Luo, Yi
Li, Xurong
Çetintaş, Ege
Jarrahi, Mona
Ozcan, Aydogan
All-optical image classification through unknown random diffusers using a single-pixel diffractive network
title All-optical image classification through unknown random diffusers using a single-pixel diffractive network
title_full All-optical image classification through unknown random diffusers using a single-pixel diffractive network
title_fullStr All-optical image classification through unknown random diffusers using a single-pixel diffractive network
title_full_unstemmed All-optical image classification through unknown random diffusers using a single-pixel diffractive network
title_short All-optical image classification through unknown random diffusers using a single-pixel diffractive network
title_sort all-optical image classification through unknown random diffusers using a single-pixel diffractive network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9998891/
https://www.ncbi.nlm.nih.gov/pubmed/36894546
http://dx.doi.org/10.1038/s41377-023-01116-3
work_keys_str_mv AT baibijie allopticalimageclassificationthroughunknownrandomdiffusersusingasinglepixeldiffractivenetwork
AT liyuhang allopticalimageclassificationthroughunknownrandomdiffusersusingasinglepixeldiffractivenetwork
AT luoyi allopticalimageclassificationthroughunknownrandomdiffusersusingasinglepixeldiffractivenetwork
AT lixurong allopticalimageclassificationthroughunknownrandomdiffusersusingasinglepixeldiffractivenetwork
AT cetintasege allopticalimageclassificationthroughunknownrandomdiffusersusingasinglepixeldiffractivenetwork
AT jarrahimona allopticalimageclassificationthroughunknownrandomdiffusersusingasinglepixeldiffractivenetwork
AT ozcanaydogan allopticalimageclassificationthroughunknownrandomdiffusersusingasinglepixeldiffractivenetwork