Cargando…

Monocular metasurface camera for passive single-shot 4D imaging

It is a grand challenge for an imaging system to simultaneously obtain multi-dimensional light field information, such as depth and polarization, of a scene for the accurate perception of the physical world. However, such a task would conventionally require bulky optical components, time-domain mult...

Descripción completa

Detalles Bibliográficos
Autores principales: Shen, Zicheng, Zhao, Feng, Jin, Chunqi, Wang, Shuai, Cao, Liangcai, Yang, Yuanmu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9950364/
https://www.ncbi.nlm.nih.gov/pubmed/36823191
http://dx.doi.org/10.1038/s41467-023-36812-6
_version_ 1784893147063517184
author Shen, Zicheng
Zhao, Feng
Jin, Chunqi
Wang, Shuai
Cao, Liangcai
Yang, Yuanmu
author_facet Shen, Zicheng
Zhao, Feng
Jin, Chunqi
Wang, Shuai
Cao, Liangcai
Yang, Yuanmu
author_sort Shen, Zicheng
collection PubMed
description It is a grand challenge for an imaging system to simultaneously obtain multi-dimensional light field information, such as depth and polarization, of a scene for the accurate perception of the physical world. However, such a task would conventionally require bulky optical components, time-domain multiplexing, and active laser illumination. Here, we experimentally demonstrate a compact monocular camera equipped with a single-layer metalens that can capture a 4D image, including 2D all-in-focus intensity, depth, and polarization of a target scene in a single shot under ambient illumination conditions. The metalens is optimized to have a conjugate pair of polarization-decoupled rotating single-helix point-spread functions that are strongly dependent on the depth of the target object. Combined with a straightforward, physically interpretable image retrieval algorithm, the camera can simultaneously perform high-accuracy depth sensing and high-fidelity polarization imaging over an extended depth of field for both static and dynamic scenes in both indoor and outdoor environments. Such a compact multi-dimensional imaging system could enable new applications in diverse areas ranging from machine vision to microscopy.
format Online
Article
Text
id pubmed-9950364
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-99503642023-02-25 Monocular metasurface camera for passive single-shot 4D imaging Shen, Zicheng Zhao, Feng Jin, Chunqi Wang, Shuai Cao, Liangcai Yang, Yuanmu Nat Commun Article It is a grand challenge for an imaging system to simultaneously obtain multi-dimensional light field information, such as depth and polarization, of a scene for the accurate perception of the physical world. However, such a task would conventionally require bulky optical components, time-domain multiplexing, and active laser illumination. Here, we experimentally demonstrate a compact monocular camera equipped with a single-layer metalens that can capture a 4D image, including 2D all-in-focus intensity, depth, and polarization of a target scene in a single shot under ambient illumination conditions. The metalens is optimized to have a conjugate pair of polarization-decoupled rotating single-helix point-spread functions that are strongly dependent on the depth of the target object. Combined with a straightforward, physically interpretable image retrieval algorithm, the camera can simultaneously perform high-accuracy depth sensing and high-fidelity polarization imaging over an extended depth of field for both static and dynamic scenes in both indoor and outdoor environments. Such a compact multi-dimensional imaging system could enable new applications in diverse areas ranging from machine vision to microscopy. Nature Publishing Group UK 2023-02-23 /pmc/articles/PMC9950364/ /pubmed/36823191 http://dx.doi.org/10.1038/s41467-023-36812-6 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Shen, Zicheng
Zhao, Feng
Jin, Chunqi
Wang, Shuai
Cao, Liangcai
Yang, Yuanmu
Monocular metasurface camera for passive single-shot 4D imaging
title Monocular metasurface camera for passive single-shot 4D imaging
title_full Monocular metasurface camera for passive single-shot 4D imaging
title_fullStr Monocular metasurface camera for passive single-shot 4D imaging
title_full_unstemmed Monocular metasurface camera for passive single-shot 4D imaging
title_short Monocular metasurface camera for passive single-shot 4D imaging
title_sort monocular metasurface camera for passive single-shot 4d imaging
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9950364/
https://www.ncbi.nlm.nih.gov/pubmed/36823191
http://dx.doi.org/10.1038/s41467-023-36812-6
work_keys_str_mv AT shenzicheng monocularmetasurfacecameraforpassivesingleshot4dimaging
AT zhaofeng monocularmetasurfacecameraforpassivesingleshot4dimaging
AT jinchunqi monocularmetasurfacecameraforpassivesingleshot4dimaging
AT wangshuai monocularmetasurfacecameraforpassivesingleshot4dimaging
AT caoliangcai monocularmetasurfacecameraforpassivesingleshot4dimaging
AT yangyuanmu monocularmetasurfacecameraforpassivesingleshot4dimaging