Cargando…

Unsupervised full-color cellular image reconstruction through disordered optical fiber

Recent years have witnessed the tremendous development of fusing fiber-optic imaging with supervised deep learning to enable high-quality imaging of hard-to-reach areas. Nevertheless, the supervised deep learning method imposes strict constraints on fiber-optic imaging systems, where the input objec...

Descripción completa

Detalles Bibliográficos
Autores principales: Hu, Xiaowen, Zhao, Jian, Antonio-Lopez, Jose Enrique, Correa, Rodrigo Amezcua, Schülzgen, Axel
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10206102/
https://www.ncbi.nlm.nih.gov/pubmed/37221183
http://dx.doi.org/10.1038/s41377-023-01183-6
_version_ 1785046153887219712
author Hu, Xiaowen
Zhao, Jian
Antonio-Lopez, Jose Enrique
Correa, Rodrigo Amezcua
Schülzgen, Axel
author_facet Hu, Xiaowen
Zhao, Jian
Antonio-Lopez, Jose Enrique
Correa, Rodrigo Amezcua
Schülzgen, Axel
author_sort Hu, Xiaowen
collection PubMed
description Recent years have witnessed the tremendous development of fusing fiber-optic imaging with supervised deep learning to enable high-quality imaging of hard-to-reach areas. Nevertheless, the supervised deep learning method imposes strict constraints on fiber-optic imaging systems, where the input objects and the fiber outputs have to be collected in pairs. To unleash the full potential of fiber-optic imaging, unsupervised image reconstruction is in demand. Unfortunately, neither optical fiber bundles nor multimode fibers can achieve a point-to-point transmission of the object with a high sampling density, as is a prerequisite for unsupervised image reconstruction. The recently proposed disordered fibers offer a new solution based on the transverse Anderson localization. Here, we demonstrate unsupervised full-color imaging with a cellular resolution through a meter-long disordered fiber in both transmission and reflection modes. The unsupervised image reconstruction consists of two stages. In the first stage, we perform a pixel-wise standardization on the fiber outputs using the statistics of the objects. In the second stage, we recover the fine details of the reconstructions through a generative adversarial network. Unsupervised image reconstruction does not need paired images, enabling a much more flexible calibration under various conditions. Our new solution achieves full-color high-fidelity cell imaging within a working distance of at least 4 mm by only collecting the fiber outputs after an initial calibration. High imaging robustness is also demonstrated when the disordered fiber is bent with a central angle of 60°. Moreover, the cross-domain generality on unseen objects is shown to be enhanced with a diversified object set.
format Online
Article
Text
id pubmed-10206102
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-102061022023-05-25 Unsupervised full-color cellular image reconstruction through disordered optical fiber Hu, Xiaowen Zhao, Jian Antonio-Lopez, Jose Enrique Correa, Rodrigo Amezcua Schülzgen, Axel Light Sci Appl Article Recent years have witnessed the tremendous development of fusing fiber-optic imaging with supervised deep learning to enable high-quality imaging of hard-to-reach areas. Nevertheless, the supervised deep learning method imposes strict constraints on fiber-optic imaging systems, where the input objects and the fiber outputs have to be collected in pairs. To unleash the full potential of fiber-optic imaging, unsupervised image reconstruction is in demand. Unfortunately, neither optical fiber bundles nor multimode fibers can achieve a point-to-point transmission of the object with a high sampling density, as is a prerequisite for unsupervised image reconstruction. The recently proposed disordered fibers offer a new solution based on the transverse Anderson localization. Here, we demonstrate unsupervised full-color imaging with a cellular resolution through a meter-long disordered fiber in both transmission and reflection modes. The unsupervised image reconstruction consists of two stages. In the first stage, we perform a pixel-wise standardization on the fiber outputs using the statistics of the objects. In the second stage, we recover the fine details of the reconstructions through a generative adversarial network. Unsupervised image reconstruction does not need paired images, enabling a much more flexible calibration under various conditions. Our new solution achieves full-color high-fidelity cell imaging within a working distance of at least 4 mm by only collecting the fiber outputs after an initial calibration. High imaging robustness is also demonstrated when the disordered fiber is bent with a central angle of 60°. Moreover, the cross-domain generality on unseen objects is shown to be enhanced with a diversified object set. Nature Publishing Group UK 2023-05-23 /pmc/articles/PMC10206102/ /pubmed/37221183 http://dx.doi.org/10.1038/s41377-023-01183-6 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Hu, Xiaowen
Zhao, Jian
Antonio-Lopez, Jose Enrique
Correa, Rodrigo Amezcua
Schülzgen, Axel
Unsupervised full-color cellular image reconstruction through disordered optical fiber
title Unsupervised full-color cellular image reconstruction through disordered optical fiber
title_full Unsupervised full-color cellular image reconstruction through disordered optical fiber
title_fullStr Unsupervised full-color cellular image reconstruction through disordered optical fiber
title_full_unstemmed Unsupervised full-color cellular image reconstruction through disordered optical fiber
title_short Unsupervised full-color cellular image reconstruction through disordered optical fiber
title_sort unsupervised full-color cellular image reconstruction through disordered optical fiber
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10206102/
https://www.ncbi.nlm.nih.gov/pubmed/37221183
http://dx.doi.org/10.1038/s41377-023-01183-6
work_keys_str_mv AT huxiaowen unsupervisedfullcolorcellularimagereconstructionthroughdisorderedopticalfiber
AT zhaojian unsupervisedfullcolorcellularimagereconstructionthroughdisorderedopticalfiber
AT antoniolopezjoseenrique unsupervisedfullcolorcellularimagereconstructionthroughdisorderedopticalfiber
AT correarodrigoamezcua unsupervisedfullcolorcellularimagereconstructionthroughdisorderedopticalfiber
AT schulzgenaxel unsupervisedfullcolorcellularimagereconstructionthroughdisorderedopticalfiber