Cargando…
Unsupervised full-color cellular image reconstruction through disordered optical fiber
Recent years have witnessed the tremendous development of fusing fiber-optic imaging with supervised deep learning to enable high-quality imaging of hard-to-reach areas. Nevertheless, the supervised deep learning method imposes strict constraints on fiber-optic imaging systems, where the input objec...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10206102/ https://www.ncbi.nlm.nih.gov/pubmed/37221183 http://dx.doi.org/10.1038/s41377-023-01183-6 |
_version_ | 1785046153887219712 |
---|---|
author | Hu, Xiaowen Zhao, Jian Antonio-Lopez, Jose Enrique Correa, Rodrigo Amezcua Schülzgen, Axel |
author_facet | Hu, Xiaowen Zhao, Jian Antonio-Lopez, Jose Enrique Correa, Rodrigo Amezcua Schülzgen, Axel |
author_sort | Hu, Xiaowen |
collection | PubMed |
description | Recent years have witnessed the tremendous development of fusing fiber-optic imaging with supervised deep learning to enable high-quality imaging of hard-to-reach areas. Nevertheless, the supervised deep learning method imposes strict constraints on fiber-optic imaging systems, where the input objects and the fiber outputs have to be collected in pairs. To unleash the full potential of fiber-optic imaging, unsupervised image reconstruction is in demand. Unfortunately, neither optical fiber bundles nor multimode fibers can achieve a point-to-point transmission of the object with a high sampling density, as is a prerequisite for unsupervised image reconstruction. The recently proposed disordered fibers offer a new solution based on the transverse Anderson localization. Here, we demonstrate unsupervised full-color imaging with a cellular resolution through a meter-long disordered fiber in both transmission and reflection modes. The unsupervised image reconstruction consists of two stages. In the first stage, we perform a pixel-wise standardization on the fiber outputs using the statistics of the objects. In the second stage, we recover the fine details of the reconstructions through a generative adversarial network. Unsupervised image reconstruction does not need paired images, enabling a much more flexible calibration under various conditions. Our new solution achieves full-color high-fidelity cell imaging within a working distance of at least 4 mm by only collecting the fiber outputs after an initial calibration. High imaging robustness is also demonstrated when the disordered fiber is bent with a central angle of 60°. Moreover, the cross-domain generality on unseen objects is shown to be enhanced with a diversified object set. |
format | Online Article Text |
id | pubmed-10206102 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-102061022023-05-25 Unsupervised full-color cellular image reconstruction through disordered optical fiber Hu, Xiaowen Zhao, Jian Antonio-Lopez, Jose Enrique Correa, Rodrigo Amezcua Schülzgen, Axel Light Sci Appl Article Recent years have witnessed the tremendous development of fusing fiber-optic imaging with supervised deep learning to enable high-quality imaging of hard-to-reach areas. Nevertheless, the supervised deep learning method imposes strict constraints on fiber-optic imaging systems, where the input objects and the fiber outputs have to be collected in pairs. To unleash the full potential of fiber-optic imaging, unsupervised image reconstruction is in demand. Unfortunately, neither optical fiber bundles nor multimode fibers can achieve a point-to-point transmission of the object with a high sampling density, as is a prerequisite for unsupervised image reconstruction. The recently proposed disordered fibers offer a new solution based on the transverse Anderson localization. Here, we demonstrate unsupervised full-color imaging with a cellular resolution through a meter-long disordered fiber in both transmission and reflection modes. The unsupervised image reconstruction consists of two stages. In the first stage, we perform a pixel-wise standardization on the fiber outputs using the statistics of the objects. In the second stage, we recover the fine details of the reconstructions through a generative adversarial network. Unsupervised image reconstruction does not need paired images, enabling a much more flexible calibration under various conditions. Our new solution achieves full-color high-fidelity cell imaging within a working distance of at least 4 mm by only collecting the fiber outputs after an initial calibration. High imaging robustness is also demonstrated when the disordered fiber is bent with a central angle of 60°. Moreover, the cross-domain generality on unseen objects is shown to be enhanced with a diversified object set. Nature Publishing Group UK 2023-05-23 /pmc/articles/PMC10206102/ /pubmed/37221183 http://dx.doi.org/10.1038/s41377-023-01183-6 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Hu, Xiaowen Zhao, Jian Antonio-Lopez, Jose Enrique Correa, Rodrigo Amezcua Schülzgen, Axel Unsupervised full-color cellular image reconstruction through disordered optical fiber |
title | Unsupervised full-color cellular image reconstruction through disordered optical fiber |
title_full | Unsupervised full-color cellular image reconstruction through disordered optical fiber |
title_fullStr | Unsupervised full-color cellular image reconstruction through disordered optical fiber |
title_full_unstemmed | Unsupervised full-color cellular image reconstruction through disordered optical fiber |
title_short | Unsupervised full-color cellular image reconstruction through disordered optical fiber |
title_sort | unsupervised full-color cellular image reconstruction through disordered optical fiber |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10206102/ https://www.ncbi.nlm.nih.gov/pubmed/37221183 http://dx.doi.org/10.1038/s41377-023-01183-6 |
work_keys_str_mv | AT huxiaowen unsupervisedfullcolorcellularimagereconstructionthroughdisorderedopticalfiber AT zhaojian unsupervisedfullcolorcellularimagereconstructionthroughdisorderedopticalfiber AT antoniolopezjoseenrique unsupervisedfullcolorcellularimagereconstructionthroughdisorderedopticalfiber AT correarodrigoamezcua unsupervisedfullcolorcellularimagereconstructionthroughdisorderedopticalfiber AT schulzgenaxel unsupervisedfullcolorcellularimagereconstructionthroughdisorderedopticalfiber |