Cargando…

All-fiber high-speed image detection enabled by deep learning

Ultra-high-speed imaging serves as a foundation for modern science. While in biomedicine, optical-fiber-based endoscopy is often required for in vivo applications, the combination of high speed with the fiber endoscopy, which is vital for exploring transient biomedical phenomena, still confronts som...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Zhoutian, Wang, Lele, Meng, Yuan, He, Tiantian, He, Sifeng, Yang, Yousi, Wang, Liuyue, Tian, Jiading, Li, Dan, Yan, Ping, Gong, Mali, Liu, Qiang, Xiao, Qirong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8930987/
https://www.ncbi.nlm.nih.gov/pubmed/35301332
http://dx.doi.org/10.1038/s41467-022-29178-8
_version_ 1784671157039923200
author Liu, Zhoutian
Wang, Lele
Meng, Yuan
He, Tiantian
He, Sifeng
Yang, Yousi
Wang, Liuyue
Tian, Jiading
Li, Dan
Yan, Ping
Gong, Mali
Liu, Qiang
Xiao, Qirong
author_facet Liu, Zhoutian
Wang, Lele
Meng, Yuan
He, Tiantian
He, Sifeng
Yang, Yousi
Wang, Liuyue
Tian, Jiading
Li, Dan
Yan, Ping
Gong, Mali
Liu, Qiang
Xiao, Qirong
author_sort Liu, Zhoutian
collection PubMed
description Ultra-high-speed imaging serves as a foundation for modern science. While in biomedicine, optical-fiber-based endoscopy is often required for in vivo applications, the combination of high speed with the fiber endoscopy, which is vital for exploring transient biomedical phenomena, still confronts some challenges. We propose all-fiber imaging at high speeds, which is achieved based on the transformation of two-dimensional spatial information into one-dimensional temporal pulsed streams by leveraging high intermodal dispersion in a multimode fiber. Neural networks are trained to reconstruct images from the temporal waveforms. It can not only detect content-aware images with high quality, but also detect images of different kinds from the training images with slightly reduced quality. The fiber probe can detect micron-scale objects with a high frame rate (15.4 Mfps) and large frame depth (10,000). This scheme combines high speeds with high mechanical flexibility and integration and may stimulate future research exploring various phenomena in vivo.
format Online
Article
Text
id pubmed-8930987
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-89309872022-04-01 All-fiber high-speed image detection enabled by deep learning Liu, Zhoutian Wang, Lele Meng, Yuan He, Tiantian He, Sifeng Yang, Yousi Wang, Liuyue Tian, Jiading Li, Dan Yan, Ping Gong, Mali Liu, Qiang Xiao, Qirong Nat Commun Article Ultra-high-speed imaging serves as a foundation for modern science. While in biomedicine, optical-fiber-based endoscopy is often required for in vivo applications, the combination of high speed with the fiber endoscopy, which is vital for exploring transient biomedical phenomena, still confronts some challenges. We propose all-fiber imaging at high speeds, which is achieved based on the transformation of two-dimensional spatial information into one-dimensional temporal pulsed streams by leveraging high intermodal dispersion in a multimode fiber. Neural networks are trained to reconstruct images from the temporal waveforms. It can not only detect content-aware images with high quality, but also detect images of different kinds from the training images with slightly reduced quality. The fiber probe can detect micron-scale objects with a high frame rate (15.4 Mfps) and large frame depth (10,000). This scheme combines high speeds with high mechanical flexibility and integration and may stimulate future research exploring various phenomena in vivo. Nature Publishing Group UK 2022-03-17 /pmc/articles/PMC8930987/ /pubmed/35301332 http://dx.doi.org/10.1038/s41467-022-29178-8 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Liu, Zhoutian
Wang, Lele
Meng, Yuan
He, Tiantian
He, Sifeng
Yang, Yousi
Wang, Liuyue
Tian, Jiading
Li, Dan
Yan, Ping
Gong, Mali
Liu, Qiang
Xiao, Qirong
All-fiber high-speed image detection enabled by deep learning
title All-fiber high-speed image detection enabled by deep learning
title_full All-fiber high-speed image detection enabled by deep learning
title_fullStr All-fiber high-speed image detection enabled by deep learning
title_full_unstemmed All-fiber high-speed image detection enabled by deep learning
title_short All-fiber high-speed image detection enabled by deep learning
title_sort all-fiber high-speed image detection enabled by deep learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8930987/
https://www.ncbi.nlm.nih.gov/pubmed/35301332
http://dx.doi.org/10.1038/s41467-022-29178-8
work_keys_str_mv AT liuzhoutian allfiberhighspeedimagedetectionenabledbydeeplearning
AT wanglele allfiberhighspeedimagedetectionenabledbydeeplearning
AT mengyuan allfiberhighspeedimagedetectionenabledbydeeplearning
AT hetiantian allfiberhighspeedimagedetectionenabledbydeeplearning
AT hesifeng allfiberhighspeedimagedetectionenabledbydeeplearning
AT yangyousi allfiberhighspeedimagedetectionenabledbydeeplearning
AT wangliuyue allfiberhighspeedimagedetectionenabledbydeeplearning
AT tianjiading allfiberhighspeedimagedetectionenabledbydeeplearning
AT lidan allfiberhighspeedimagedetectionenabledbydeeplearning
AT yanping allfiberhighspeedimagedetectionenabledbydeeplearning
AT gongmali allfiberhighspeedimagedetectionenabledbydeeplearning
AT liuqiang allfiberhighspeedimagedetectionenabledbydeeplearning
AT xiaoqirong allfiberhighspeedimagedetectionenabledbydeeplearning