Cargando…

Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data

Optical coherence tomography (OCT) is a widely used non-invasive biomedical imaging modality that can rapidly provide volumetric images of samples. Here, we present a deep learning-based image reconstruction framework that can generate swept-source OCT (SS-OCT) images using undersampled spectral dat...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Yijie, Liu, Tairan, Singh, Manmohan, Çetintaş, Ege, Luo, Yilin, Rivenson, Yair, Larin, Kirill V., Ozcan, Aydogan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8322159/
https://www.ncbi.nlm.nih.gov/pubmed/34326306
http://dx.doi.org/10.1038/s41377-021-00594-7
_version_ 1783730992867966976
author Zhang, Yijie
Liu, Tairan
Singh, Manmohan
Çetintaş, Ege
Luo, Yilin
Rivenson, Yair
Larin, Kirill V.
Ozcan, Aydogan
author_facet Zhang, Yijie
Liu, Tairan
Singh, Manmohan
Çetintaş, Ege
Luo, Yilin
Rivenson, Yair
Larin, Kirill V.
Ozcan, Aydogan
author_sort Zhang, Yijie
collection PubMed
description Optical coherence tomography (OCT) is a widely used non-invasive biomedical imaging modality that can rapidly provide volumetric images of samples. Here, we present a deep learning-based image reconstruction framework that can generate swept-source OCT (SS-OCT) images using undersampled spectral data, without any spatial aliasing artifacts. This neural network-based image reconstruction does not require any hardware changes to the optical setup and can be easily integrated with existing swept-source or spectral-domain OCT systems to reduce the amount of raw spectral data to be acquired. To show the efficacy of this framework, we trained and blindly tested a deep neural network using mouse embryo samples imaged by an SS-OCT system. Using 2-fold undersampled spectral data (i.e., 640 spectral points per A-line), the trained neural network can blindly reconstruct 512 A-lines in 0.59 ms using multiple graphics-processing units (GPUs), removing spatial aliasing artifacts due to spectral undersampling, also presenting a very good match to the images of the same samples, reconstructed using the full spectral OCT data (i.e., 1280 spectral points per A-line). We also successfully demonstrate that this framework can be further extended to process 3× undersampled spectral data per A-line, with some performance degradation in the reconstructed image quality compared to 2× spectral undersampling. Furthermore, an A-line-optimized undersampling method is presented by jointly optimizing the spectral sampling locations and the corresponding image reconstruction network, which improved the overall imaging performance using less spectral data points per A-line compared to 2× or 3× spectral undersampling results. This deep learning-enabled image reconstruction approach can be broadly used in various forms of spectral-domain OCT systems, helping to increase their imaging speed without sacrificing image resolution and signal-to-noise ratio.
format Online
Article
Text
id pubmed-8322159
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-83221592021-08-02 Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data Zhang, Yijie Liu, Tairan Singh, Manmohan Çetintaş, Ege Luo, Yilin Rivenson, Yair Larin, Kirill V. Ozcan, Aydogan Light Sci Appl Article Optical coherence tomography (OCT) is a widely used non-invasive biomedical imaging modality that can rapidly provide volumetric images of samples. Here, we present a deep learning-based image reconstruction framework that can generate swept-source OCT (SS-OCT) images using undersampled spectral data, without any spatial aliasing artifacts. This neural network-based image reconstruction does not require any hardware changes to the optical setup and can be easily integrated with existing swept-source or spectral-domain OCT systems to reduce the amount of raw spectral data to be acquired. To show the efficacy of this framework, we trained and blindly tested a deep neural network using mouse embryo samples imaged by an SS-OCT system. Using 2-fold undersampled spectral data (i.e., 640 spectral points per A-line), the trained neural network can blindly reconstruct 512 A-lines in 0.59 ms using multiple graphics-processing units (GPUs), removing spatial aliasing artifacts due to spectral undersampling, also presenting a very good match to the images of the same samples, reconstructed using the full spectral OCT data (i.e., 1280 spectral points per A-line). We also successfully demonstrate that this framework can be further extended to process 3× undersampled spectral data per A-line, with some performance degradation in the reconstructed image quality compared to 2× spectral undersampling. Furthermore, an A-line-optimized undersampling method is presented by jointly optimizing the spectral sampling locations and the corresponding image reconstruction network, which improved the overall imaging performance using less spectral data points per A-line compared to 2× or 3× spectral undersampling results. This deep learning-enabled image reconstruction approach can be broadly used in various forms of spectral-domain OCT systems, helping to increase their imaging speed without sacrificing image resolution and signal-to-noise ratio. Nature Publishing Group UK 2021-07-29 /pmc/articles/PMC8322159/ /pubmed/34326306 http://dx.doi.org/10.1038/s41377-021-00594-7 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Zhang, Yijie
Liu, Tairan
Singh, Manmohan
Çetintaş, Ege
Luo, Yilin
Rivenson, Yair
Larin, Kirill V.
Ozcan, Aydogan
Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data
title Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data
title_full Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data
title_fullStr Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data
title_full_unstemmed Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data
title_short Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data
title_sort neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8322159/
https://www.ncbi.nlm.nih.gov/pubmed/34326306
http://dx.doi.org/10.1038/s41377-021-00594-7
work_keys_str_mv AT zhangyijie neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata
AT liutairan neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata
AT singhmanmohan neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata
AT cetintasege neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata
AT luoyilin neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata
AT rivensonyair neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata
AT larinkirillv neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata
AT ozcanaydogan neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata