Cargando…
Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data
Optical coherence tomography (OCT) is a widely used non-invasive biomedical imaging modality that can rapidly provide volumetric images of samples. Here, we present a deep learning-based image reconstruction framework that can generate swept-source OCT (SS-OCT) images using undersampled spectral dat...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8322159/ https://www.ncbi.nlm.nih.gov/pubmed/34326306 http://dx.doi.org/10.1038/s41377-021-00594-7 |
_version_ | 1783730992867966976 |
---|---|
author | Zhang, Yijie Liu, Tairan Singh, Manmohan Çetintaş, Ege Luo, Yilin Rivenson, Yair Larin, Kirill V. Ozcan, Aydogan |
author_facet | Zhang, Yijie Liu, Tairan Singh, Manmohan Çetintaş, Ege Luo, Yilin Rivenson, Yair Larin, Kirill V. Ozcan, Aydogan |
author_sort | Zhang, Yijie |
collection | PubMed |
description | Optical coherence tomography (OCT) is a widely used non-invasive biomedical imaging modality that can rapidly provide volumetric images of samples. Here, we present a deep learning-based image reconstruction framework that can generate swept-source OCT (SS-OCT) images using undersampled spectral data, without any spatial aliasing artifacts. This neural network-based image reconstruction does not require any hardware changes to the optical setup and can be easily integrated with existing swept-source or spectral-domain OCT systems to reduce the amount of raw spectral data to be acquired. To show the efficacy of this framework, we trained and blindly tested a deep neural network using mouse embryo samples imaged by an SS-OCT system. Using 2-fold undersampled spectral data (i.e., 640 spectral points per A-line), the trained neural network can blindly reconstruct 512 A-lines in 0.59 ms using multiple graphics-processing units (GPUs), removing spatial aliasing artifacts due to spectral undersampling, also presenting a very good match to the images of the same samples, reconstructed using the full spectral OCT data (i.e., 1280 spectral points per A-line). We also successfully demonstrate that this framework can be further extended to process 3× undersampled spectral data per A-line, with some performance degradation in the reconstructed image quality compared to 2× spectral undersampling. Furthermore, an A-line-optimized undersampling method is presented by jointly optimizing the spectral sampling locations and the corresponding image reconstruction network, which improved the overall imaging performance using less spectral data points per A-line compared to 2× or 3× spectral undersampling results. This deep learning-enabled image reconstruction approach can be broadly used in various forms of spectral-domain OCT systems, helping to increase their imaging speed without sacrificing image resolution and signal-to-noise ratio. |
format | Online Article Text |
id | pubmed-8322159 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-83221592021-08-02 Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data Zhang, Yijie Liu, Tairan Singh, Manmohan Çetintaş, Ege Luo, Yilin Rivenson, Yair Larin, Kirill V. Ozcan, Aydogan Light Sci Appl Article Optical coherence tomography (OCT) is a widely used non-invasive biomedical imaging modality that can rapidly provide volumetric images of samples. Here, we present a deep learning-based image reconstruction framework that can generate swept-source OCT (SS-OCT) images using undersampled spectral data, without any spatial aliasing artifacts. This neural network-based image reconstruction does not require any hardware changes to the optical setup and can be easily integrated with existing swept-source or spectral-domain OCT systems to reduce the amount of raw spectral data to be acquired. To show the efficacy of this framework, we trained and blindly tested a deep neural network using mouse embryo samples imaged by an SS-OCT system. Using 2-fold undersampled spectral data (i.e., 640 spectral points per A-line), the trained neural network can blindly reconstruct 512 A-lines in 0.59 ms using multiple graphics-processing units (GPUs), removing spatial aliasing artifacts due to spectral undersampling, also presenting a very good match to the images of the same samples, reconstructed using the full spectral OCT data (i.e., 1280 spectral points per A-line). We also successfully demonstrate that this framework can be further extended to process 3× undersampled spectral data per A-line, with some performance degradation in the reconstructed image quality compared to 2× spectral undersampling. Furthermore, an A-line-optimized undersampling method is presented by jointly optimizing the spectral sampling locations and the corresponding image reconstruction network, which improved the overall imaging performance using less spectral data points per A-line compared to 2× or 3× spectral undersampling results. This deep learning-enabled image reconstruction approach can be broadly used in various forms of spectral-domain OCT systems, helping to increase their imaging speed without sacrificing image resolution and signal-to-noise ratio. Nature Publishing Group UK 2021-07-29 /pmc/articles/PMC8322159/ /pubmed/34326306 http://dx.doi.org/10.1038/s41377-021-00594-7 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Zhang, Yijie Liu, Tairan Singh, Manmohan Çetintaş, Ege Luo, Yilin Rivenson, Yair Larin, Kirill V. Ozcan, Aydogan Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data |
title | Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data |
title_full | Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data |
title_fullStr | Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data |
title_full_unstemmed | Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data |
title_short | Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data |
title_sort | neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8322159/ https://www.ncbi.nlm.nih.gov/pubmed/34326306 http://dx.doi.org/10.1038/s41377-021-00594-7 |
work_keys_str_mv | AT zhangyijie neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata AT liutairan neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata AT singhmanmohan neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata AT cetintasege neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata AT luoyilin neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata AT rivensonyair neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata AT larinkirillv neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata AT ozcanaydogan neuralnetworkbasedimagereconstructioninsweptsourceopticalcoherencetomographyusingundersampledspectraldata |