Cargando…

Deep-learning-assisted Fourier transform imaging spectroscopy for hyperspectral fluorescence imaging

Hyperspectral fluorescence imaging is widely used when multiple fluorescent probes with close emission peaks are required. In particular, Fourier transform imaging spectroscopy (FTIS) provides unrivaled spectral resolution; however, the imaging throughput is very low due to the amount of interferogr...

Descripción completa

Detalles Bibliográficos
Autores principales: Juntunen, Cory, Woller, Isabel M., Abramczyk, Andrew R., Sung, Yongjin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8847646/
https://www.ncbi.nlm.nih.gov/pubmed/35169167
http://dx.doi.org/10.1038/s41598-022-06360-y
_version_ 1784652089714016256
author Juntunen, Cory
Woller, Isabel M.
Abramczyk, Andrew R.
Sung, Yongjin
author_facet Juntunen, Cory
Woller, Isabel M.
Abramczyk, Andrew R.
Sung, Yongjin
author_sort Juntunen, Cory
collection PubMed
description Hyperspectral fluorescence imaging is widely used when multiple fluorescent probes with close emission peaks are required. In particular, Fourier transform imaging spectroscopy (FTIS) provides unrivaled spectral resolution; however, the imaging throughput is very low due to the amount of interferogram sampling required. In this work, we apply deep learning to FTIS and show that the interferogram sampling can be drastically reduced by an order of magnitude without noticeable degradation in the image quality. For the demonstration, we use bovine pulmonary artery endothelial cells stained with three fluorescent dyes and 10 types of fluorescent beads with close emission peaks. Further, we show that the deep learning approach is more robust to the translation stage error and environmental vibrations. Thereby, the He-Ne correction, which is typically required for FTIS, can be bypassed, thus reducing the cost, size, and complexity of the FTIS system. Finally, we construct neural network models using Hyperband, an automatic hyperparameter selection algorithm, and compare the performance with our manually-optimized model.
format Online
Article
Text
id pubmed-8847646
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-88476462022-02-17 Deep-learning-assisted Fourier transform imaging spectroscopy for hyperspectral fluorescence imaging Juntunen, Cory Woller, Isabel M. Abramczyk, Andrew R. Sung, Yongjin Sci Rep Article Hyperspectral fluorescence imaging is widely used when multiple fluorescent probes with close emission peaks are required. In particular, Fourier transform imaging spectroscopy (FTIS) provides unrivaled spectral resolution; however, the imaging throughput is very low due to the amount of interferogram sampling required. In this work, we apply deep learning to FTIS and show that the interferogram sampling can be drastically reduced by an order of magnitude without noticeable degradation in the image quality. For the demonstration, we use bovine pulmonary artery endothelial cells stained with three fluorescent dyes and 10 types of fluorescent beads with close emission peaks. Further, we show that the deep learning approach is more robust to the translation stage error and environmental vibrations. Thereby, the He-Ne correction, which is typically required for FTIS, can be bypassed, thus reducing the cost, size, and complexity of the FTIS system. Finally, we construct neural network models using Hyperband, an automatic hyperparameter selection algorithm, and compare the performance with our manually-optimized model. Nature Publishing Group UK 2022-02-15 /pmc/articles/PMC8847646/ /pubmed/35169167 http://dx.doi.org/10.1038/s41598-022-06360-y Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Juntunen, Cory
Woller, Isabel M.
Abramczyk, Andrew R.
Sung, Yongjin
Deep-learning-assisted Fourier transform imaging spectroscopy for hyperspectral fluorescence imaging
title Deep-learning-assisted Fourier transform imaging spectroscopy for hyperspectral fluorescence imaging
title_full Deep-learning-assisted Fourier transform imaging spectroscopy for hyperspectral fluorescence imaging
title_fullStr Deep-learning-assisted Fourier transform imaging spectroscopy for hyperspectral fluorescence imaging
title_full_unstemmed Deep-learning-assisted Fourier transform imaging spectroscopy for hyperspectral fluorescence imaging
title_short Deep-learning-assisted Fourier transform imaging spectroscopy for hyperspectral fluorescence imaging
title_sort deep-learning-assisted fourier transform imaging spectroscopy for hyperspectral fluorescence imaging
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8847646/
https://www.ncbi.nlm.nih.gov/pubmed/35169167
http://dx.doi.org/10.1038/s41598-022-06360-y
work_keys_str_mv AT juntunencory deeplearningassistedfouriertransformimagingspectroscopyforhyperspectralfluorescenceimaging
AT wollerisabelm deeplearningassistedfouriertransformimagingspectroscopyforhyperspectralfluorescenceimaging
AT abramczykandrewr deeplearningassistedfouriertransformimagingspectroscopyforhyperspectralfluorescenceimaging
AT sungyongjin deeplearningassistedfouriertransformimagingspectroscopyforhyperspectralfluorescenceimaging