Cargando…

De-scattering Deep Neural Network Enables Fast Imaging of Spines through Scattering Media by Temporal Focusing Microscopy

Today the gold standard for in vivo imaging through scattering tissue is point-scanning two-photon microscopy (PSTPM). Especially in neuroscience, PSTPM is widely used for deep-tissue imaging in the brain. However, due to sequential scanning, PSTPM is slow. Temporal focusing microscopy (TFM), on the...

Descripción completa

Detalles Bibliográficos
Autores principales: Wei, Zhun, Boivin, Josiah R., Xue, Yi, Burnell, Kendyll, Wijethilake, Navodini, Chen, Xudong, So, Peter T. C., Nedivi, Elly, Wadduwage, Dushan N.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Journal Experts 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10275030/
https://www.ncbi.nlm.nih.gov/pubmed/37333305
http://dx.doi.org/10.21203/rs.3.rs-2410214/v1
_version_ 1785059827122176000
author Wei, Zhun
Boivin, Josiah R.
Xue, Yi
Burnell, Kendyll
Wijethilake, Navodini
Chen, Xudong
So, Peter T. C.
Nedivi, Elly
Wadduwage, Dushan N.
author_facet Wei, Zhun
Boivin, Josiah R.
Xue, Yi
Burnell, Kendyll
Wijethilake, Navodini
Chen, Xudong
So, Peter T. C.
Nedivi, Elly
Wadduwage, Dushan N.
author_sort Wei, Zhun
collection PubMed
description Today the gold standard for in vivo imaging through scattering tissue is point-scanning two-photon microscopy (PSTPM). Especially in neuroscience, PSTPM is widely used for deep-tissue imaging in the brain. However, due to sequential scanning, PSTPM is slow. Temporal focusing microscopy (TFM), on the other hand, focuses femtosecond pulsed laser light temporally while keeping wide-field illumination, and is consequently much faster. However, due to the use of a camera detector, TFM suffers from the scattering of emission photons. As a result, TFM produces images of poor quality, obscuring fluorescent signals from small structures such as dendritic spines. In this work, we present a de-scattering deep neural network (DeScatterNet) to improve the quality of TFM images. Using a 3D convolutional neural network (CNN) we build a map from TFM to PSTPM modalities, to enable fast TFM imaging while maintaining high image quality through scattering media. We demonstrate this approach for in vivo imaging of dendritic spines on pyramidal neurons in the mouse visual cortex. We quantitatively show that our trained network rapidly outputs images that recover biologically relevant features previously buried in the scattered fluorescence in the TFM images. In vivo imaging that combines TFM and the proposed neural network is one to two orders of magnitude faster than PSTPM but retains the high quality necessary to analyze small fluorescent structures. The proposed approach could also be beneficial for improving the performance of many speed-demanding deep-tissue imaging applications, such as in vivo voltage imaging.
format Online
Article
Text
id pubmed-10275030
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher American Journal Experts
record_format MEDLINE/PubMed
spelling pubmed-102750302023-06-17 De-scattering Deep Neural Network Enables Fast Imaging of Spines through Scattering Media by Temporal Focusing Microscopy Wei, Zhun Boivin, Josiah R. Xue, Yi Burnell, Kendyll Wijethilake, Navodini Chen, Xudong So, Peter T. C. Nedivi, Elly Wadduwage, Dushan N. Res Sq Article Today the gold standard for in vivo imaging through scattering tissue is point-scanning two-photon microscopy (PSTPM). Especially in neuroscience, PSTPM is widely used for deep-tissue imaging in the brain. However, due to sequential scanning, PSTPM is slow. Temporal focusing microscopy (TFM), on the other hand, focuses femtosecond pulsed laser light temporally while keeping wide-field illumination, and is consequently much faster. However, due to the use of a camera detector, TFM suffers from the scattering of emission photons. As a result, TFM produces images of poor quality, obscuring fluorescent signals from small structures such as dendritic spines. In this work, we present a de-scattering deep neural network (DeScatterNet) to improve the quality of TFM images. Using a 3D convolutional neural network (CNN) we build a map from TFM to PSTPM modalities, to enable fast TFM imaging while maintaining high image quality through scattering media. We demonstrate this approach for in vivo imaging of dendritic spines on pyramidal neurons in the mouse visual cortex. We quantitatively show that our trained network rapidly outputs images that recover biologically relevant features previously buried in the scattered fluorescence in the TFM images. In vivo imaging that combines TFM and the proposed neural network is one to two orders of magnitude faster than PSTPM but retains the high quality necessary to analyze small fluorescent structures. The proposed approach could also be beneficial for improving the performance of many speed-demanding deep-tissue imaging applications, such as in vivo voltage imaging. American Journal Experts 2023-06-08 /pmc/articles/PMC10275030/ /pubmed/37333305 http://dx.doi.org/10.21203/rs.3.rs-2410214/v1 Text en https://creativecommons.org/licenses/by/4.0/This work is licensed under a Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/) , which allows reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator. The license allows for commercial use.
spellingShingle Article
Wei, Zhun
Boivin, Josiah R.
Xue, Yi
Burnell, Kendyll
Wijethilake, Navodini
Chen, Xudong
So, Peter T. C.
Nedivi, Elly
Wadduwage, Dushan N.
De-scattering Deep Neural Network Enables Fast Imaging of Spines through Scattering Media by Temporal Focusing Microscopy
title De-scattering Deep Neural Network Enables Fast Imaging of Spines through Scattering Media by Temporal Focusing Microscopy
title_full De-scattering Deep Neural Network Enables Fast Imaging of Spines through Scattering Media by Temporal Focusing Microscopy
title_fullStr De-scattering Deep Neural Network Enables Fast Imaging of Spines through Scattering Media by Temporal Focusing Microscopy
title_full_unstemmed De-scattering Deep Neural Network Enables Fast Imaging of Spines through Scattering Media by Temporal Focusing Microscopy
title_short De-scattering Deep Neural Network Enables Fast Imaging of Spines through Scattering Media by Temporal Focusing Microscopy
title_sort de-scattering deep neural network enables fast imaging of spines through scattering media by temporal focusing microscopy
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10275030/
https://www.ncbi.nlm.nih.gov/pubmed/37333305
http://dx.doi.org/10.21203/rs.3.rs-2410214/v1
work_keys_str_mv AT weizhun descatteringdeepneuralnetworkenablesfastimagingofspinesthroughscatteringmediabytemporalfocusingmicroscopy
AT boivinjosiahr descatteringdeepneuralnetworkenablesfastimagingofspinesthroughscatteringmediabytemporalfocusingmicroscopy
AT xueyi descatteringdeepneuralnetworkenablesfastimagingofspinesthroughscatteringmediabytemporalfocusingmicroscopy
AT burnellkendyll descatteringdeepneuralnetworkenablesfastimagingofspinesthroughscatteringmediabytemporalfocusingmicroscopy
AT wijethilakenavodini descatteringdeepneuralnetworkenablesfastimagingofspinesthroughscatteringmediabytemporalfocusingmicroscopy
AT chenxudong descatteringdeepneuralnetworkenablesfastimagingofspinesthroughscatteringmediabytemporalfocusingmicroscopy
AT sopetertc descatteringdeepneuralnetworkenablesfastimagingofspinesthroughscatteringmediabytemporalfocusingmicroscopy
AT nedivielly descatteringdeepneuralnetworkenablesfastimagingofspinesthroughscatteringmediabytemporalfocusingmicroscopy
AT wadduwagedushann descatteringdeepneuralnetworkenablesfastimagingofspinesthroughscatteringmediabytemporalfocusingmicroscopy