Cargando…

Deep Learning–Assisted Multiphoton Microscopy to Reduce Light Exposure and Expedite Imaging in Tissues With High and Low Light Sensitivity

PURPOSE: Two-photon excitation fluorescence (2PEF) reveals information about tissue function. Concerns for phototoxicity demand lower light exposure during imaging. Reducing excitation light reduces the quality of the image by limiting fluorescence emission. We applied deep learning (DL) super-resol...

Descripción completa

Detalles Bibliográficos
Autores principales: McAleer, Stephen, Fast, Alexander, Xue, Yuntian, Seiler, Magdalene J., Tang, William C., Balu, Mihaela, Baldi, Pierre, Browne, Andrew W.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Association for Research in Vision and Ophthalmology 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8543395/
https://www.ncbi.nlm.nih.gov/pubmed/34668935
http://dx.doi.org/10.1167/tvst.10.12.30
_version_ 1784589625973538816
author McAleer, Stephen
Fast, Alexander
Xue, Yuntian
Seiler, Magdalene J.
Tang, William C.
Balu, Mihaela
Baldi, Pierre
Browne, Andrew W.
author_facet McAleer, Stephen
Fast, Alexander
Xue, Yuntian
Seiler, Magdalene J.
Tang, William C.
Balu, Mihaela
Baldi, Pierre
Browne, Andrew W.
author_sort McAleer, Stephen
collection PubMed
description PURPOSE: Two-photon excitation fluorescence (2PEF) reveals information about tissue function. Concerns for phototoxicity demand lower light exposure during imaging. Reducing excitation light reduces the quality of the image by limiting fluorescence emission. We applied deep learning (DL) super-resolution techniques to images acquired from low light exposure to yield high-resolution images of retinal and skin tissues. METHODS: We analyzed two methods: a method based on U-Net and a patch-based regression method using paired images of skin (550) and retina (1200), each with low- and high-resolution paired images. The retina dataset was acquired at low and high laser powers from retinal organoids, and the skin dataset was obtained from averaging 7 to 15 frames or 70 frames. Mean squared error (MSE) and the structural similarity index measure (SSIM) were outcome measures for DL algorithm performance. RESULTS: For the skin dataset, the patches method achieved a lower MSE (3.768) compared with U-Net (4.032) and a high SSIM (0.824) compared with U-Net (0.783). For the retinal dataset, the patches method achieved an average MSE of 27,611 compared with 146,855 for the U-Net method and an average SSIM of 0.636 compared with 0.607 for the U-Net method. The patches method was slower (303 seconds) than the U-Net method (<1 second). CONCLUSIONS: DL can reduce excitation light exposure in 2PEF imaging while preserving image quality metrics. TRANSLATIONAL RELEVANCE: DL methods will aid in translating 2PEF imaging from benchtop systems to in vivo imaging of light-sensitive tissues such as the retina.
format Online
Article
Text
id pubmed-8543395
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher The Association for Research in Vision and Ophthalmology
record_format MEDLINE/PubMed
spelling pubmed-85433952021-10-29 Deep Learning–Assisted Multiphoton Microscopy to Reduce Light Exposure and Expedite Imaging in Tissues With High and Low Light Sensitivity McAleer, Stephen Fast, Alexander Xue, Yuntian Seiler, Magdalene J. Tang, William C. Balu, Mihaela Baldi, Pierre Browne, Andrew W. Transl Vis Sci Technol Article PURPOSE: Two-photon excitation fluorescence (2PEF) reveals information about tissue function. Concerns for phototoxicity demand lower light exposure during imaging. Reducing excitation light reduces the quality of the image by limiting fluorescence emission. We applied deep learning (DL) super-resolution techniques to images acquired from low light exposure to yield high-resolution images of retinal and skin tissues. METHODS: We analyzed two methods: a method based on U-Net and a patch-based regression method using paired images of skin (550) and retina (1200), each with low- and high-resolution paired images. The retina dataset was acquired at low and high laser powers from retinal organoids, and the skin dataset was obtained from averaging 7 to 15 frames or 70 frames. Mean squared error (MSE) and the structural similarity index measure (SSIM) were outcome measures for DL algorithm performance. RESULTS: For the skin dataset, the patches method achieved a lower MSE (3.768) compared with U-Net (4.032) and a high SSIM (0.824) compared with U-Net (0.783). For the retinal dataset, the patches method achieved an average MSE of 27,611 compared with 146,855 for the U-Net method and an average SSIM of 0.636 compared with 0.607 for the U-Net method. The patches method was slower (303 seconds) than the U-Net method (<1 second). CONCLUSIONS: DL can reduce excitation light exposure in 2PEF imaging while preserving image quality metrics. TRANSLATIONAL RELEVANCE: DL methods will aid in translating 2PEF imaging from benchtop systems to in vivo imaging of light-sensitive tissues such as the retina. The Association for Research in Vision and Ophthalmology 2021-10-20 /pmc/articles/PMC8543395/ /pubmed/34668935 http://dx.doi.org/10.1167/tvst.10.12.30 Text en Copyright 2021 The Authors https://creativecommons.org/licenses/by-nc-nd/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
spellingShingle Article
McAleer, Stephen
Fast, Alexander
Xue, Yuntian
Seiler, Magdalene J.
Tang, William C.
Balu, Mihaela
Baldi, Pierre
Browne, Andrew W.
Deep Learning–Assisted Multiphoton Microscopy to Reduce Light Exposure and Expedite Imaging in Tissues With High and Low Light Sensitivity
title Deep Learning–Assisted Multiphoton Microscopy to Reduce Light Exposure and Expedite Imaging in Tissues With High and Low Light Sensitivity
title_full Deep Learning–Assisted Multiphoton Microscopy to Reduce Light Exposure and Expedite Imaging in Tissues With High and Low Light Sensitivity
title_fullStr Deep Learning–Assisted Multiphoton Microscopy to Reduce Light Exposure and Expedite Imaging in Tissues With High and Low Light Sensitivity
title_full_unstemmed Deep Learning–Assisted Multiphoton Microscopy to Reduce Light Exposure and Expedite Imaging in Tissues With High and Low Light Sensitivity
title_short Deep Learning–Assisted Multiphoton Microscopy to Reduce Light Exposure and Expedite Imaging in Tissues With High and Low Light Sensitivity
title_sort deep learning–assisted multiphoton microscopy to reduce light exposure and expedite imaging in tissues with high and low light sensitivity
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8543395/
https://www.ncbi.nlm.nih.gov/pubmed/34668935
http://dx.doi.org/10.1167/tvst.10.12.30
work_keys_str_mv AT mcaleerstephen deeplearningassistedmultiphotonmicroscopytoreducelightexposureandexpediteimagingintissueswithhighandlowlightsensitivity
AT fastalexander deeplearningassistedmultiphotonmicroscopytoreducelightexposureandexpediteimagingintissueswithhighandlowlightsensitivity
AT xueyuntian deeplearningassistedmultiphotonmicroscopytoreducelightexposureandexpediteimagingintissueswithhighandlowlightsensitivity
AT seilermagdalenej deeplearningassistedmultiphotonmicroscopytoreducelightexposureandexpediteimagingintissueswithhighandlowlightsensitivity
AT tangwilliamc deeplearningassistedmultiphotonmicroscopytoreducelightexposureandexpediteimagingintissueswithhighandlowlightsensitivity
AT balumihaela deeplearningassistedmultiphotonmicroscopytoreducelightexposureandexpediteimagingintissueswithhighandlowlightsensitivity
AT baldipierre deeplearningassistedmultiphotonmicroscopytoreducelightexposureandexpediteimagingintissueswithhighandlowlightsensitivity
AT browneandreww deeplearningassistedmultiphotonmicroscopytoreducelightexposureandexpediteimagingintissueswithhighandlowlightsensitivity