Cargando…

Deep learning-driven adaptive optics for single-molecule localization microscopy

The inhomogeneous refractive indices of biological tissues blur and distort single-molecule emission patterns generating image artifacts and decreasing the achievable resolution of single-molecule localization microscopy (SMLM). Conventional sensorless adaptive optics methods rely on iterative mirro...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Peiyi, Ma, Donghan, Cheng, Xi, Tsai, Andy P., Tang, Yu, Gao, Hao-Cheng, Fang, Li, Bi, Cheng, Landreth, Gary E., Chubykin, Alexander A., Huang, Fang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group US 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10630144/
https://www.ncbi.nlm.nih.gov/pubmed/37770712
http://dx.doi.org/10.1038/s41592-023-02029-0
_version_ 1785132093844488192
author Zhang, Peiyi
Ma, Donghan
Cheng, Xi
Tsai, Andy P.
Tang, Yu
Gao, Hao-Cheng
Fang, Li
Bi, Cheng
Landreth, Gary E.
Chubykin, Alexander A.
Huang, Fang
author_facet Zhang, Peiyi
Ma, Donghan
Cheng, Xi
Tsai, Andy P.
Tang, Yu
Gao, Hao-Cheng
Fang, Li
Bi, Cheng
Landreth, Gary E.
Chubykin, Alexander A.
Huang, Fang
author_sort Zhang, Peiyi
collection PubMed
description The inhomogeneous refractive indices of biological tissues blur and distort single-molecule emission patterns generating image artifacts and decreasing the achievable resolution of single-molecule localization microscopy (SMLM). Conventional sensorless adaptive optics methods rely on iterative mirror changes and image-quality metrics. However, these metrics result in inconsistent metric responses and thus fundamentally limit their efficacy for aberration correction in tissues. To bypass iterative trial-then-evaluate processes, we developed deep learning-driven adaptive optics for SMLM to allow direct inference of wavefront distortion and near real-time compensation. Our trained deep neural network monitors the individual emission patterns from single-molecule experiments, infers their shared wavefront distortion, feeds the estimates through a dynamic filter and drives a deformable mirror to compensate sample-induced aberrations. We demonstrated that our method simultaneously estimates and compensates 28 wavefront deformation shapes and improves the resolution and fidelity of three-dimensional SMLM through >130-µm-thick brain tissue specimens.
format Online
Article
Text
id pubmed-10630144
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group US
record_format MEDLINE/PubMed
spelling pubmed-106301442023-11-09 Deep learning-driven adaptive optics for single-molecule localization microscopy Zhang, Peiyi Ma, Donghan Cheng, Xi Tsai, Andy P. Tang, Yu Gao, Hao-Cheng Fang, Li Bi, Cheng Landreth, Gary E. Chubykin, Alexander A. Huang, Fang Nat Methods Article The inhomogeneous refractive indices of biological tissues blur and distort single-molecule emission patterns generating image artifacts and decreasing the achievable resolution of single-molecule localization microscopy (SMLM). Conventional sensorless adaptive optics methods rely on iterative mirror changes and image-quality metrics. However, these metrics result in inconsistent metric responses and thus fundamentally limit their efficacy for aberration correction in tissues. To bypass iterative trial-then-evaluate processes, we developed deep learning-driven adaptive optics for SMLM to allow direct inference of wavefront distortion and near real-time compensation. Our trained deep neural network monitors the individual emission patterns from single-molecule experiments, infers their shared wavefront distortion, feeds the estimates through a dynamic filter and drives a deformable mirror to compensate sample-induced aberrations. We demonstrated that our method simultaneously estimates and compensates 28 wavefront deformation shapes and improves the resolution and fidelity of three-dimensional SMLM through >130-µm-thick brain tissue specimens. Nature Publishing Group US 2023-09-28 2023 /pmc/articles/PMC10630144/ /pubmed/37770712 http://dx.doi.org/10.1038/s41592-023-02029-0 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Zhang, Peiyi
Ma, Donghan
Cheng, Xi
Tsai, Andy P.
Tang, Yu
Gao, Hao-Cheng
Fang, Li
Bi, Cheng
Landreth, Gary E.
Chubykin, Alexander A.
Huang, Fang
Deep learning-driven adaptive optics for single-molecule localization microscopy
title Deep learning-driven adaptive optics for single-molecule localization microscopy
title_full Deep learning-driven adaptive optics for single-molecule localization microscopy
title_fullStr Deep learning-driven adaptive optics for single-molecule localization microscopy
title_full_unstemmed Deep learning-driven adaptive optics for single-molecule localization microscopy
title_short Deep learning-driven adaptive optics for single-molecule localization microscopy
title_sort deep learning-driven adaptive optics for single-molecule localization microscopy
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10630144/
https://www.ncbi.nlm.nih.gov/pubmed/37770712
http://dx.doi.org/10.1038/s41592-023-02029-0
work_keys_str_mv AT zhangpeiyi deeplearningdrivenadaptiveopticsforsinglemoleculelocalizationmicroscopy
AT madonghan deeplearningdrivenadaptiveopticsforsinglemoleculelocalizationmicroscopy
AT chengxi deeplearningdrivenadaptiveopticsforsinglemoleculelocalizationmicroscopy
AT tsaiandyp deeplearningdrivenadaptiveopticsforsinglemoleculelocalizationmicroscopy
AT tangyu deeplearningdrivenadaptiveopticsforsinglemoleculelocalizationmicroscopy
AT gaohaocheng deeplearningdrivenadaptiveopticsforsinglemoleculelocalizationmicroscopy
AT fangli deeplearningdrivenadaptiveopticsforsinglemoleculelocalizationmicroscopy
AT bicheng deeplearningdrivenadaptiveopticsforsinglemoleculelocalizationmicroscopy
AT landrethgarye deeplearningdrivenadaptiveopticsforsinglemoleculelocalizationmicroscopy
AT chubykinalexandera deeplearningdrivenadaptiveopticsforsinglemoleculelocalizationmicroscopy
AT huangfang deeplearningdrivenadaptiveopticsforsinglemoleculelocalizationmicroscopy