Cargando…

Deep learning alignment of bidirectional raster scanning in high speed photoacoustic microscopy

Simultaneous point-by-point raster scanning of optical and acoustic beams has been widely adapted to high-speed photoacoustic microscopy (PAM) using a water-immersible microelectromechanical system or galvanometer scanner. However, when using high-speed water-immersible scanners, the two consecutive...

Descripción completa

Detalles Bibliográficos
Autores principales: Kim, Jongbeom, Lee, Dongyoon, Lim, Hyokyung, Yang, Hyekyeong, Kim, Jaewoo, Kim, Jeesu, Kim, Yeonggeun, Kim, Hyung Ham, Kim, Chulhong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9519743/
https://www.ncbi.nlm.nih.gov/pubmed/36171249
http://dx.doi.org/10.1038/s41598-022-20378-2
_version_ 1784799468896387072
author Kim, Jongbeom
Lee, Dongyoon
Lim, Hyokyung
Yang, Hyekyeong
Kim, Jaewoo
Kim, Jeesu
Kim, Yeonggeun
Kim, Hyung Ham
Kim, Chulhong
author_facet Kim, Jongbeom
Lee, Dongyoon
Lim, Hyokyung
Yang, Hyekyeong
Kim, Jaewoo
Kim, Jeesu
Kim, Yeonggeun
Kim, Hyung Ham
Kim, Chulhong
author_sort Kim, Jongbeom
collection PubMed
description Simultaneous point-by-point raster scanning of optical and acoustic beams has been widely adapted to high-speed photoacoustic microscopy (PAM) using a water-immersible microelectromechanical system or galvanometer scanner. However, when using high-speed water-immersible scanners, the two consecutively acquired bidirectional PAM images are misaligned with each other because of unstable performance, which causes a non-uniform time interval between scanning points. Therefore, only one unidirectionally acquired image is typically used; consequently, the imaging speed is reduced by half. Here, we demonstrate a scanning framework based on a deep neural network (DNN) to correct misaligned PAM images acquired via bidirectional raster scanning. The proposed method doubles the imaging speed compared to that of conventional methods by aligning nonlinear mismatched cross-sectional B-scan photoacoustic images during bidirectional raster scanning. Our DNN-assisted raster scanning framework can further potentially be applied to other raster scanning-based biomedical imaging tools, such as optical coherence tomography, ultrasound microscopy, and confocal microscopy.
format Online
Article
Text
id pubmed-9519743
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-95197432022-09-30 Deep learning alignment of bidirectional raster scanning in high speed photoacoustic microscopy Kim, Jongbeom Lee, Dongyoon Lim, Hyokyung Yang, Hyekyeong Kim, Jaewoo Kim, Jeesu Kim, Yeonggeun Kim, Hyung Ham Kim, Chulhong Sci Rep Article Simultaneous point-by-point raster scanning of optical and acoustic beams has been widely adapted to high-speed photoacoustic microscopy (PAM) using a water-immersible microelectromechanical system or galvanometer scanner. However, when using high-speed water-immersible scanners, the two consecutively acquired bidirectional PAM images are misaligned with each other because of unstable performance, which causes a non-uniform time interval between scanning points. Therefore, only one unidirectionally acquired image is typically used; consequently, the imaging speed is reduced by half. Here, we demonstrate a scanning framework based on a deep neural network (DNN) to correct misaligned PAM images acquired via bidirectional raster scanning. The proposed method doubles the imaging speed compared to that of conventional methods by aligning nonlinear mismatched cross-sectional B-scan photoacoustic images during bidirectional raster scanning. Our DNN-assisted raster scanning framework can further potentially be applied to other raster scanning-based biomedical imaging tools, such as optical coherence tomography, ultrasound microscopy, and confocal microscopy. Nature Publishing Group UK 2022-09-28 /pmc/articles/PMC9519743/ /pubmed/36171249 http://dx.doi.org/10.1038/s41598-022-20378-2 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Kim, Jongbeom
Lee, Dongyoon
Lim, Hyokyung
Yang, Hyekyeong
Kim, Jaewoo
Kim, Jeesu
Kim, Yeonggeun
Kim, Hyung Ham
Kim, Chulhong
Deep learning alignment of bidirectional raster scanning in high speed photoacoustic microscopy
title Deep learning alignment of bidirectional raster scanning in high speed photoacoustic microscopy
title_full Deep learning alignment of bidirectional raster scanning in high speed photoacoustic microscopy
title_fullStr Deep learning alignment of bidirectional raster scanning in high speed photoacoustic microscopy
title_full_unstemmed Deep learning alignment of bidirectional raster scanning in high speed photoacoustic microscopy
title_short Deep learning alignment of bidirectional raster scanning in high speed photoacoustic microscopy
title_sort deep learning alignment of bidirectional raster scanning in high speed photoacoustic microscopy
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9519743/
https://www.ncbi.nlm.nih.gov/pubmed/36171249
http://dx.doi.org/10.1038/s41598-022-20378-2
work_keys_str_mv AT kimjongbeom deeplearningalignmentofbidirectionalrasterscanninginhighspeedphotoacousticmicroscopy
AT leedongyoon deeplearningalignmentofbidirectionalrasterscanninginhighspeedphotoacousticmicroscopy
AT limhyokyung deeplearningalignmentofbidirectionalrasterscanninginhighspeedphotoacousticmicroscopy
AT yanghyekyeong deeplearningalignmentofbidirectionalrasterscanninginhighspeedphotoacousticmicroscopy
AT kimjaewoo deeplearningalignmentofbidirectionalrasterscanninginhighspeedphotoacousticmicroscopy
AT kimjeesu deeplearningalignmentofbidirectionalrasterscanninginhighspeedphotoacousticmicroscopy
AT kimyeonggeun deeplearningalignmentofbidirectionalrasterscanninginhighspeedphotoacousticmicroscopy
AT kimhyungham deeplearningalignmentofbidirectionalrasterscanninginhighspeedphotoacousticmicroscopy
AT kimchulhong deeplearningalignmentofbidirectionalrasterscanninginhighspeedphotoacousticmicroscopy