Cargando…

Design and Testing of Augmented Reality-Based Fluorescence Imaging Goggle for Intraoperative Imaging-Guided Surgery

The different pathways between the position of a near-infrared camera and the user’s eye limit the use of existing near-infrared fluorescence imaging systems for tumor margin assessments. By utilizing an optical system that precisely matches the near-infrared fluorescence image and the optical path...

Descripción completa

Detalles Bibliográficos
Autores principales: Lee, Seung Hyun, Quan, Yu Hua, Kim, Min Sub, Kwon, Ki Hyeok, Choi, Byeong Hyeon, Kim, Hyun Koo, Kim, Beop-Min
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8224390/
https://www.ncbi.nlm.nih.gov/pubmed/34064205
http://dx.doi.org/10.3390/diagnostics11060927
_version_ 1783711880139767808
author Lee, Seung Hyun
Quan, Yu Hua
Kim, Min Sub
Kwon, Ki Hyeok
Choi, Byeong Hyeon
Kim, Hyun Koo
Kim, Beop-Min
author_facet Lee, Seung Hyun
Quan, Yu Hua
Kim, Min Sub
Kwon, Ki Hyeok
Choi, Byeong Hyeon
Kim, Hyun Koo
Kim, Beop-Min
author_sort Lee, Seung Hyun
collection PubMed
description The different pathways between the position of a near-infrared camera and the user’s eye limit the use of existing near-infrared fluorescence imaging systems for tumor margin assessments. By utilizing an optical system that precisely matches the near-infrared fluorescence image and the optical path of visible light, we developed an augmented reality (AR)-based fluorescence imaging system that provides users with a fluorescence image that matches the real-field, without requiring any additional algorithms. Commercial smart glasses, dichroic beam splitters, mirrors, and custom near-infrared cameras were employed to develop the proposed system, and each mount was designed and utilized. After its performance was assessed in the laboratory, preclinical experiments involving tumor detection and lung lobectomy in mice and rabbits by using indocyanine green (ICG) were conducted. The results showed that the proposed system provided a stable image of fluorescence that matched the actual site. In addition, preclinical experiments confirmed that the proposed system could be used to detect tumors using ICG and evaluate lung lobectomies. The AR-based intraoperative smart goggle system could detect fluorescence images for tumor margin assessments in animal models, without disrupting the surgical workflow in an operating room. Additionally, it was confirmed that, even when the system itself was distorted when worn, the fluorescence image consistently matched the actual site.
format Online
Article
Text
id pubmed-8224390
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-82243902021-06-25 Design and Testing of Augmented Reality-Based Fluorescence Imaging Goggle for Intraoperative Imaging-Guided Surgery Lee, Seung Hyun Quan, Yu Hua Kim, Min Sub Kwon, Ki Hyeok Choi, Byeong Hyeon Kim, Hyun Koo Kim, Beop-Min Diagnostics (Basel) Article The different pathways between the position of a near-infrared camera and the user’s eye limit the use of existing near-infrared fluorescence imaging systems for tumor margin assessments. By utilizing an optical system that precisely matches the near-infrared fluorescence image and the optical path of visible light, we developed an augmented reality (AR)-based fluorescence imaging system that provides users with a fluorescence image that matches the real-field, without requiring any additional algorithms. Commercial smart glasses, dichroic beam splitters, mirrors, and custom near-infrared cameras were employed to develop the proposed system, and each mount was designed and utilized. After its performance was assessed in the laboratory, preclinical experiments involving tumor detection and lung lobectomy in mice and rabbits by using indocyanine green (ICG) were conducted. The results showed that the proposed system provided a stable image of fluorescence that matched the actual site. In addition, preclinical experiments confirmed that the proposed system could be used to detect tumors using ICG and evaluate lung lobectomies. The AR-based intraoperative smart goggle system could detect fluorescence images for tumor margin assessments in animal models, without disrupting the surgical workflow in an operating room. Additionally, it was confirmed that, even when the system itself was distorted when worn, the fluorescence image consistently matched the actual site. MDPI 2021-05-21 /pmc/articles/PMC8224390/ /pubmed/34064205 http://dx.doi.org/10.3390/diagnostics11060927 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Lee, Seung Hyun
Quan, Yu Hua
Kim, Min Sub
Kwon, Ki Hyeok
Choi, Byeong Hyeon
Kim, Hyun Koo
Kim, Beop-Min
Design and Testing of Augmented Reality-Based Fluorescence Imaging Goggle for Intraoperative Imaging-Guided Surgery
title Design and Testing of Augmented Reality-Based Fluorescence Imaging Goggle for Intraoperative Imaging-Guided Surgery
title_full Design and Testing of Augmented Reality-Based Fluorescence Imaging Goggle for Intraoperative Imaging-Guided Surgery
title_fullStr Design and Testing of Augmented Reality-Based Fluorescence Imaging Goggle for Intraoperative Imaging-Guided Surgery
title_full_unstemmed Design and Testing of Augmented Reality-Based Fluorescence Imaging Goggle for Intraoperative Imaging-Guided Surgery
title_short Design and Testing of Augmented Reality-Based Fluorescence Imaging Goggle for Intraoperative Imaging-Guided Surgery
title_sort design and testing of augmented reality-based fluorescence imaging goggle for intraoperative imaging-guided surgery
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8224390/
https://www.ncbi.nlm.nih.gov/pubmed/34064205
http://dx.doi.org/10.3390/diagnostics11060927
work_keys_str_mv AT leeseunghyun designandtestingofaugmentedrealitybasedfluorescenceimaginggoggleforintraoperativeimagingguidedsurgery
AT quanyuhua designandtestingofaugmentedrealitybasedfluorescenceimaginggoggleforintraoperativeimagingguidedsurgery
AT kimminsub designandtestingofaugmentedrealitybasedfluorescenceimaginggoggleforintraoperativeimagingguidedsurgery
AT kwonkihyeok designandtestingofaugmentedrealitybasedfluorescenceimaginggoggleforintraoperativeimagingguidedsurgery
AT choibyeonghyeon designandtestingofaugmentedrealitybasedfluorescenceimaginggoggleforintraoperativeimagingguidedsurgery
AT kimhyunkoo designandtestingofaugmentedrealitybasedfluorescenceimaginggoggleforintraoperativeimagingguidedsurgery
AT kimbeopmin designandtestingofaugmentedrealitybasedfluorescenceimaginggoggleforintraoperativeimagingguidedsurgery