Cargando…

A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery

In the medical field, guidance to follow the surgical plan is crucial. Image overlay projection is a solution to link the surgical plan with the patient. It realizes augmented reality (AR) by projecting computer-generated image on the surface of the target through a projector, which can visualize ad...

Descripción completa

Detalles Bibliográficos
Autores principales: Gao, Yuan, Zhao, Yuyun, Xie, Le, Zheng, Guoyan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8122285/
https://www.ncbi.nlm.nih.gov/pubmed/33922079
http://dx.doi.org/10.3390/s21092931
_version_ 1783692579081027584
author Gao, Yuan
Zhao, Yuyun
Xie, Le
Zheng, Guoyan
author_facet Gao, Yuan
Zhao, Yuyun
Xie, Le
Zheng, Guoyan
author_sort Gao, Yuan
collection PubMed
description In the medical field, guidance to follow the surgical plan is crucial. Image overlay projection is a solution to link the surgical plan with the patient. It realizes augmented reality (AR) by projecting computer-generated image on the surface of the target through a projector, which can visualize additional information to the scene. By overlaying anatomical information or surgical plans on the surgery area, projection helps to enhance the surgeon’s understanding of the anatomical structure, and intuitively visualizes the surgical target and key structures of the operation, and avoid the surgeon’s sight diversion between monitor and patient. However, it still remains a challenge to project the surgical navigation information on the target precisely and efficiently. In this study, we propose a projector-based surgical navigation system. Through the gray code-based calibration method, the projector can be calibrated with a camera and then be integrated with an optical spatial locator, so that the navigation information of the operation can be accurately projected onto the target area. We validated the projection accuracy of the system through back projection, with average projection error of 3.37 pixels in x direction and 1.51 pixels in y direction, and model projection with an average position error of 1.03 ± 0.43 mm, and carried out puncture experiments using the system with correct rate of 99%, and qualitatively analyzed the system’s performance through the questionnaire. The results demonstrate the efficacy of our proposed AR system.
format Online
Article
Text
id pubmed-8122285
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-81222852021-05-16 A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery Gao, Yuan Zhao, Yuyun Xie, Le Zheng, Guoyan Sensors (Basel) Article In the medical field, guidance to follow the surgical plan is crucial. Image overlay projection is a solution to link the surgical plan with the patient. It realizes augmented reality (AR) by projecting computer-generated image on the surface of the target through a projector, which can visualize additional information to the scene. By overlaying anatomical information or surgical plans on the surgery area, projection helps to enhance the surgeon’s understanding of the anatomical structure, and intuitively visualizes the surgical target and key structures of the operation, and avoid the surgeon’s sight diversion between monitor and patient. However, it still remains a challenge to project the surgical navigation information on the target precisely and efficiently. In this study, we propose a projector-based surgical navigation system. Through the gray code-based calibration method, the projector can be calibrated with a camera and then be integrated with an optical spatial locator, so that the navigation information of the operation can be accurately projected onto the target area. We validated the projection accuracy of the system through back projection, with average projection error of 3.37 pixels in x direction and 1.51 pixels in y direction, and model projection with an average position error of 1.03 ± 0.43 mm, and carried out puncture experiments using the system with correct rate of 99%, and qualitatively analyzed the system’s performance through the questionnaire. The results demonstrate the efficacy of our proposed AR system. MDPI 2021-04-22 /pmc/articles/PMC8122285/ /pubmed/33922079 http://dx.doi.org/10.3390/s21092931 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Gao, Yuan
Zhao, Yuyun
Xie, Le
Zheng, Guoyan
A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery
title A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery
title_full A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery
title_fullStr A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery
title_full_unstemmed A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery
title_short A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery
title_sort projector-based augmented reality navigation system for computer-assisted surgery
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8122285/
https://www.ncbi.nlm.nih.gov/pubmed/33922079
http://dx.doi.org/10.3390/s21092931
work_keys_str_mv AT gaoyuan aprojectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery
AT zhaoyuyun aprojectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery
AT xiele aprojectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery
AT zhengguoyan aprojectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery
AT gaoyuan projectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery
AT zhaoyuyun projectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery
AT xiele projectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery
AT zhengguoyan projectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery