Cargando…
A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery
In the medical field, guidance to follow the surgical plan is crucial. Image overlay projection is a solution to link the surgical plan with the patient. It realizes augmented reality (AR) by projecting computer-generated image on the surface of the target through a projector, which can visualize ad...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8122285/ https://www.ncbi.nlm.nih.gov/pubmed/33922079 http://dx.doi.org/10.3390/s21092931 |
_version_ | 1783692579081027584 |
---|---|
author | Gao, Yuan Zhao, Yuyun Xie, Le Zheng, Guoyan |
author_facet | Gao, Yuan Zhao, Yuyun Xie, Le Zheng, Guoyan |
author_sort | Gao, Yuan |
collection | PubMed |
description | In the medical field, guidance to follow the surgical plan is crucial. Image overlay projection is a solution to link the surgical plan with the patient. It realizes augmented reality (AR) by projecting computer-generated image on the surface of the target through a projector, which can visualize additional information to the scene. By overlaying anatomical information or surgical plans on the surgery area, projection helps to enhance the surgeon’s understanding of the anatomical structure, and intuitively visualizes the surgical target and key structures of the operation, and avoid the surgeon’s sight diversion between monitor and patient. However, it still remains a challenge to project the surgical navigation information on the target precisely and efficiently. In this study, we propose a projector-based surgical navigation system. Through the gray code-based calibration method, the projector can be calibrated with a camera and then be integrated with an optical spatial locator, so that the navigation information of the operation can be accurately projected onto the target area. We validated the projection accuracy of the system through back projection, with average projection error of 3.37 pixels in x direction and 1.51 pixels in y direction, and model projection with an average position error of 1.03 ± 0.43 mm, and carried out puncture experiments using the system with correct rate of 99%, and qualitatively analyzed the system’s performance through the questionnaire. The results demonstrate the efficacy of our proposed AR system. |
format | Online Article Text |
id | pubmed-8122285 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-81222852021-05-16 A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery Gao, Yuan Zhao, Yuyun Xie, Le Zheng, Guoyan Sensors (Basel) Article In the medical field, guidance to follow the surgical plan is crucial. Image overlay projection is a solution to link the surgical plan with the patient. It realizes augmented reality (AR) by projecting computer-generated image on the surface of the target through a projector, which can visualize additional information to the scene. By overlaying anatomical information or surgical plans on the surgery area, projection helps to enhance the surgeon’s understanding of the anatomical structure, and intuitively visualizes the surgical target and key structures of the operation, and avoid the surgeon’s sight diversion between monitor and patient. However, it still remains a challenge to project the surgical navigation information on the target precisely and efficiently. In this study, we propose a projector-based surgical navigation system. Through the gray code-based calibration method, the projector can be calibrated with a camera and then be integrated with an optical spatial locator, so that the navigation information of the operation can be accurately projected onto the target area. We validated the projection accuracy of the system through back projection, with average projection error of 3.37 pixels in x direction and 1.51 pixels in y direction, and model projection with an average position error of 1.03 ± 0.43 mm, and carried out puncture experiments using the system with correct rate of 99%, and qualitatively analyzed the system’s performance through the questionnaire. The results demonstrate the efficacy of our proposed AR system. MDPI 2021-04-22 /pmc/articles/PMC8122285/ /pubmed/33922079 http://dx.doi.org/10.3390/s21092931 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Gao, Yuan Zhao, Yuyun Xie, Le Zheng, Guoyan A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery |
title | A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery |
title_full | A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery |
title_fullStr | A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery |
title_full_unstemmed | A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery |
title_short | A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery |
title_sort | projector-based augmented reality navigation system for computer-assisted surgery |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8122285/ https://www.ncbi.nlm.nih.gov/pubmed/33922079 http://dx.doi.org/10.3390/s21092931 |
work_keys_str_mv | AT gaoyuan aprojectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery AT zhaoyuyun aprojectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery AT xiele aprojectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery AT zhengguoyan aprojectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery AT gaoyuan projectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery AT zhaoyuyun projectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery AT xiele projectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery AT zhengguoyan projectorbasedaugmentedrealitynavigationsystemforcomputerassistedsurgery |