Cargando…

Remote Interactive Surgery Platform (RISP): Proof of Concept for an Augmented-Reality-Based Platform for Surgical Telementoring

The “Remote Interactive Surgery Platform” (RISP) is an augmented reality (AR)-based platform for surgical telementoring. It builds upon recent advances of mixed reality head-mounted displays (MR-HMD) and associated immersive visualization technologies to assist the surgeon during an operation. It en...

Descripción completa

Detalles Bibliográficos
Autores principales: Kalbas, Yannik, Jung, Hoijoon, Ricklin, John, Jin, Ge, Li, Mingjian, Rauer, Thomas, Dehghani, Shervin, Navab, Nassir, Kim, Jinman, Pape, Hans-Christoph, Heining, Sandro-Michael
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10054087/
https://www.ncbi.nlm.nih.gov/pubmed/36976107
http://dx.doi.org/10.3390/jimaging9030056
_version_ 1785015570818662400
author Kalbas, Yannik
Jung, Hoijoon
Ricklin, John
Jin, Ge
Li, Mingjian
Rauer, Thomas
Dehghani, Shervin
Navab, Nassir
Kim, Jinman
Pape, Hans-Christoph
Heining, Sandro-Michael
author_facet Kalbas, Yannik
Jung, Hoijoon
Ricklin, John
Jin, Ge
Li, Mingjian
Rauer, Thomas
Dehghani, Shervin
Navab, Nassir
Kim, Jinman
Pape, Hans-Christoph
Heining, Sandro-Michael
author_sort Kalbas, Yannik
collection PubMed
description The “Remote Interactive Surgery Platform” (RISP) is an augmented reality (AR)-based platform for surgical telementoring. It builds upon recent advances of mixed reality head-mounted displays (MR-HMD) and associated immersive visualization technologies to assist the surgeon during an operation. It enables an interactive, real-time collaboration with a remote consultant by sharing the operating surgeon’s field of view through the Microsoft (MS) HoloLens2 (HL2). Development of the RISP started during the Medical Augmented Reality Summer School 2021 and is currently still ongoing. It currently includes features such as three-dimensional annotations, bidirectional voice communication and interactive windows to display radiographs within the sterile field. This manuscript provides an overview of the RISP and preliminary results regarding its annotation accuracy and user experience measured with ten participants.
format Online
Article
Text
id pubmed-10054087
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-100540872023-03-30 Remote Interactive Surgery Platform (RISP): Proof of Concept for an Augmented-Reality-Based Platform for Surgical Telementoring Kalbas, Yannik Jung, Hoijoon Ricklin, John Jin, Ge Li, Mingjian Rauer, Thomas Dehghani, Shervin Navab, Nassir Kim, Jinman Pape, Hans-Christoph Heining, Sandro-Michael J Imaging Article The “Remote Interactive Surgery Platform” (RISP) is an augmented reality (AR)-based platform for surgical telementoring. It builds upon recent advances of mixed reality head-mounted displays (MR-HMD) and associated immersive visualization technologies to assist the surgeon during an operation. It enables an interactive, real-time collaboration with a remote consultant by sharing the operating surgeon’s field of view through the Microsoft (MS) HoloLens2 (HL2). Development of the RISP started during the Medical Augmented Reality Summer School 2021 and is currently still ongoing. It currently includes features such as three-dimensional annotations, bidirectional voice communication and interactive windows to display radiographs within the sterile field. This manuscript provides an overview of the RISP and preliminary results regarding its annotation accuracy and user experience measured with ten participants. MDPI 2023-02-23 /pmc/articles/PMC10054087/ /pubmed/36976107 http://dx.doi.org/10.3390/jimaging9030056 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Kalbas, Yannik
Jung, Hoijoon
Ricklin, John
Jin, Ge
Li, Mingjian
Rauer, Thomas
Dehghani, Shervin
Navab, Nassir
Kim, Jinman
Pape, Hans-Christoph
Heining, Sandro-Michael
Remote Interactive Surgery Platform (RISP): Proof of Concept for an Augmented-Reality-Based Platform for Surgical Telementoring
title Remote Interactive Surgery Platform (RISP): Proof of Concept for an Augmented-Reality-Based Platform for Surgical Telementoring
title_full Remote Interactive Surgery Platform (RISP): Proof of Concept for an Augmented-Reality-Based Platform for Surgical Telementoring
title_fullStr Remote Interactive Surgery Platform (RISP): Proof of Concept for an Augmented-Reality-Based Platform for Surgical Telementoring
title_full_unstemmed Remote Interactive Surgery Platform (RISP): Proof of Concept for an Augmented-Reality-Based Platform for Surgical Telementoring
title_short Remote Interactive Surgery Platform (RISP): Proof of Concept for an Augmented-Reality-Based Platform for Surgical Telementoring
title_sort remote interactive surgery platform (risp): proof of concept for an augmented-reality-based platform for surgical telementoring
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10054087/
https://www.ncbi.nlm.nih.gov/pubmed/36976107
http://dx.doi.org/10.3390/jimaging9030056
work_keys_str_mv AT kalbasyannik remoteinteractivesurgeryplatformrispproofofconceptforanaugmentedrealitybasedplatformforsurgicaltelementoring
AT junghoijoon remoteinteractivesurgeryplatformrispproofofconceptforanaugmentedrealitybasedplatformforsurgicaltelementoring
AT ricklinjohn remoteinteractivesurgeryplatformrispproofofconceptforanaugmentedrealitybasedplatformforsurgicaltelementoring
AT jinge remoteinteractivesurgeryplatformrispproofofconceptforanaugmentedrealitybasedplatformforsurgicaltelementoring
AT limingjian remoteinteractivesurgeryplatformrispproofofconceptforanaugmentedrealitybasedplatformforsurgicaltelementoring
AT rauerthomas remoteinteractivesurgeryplatformrispproofofconceptforanaugmentedrealitybasedplatformforsurgicaltelementoring
AT dehghanishervin remoteinteractivesurgeryplatformrispproofofconceptforanaugmentedrealitybasedplatformforsurgicaltelementoring
AT navabnassir remoteinteractivesurgeryplatformrispproofofconceptforanaugmentedrealitybasedplatformforsurgicaltelementoring
AT kimjinman remoteinteractivesurgeryplatformrispproofofconceptforanaugmentedrealitybasedplatformforsurgicaltelementoring
AT papehanschristoph remoteinteractivesurgeryplatformrispproofofconceptforanaugmentedrealitybasedplatformforsurgicaltelementoring
AT heiningsandromichael remoteinteractivesurgeryplatformrispproofofconceptforanaugmentedrealitybasedplatformforsurgicaltelementoring