Cargando…

Step-by-step optimisation of robotic-assisted radical prostatectomy using augmented reality

INTRODUCTION: Surgical training will be complemented by digitalisation, as the COVID 19 pandemic continues (1). Proximie is an augmented reality (AR) platform that can display up to 4 native camera views, with live or semi live telementoring. It can optimise ergonomics of the surgeon at the console...

Descripción completa

Detalles Bibliográficos
Autores principales: Noël, Jonathan, Moschovas, Marcio Covas, Patel, Ela, Rogers, Travis, Marquinez, Jeffrey, Rocco, Bernardo, Mottrie, Alexandre, Patel, Vipul
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Sociedade Brasileira de Urologia 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9060177/
https://www.ncbi.nlm.nih.gov/pubmed/35168316
http://dx.doi.org/10.1590/S1677-5538.IBJU.2022.99.10
_version_ 1784698464622346240
author Noël, Jonathan
Moschovas, Marcio Covas
Patel, Ela
Rogers, Travis
Marquinez, Jeffrey
Rocco, Bernardo
Mottrie, Alexandre
Patel, Vipul
author_facet Noël, Jonathan
Moschovas, Marcio Covas
Patel, Ela
Rogers, Travis
Marquinez, Jeffrey
Rocco, Bernardo
Mottrie, Alexandre
Patel, Vipul
author_sort Noël, Jonathan
collection PubMed
description INTRODUCTION: Surgical training will be complemented by digitalisation, as the COVID 19 pandemic continues (1). Proximie is an augmented reality (AR) platform that can display up to 4 native camera views, with live or semi live telementoring. It can optimise ergonomics of the surgeon at the console (2), and robotic instrument orientation. We describe the utilisation of Proximie as a step-by-step guide in a robotic assisted radical prostatectomy (RARP). SURGICAL TECHNIQUE: Author V. P. performed a transperitoneal multiport da Vinci Xi RARP with the Proximie platform: a laptop computer, multiple HD webcams, microphones and speakers. Using an HDMI cable to the Intuitive Surgical tower, output display from the console and an additional laparoscopic tower is shown. Each webcam was mounted to the side armrests of the console, directed at the surgeon's hands. An independent ‘drop in’ laparoscope via an additional 5mm left upper quadrant port was utilised. Observers can visualise the AR platform's recordings on a laptop and/or smartphone. A PTZ (pan-tilt-zoom) camera can capture the operating room, bedside assistant, ports and patient position. Our video demonstrates three of four camera views for posture, forearm, wrist, hand, and finger orientation, relative to the translated robotic steps. A pincer grasp of the endowrist manipulator during anastomosis allows optimal robotic wrist rotation. The second laparoscopic camera view demonstrated intracorporeal angles of robotic arm and bedside assistant's instrument position for critical steps such as nerve sparing and anastomosis (3). The console time was 100 minutes, no intraoperative complications, or delay in image transmission occurred with utilising the platform. CONSIDERATIONS: An AR platform can create deeper learning for RARP in real time or recorded sessions. Two-way verbal and visual communication with ability to annotate on screen, allows long distance mentoring. The platform's utility can be accessed in anywhere, to project surgeons beyond their immediate environment. This allows for democratisation of access to high volume institutions and their evolution of techniques (4), to assist patients globally. Potential developments are artificial intelligence (AI) networks analysing repository of such recorded data, to identify intraoperative hand motion and robotic instrument tracking. AR is a pertinent building block to enhance robotic training, skill dissemination, precision medicine (5) and surgery overall.
format Online
Article
Text
id pubmed-9060177
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Sociedade Brasileira de Urologia
record_format MEDLINE/PubMed
spelling pubmed-90601772022-05-06 Step-by-step optimisation of robotic-assisted radical prostatectomy using augmented reality Noël, Jonathan Moschovas, Marcio Covas Patel, Ela Rogers, Travis Marquinez, Jeffrey Rocco, Bernardo Mottrie, Alexandre Patel, Vipul Int Braz J Urol Video Section INTRODUCTION: Surgical training will be complemented by digitalisation, as the COVID 19 pandemic continues (1). Proximie is an augmented reality (AR) platform that can display up to 4 native camera views, with live or semi live telementoring. It can optimise ergonomics of the surgeon at the console (2), and robotic instrument orientation. We describe the utilisation of Proximie as a step-by-step guide in a robotic assisted radical prostatectomy (RARP). SURGICAL TECHNIQUE: Author V. P. performed a transperitoneal multiport da Vinci Xi RARP with the Proximie platform: a laptop computer, multiple HD webcams, microphones and speakers. Using an HDMI cable to the Intuitive Surgical tower, output display from the console and an additional laparoscopic tower is shown. Each webcam was mounted to the side armrests of the console, directed at the surgeon's hands. An independent ‘drop in’ laparoscope via an additional 5mm left upper quadrant port was utilised. Observers can visualise the AR platform's recordings on a laptop and/or smartphone. A PTZ (pan-tilt-zoom) camera can capture the operating room, bedside assistant, ports and patient position. Our video demonstrates three of four camera views for posture, forearm, wrist, hand, and finger orientation, relative to the translated robotic steps. A pincer grasp of the endowrist manipulator during anastomosis allows optimal robotic wrist rotation. The second laparoscopic camera view demonstrated intracorporeal angles of robotic arm and bedside assistant's instrument position for critical steps such as nerve sparing and anastomosis (3). The console time was 100 minutes, no intraoperative complications, or delay in image transmission occurred with utilising the platform. CONSIDERATIONS: An AR platform can create deeper learning for RARP in real time or recorded sessions. Two-way verbal and visual communication with ability to annotate on screen, allows long distance mentoring. The platform's utility can be accessed in anywhere, to project surgeons beyond their immediate environment. This allows for democratisation of access to high volume institutions and their evolution of techniques (4), to assist patients globally. Potential developments are artificial intelligence (AI) networks analysing repository of such recorded data, to identify intraoperative hand motion and robotic instrument tracking. AR is a pertinent building block to enhance robotic training, skill dissemination, precision medicine (5) and surgery overall. Sociedade Brasileira de Urologia 2022-01-12 /pmc/articles/PMC9060177/ /pubmed/35168316 http://dx.doi.org/10.1590/S1677-5538.IBJU.2022.99.10 Text en https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Video Section
Noël, Jonathan
Moschovas, Marcio Covas
Patel, Ela
Rogers, Travis
Marquinez, Jeffrey
Rocco, Bernardo
Mottrie, Alexandre
Patel, Vipul
Step-by-step optimisation of robotic-assisted radical prostatectomy using augmented reality
title Step-by-step optimisation of robotic-assisted radical prostatectomy using augmented reality
title_full Step-by-step optimisation of robotic-assisted radical prostatectomy using augmented reality
title_fullStr Step-by-step optimisation of robotic-assisted radical prostatectomy using augmented reality
title_full_unstemmed Step-by-step optimisation of robotic-assisted radical prostatectomy using augmented reality
title_short Step-by-step optimisation of robotic-assisted radical prostatectomy using augmented reality
title_sort step-by-step optimisation of robotic-assisted radical prostatectomy using augmented reality
topic Video Section
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9060177/
https://www.ncbi.nlm.nih.gov/pubmed/35168316
http://dx.doi.org/10.1590/S1677-5538.IBJU.2022.99.10
work_keys_str_mv AT noeljonathan stepbystepoptimisationofroboticassistedradicalprostatectomyusingaugmentedreality
AT moschovasmarciocovas stepbystepoptimisationofroboticassistedradicalprostatectomyusingaugmentedreality
AT patelela stepbystepoptimisationofroboticassistedradicalprostatectomyusingaugmentedreality
AT rogerstravis stepbystepoptimisationofroboticassistedradicalprostatectomyusingaugmentedreality
AT marquinezjeffrey stepbystepoptimisationofroboticassistedradicalprostatectomyusingaugmentedreality
AT roccobernardo stepbystepoptimisationofroboticassistedradicalprostatectomyusingaugmentedreality
AT mottriealexandre stepbystepoptimisationofroboticassistedradicalprostatectomyusingaugmentedreality
AT patelvipul stepbystepoptimisationofroboticassistedradicalprostatectomyusingaugmentedreality