Cargando…

An eye-tracking based robotic scrub nurse: proof of concept

BACKGROUND: Within surgery, assistive robotic devices (ARD) have reported improved patient outcomes. ARD can offer the surgical team a “third hand” to perform wider tasks and more degrees of motion in comparison with conventional laparoscopy. We test an eye-tracking based robotic scrub nurse (RSN) i...

Descripción completa

Detalles Bibliográficos
Autores principales: Ezzat, Ahmed, Kogkas, Alexandros, Holt, Josephine, Thakkar, Rudrik, Darzi, Ara, Mylonas, George
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8186017/
https://www.ncbi.nlm.nih.gov/pubmed/34101012
http://dx.doi.org/10.1007/s00464-021-08569-w
_version_ 1783704876460539904
author Ezzat, Ahmed
Kogkas, Alexandros
Holt, Josephine
Thakkar, Rudrik
Darzi, Ara
Mylonas, George
author_facet Ezzat, Ahmed
Kogkas, Alexandros
Holt, Josephine
Thakkar, Rudrik
Darzi, Ara
Mylonas, George
author_sort Ezzat, Ahmed
collection PubMed
description BACKGROUND: Within surgery, assistive robotic devices (ARD) have reported improved patient outcomes. ARD can offer the surgical team a “third hand” to perform wider tasks and more degrees of motion in comparison with conventional laparoscopy. We test an eye-tracking based robotic scrub nurse (RSN) in a simulated operating room based on a novel real-time framework for theatre-wide 3D gaze localization in a mobile fashion. METHODS: Surgeons performed segmental resection of pig colon and handsewn end-to-end anastomosis while wearing eye-tracking glasses (ETG) assisted by distributed RGB-D motion sensors. To select instruments, surgeons (ST) fixed their gaze on a screen, initiating the RSN to pick up and transfer the item. Comparison was made between the task with the assistance of a human scrub nurse (HSNt) versus the task with the assistance of robotic and human scrub nurse (R&HSNt). Task load (NASA-TLX), technology acceptance (Van der Laan’s), metric data on performance and team communication were measured. RESULTS: Overall, 10 ST participated. NASA-TLX feedback for ST on HSNt vs R&HSNt usage revealed no significant difference in mental, physical or temporal demands and no change in task performance. ST reported significantly higher frustration score with R&HSNt. Van der Laan’s scores showed positive usefulness and satisfaction scores in using the RSN. No significant difference in operating time was observed. CONCLUSIONS: We report initial findings of our eye-tracking based RSN. This enables mobile, unrestricted hands-free human–robot interaction intra-operatively. Importantly, this platform is deemed non-inferior to HSNt and accepted by ST and HSN test users. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00464-021-08569-w.
format Online
Article
Text
id pubmed-8186017
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-81860172021-06-08 An eye-tracking based robotic scrub nurse: proof of concept Ezzat, Ahmed Kogkas, Alexandros Holt, Josephine Thakkar, Rudrik Darzi, Ara Mylonas, George Surg Endosc New Technology BACKGROUND: Within surgery, assistive robotic devices (ARD) have reported improved patient outcomes. ARD can offer the surgical team a “third hand” to perform wider tasks and more degrees of motion in comparison with conventional laparoscopy. We test an eye-tracking based robotic scrub nurse (RSN) in a simulated operating room based on a novel real-time framework for theatre-wide 3D gaze localization in a mobile fashion. METHODS: Surgeons performed segmental resection of pig colon and handsewn end-to-end anastomosis while wearing eye-tracking glasses (ETG) assisted by distributed RGB-D motion sensors. To select instruments, surgeons (ST) fixed their gaze on a screen, initiating the RSN to pick up and transfer the item. Comparison was made between the task with the assistance of a human scrub nurse (HSNt) versus the task with the assistance of robotic and human scrub nurse (R&HSNt). Task load (NASA-TLX), technology acceptance (Van der Laan’s), metric data on performance and team communication were measured. RESULTS: Overall, 10 ST participated. NASA-TLX feedback for ST on HSNt vs R&HSNt usage revealed no significant difference in mental, physical or temporal demands and no change in task performance. ST reported significantly higher frustration score with R&HSNt. Van der Laan’s scores showed positive usefulness and satisfaction scores in using the RSN. No significant difference in operating time was observed. CONCLUSIONS: We report initial findings of our eye-tracking based RSN. This enables mobile, unrestricted hands-free human–robot interaction intra-operatively. Importantly, this platform is deemed non-inferior to HSNt and accepted by ST and HSN test users. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00464-021-08569-w. Springer US 2021-06-08 2021 /pmc/articles/PMC8186017/ /pubmed/34101012 http://dx.doi.org/10.1007/s00464-021-08569-w Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle New Technology
Ezzat, Ahmed
Kogkas, Alexandros
Holt, Josephine
Thakkar, Rudrik
Darzi, Ara
Mylonas, George
An eye-tracking based robotic scrub nurse: proof of concept
title An eye-tracking based robotic scrub nurse: proof of concept
title_full An eye-tracking based robotic scrub nurse: proof of concept
title_fullStr An eye-tracking based robotic scrub nurse: proof of concept
title_full_unstemmed An eye-tracking based robotic scrub nurse: proof of concept
title_short An eye-tracking based robotic scrub nurse: proof of concept
title_sort eye-tracking based robotic scrub nurse: proof of concept
topic New Technology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8186017/
https://www.ncbi.nlm.nih.gov/pubmed/34101012
http://dx.doi.org/10.1007/s00464-021-08569-w
work_keys_str_mv AT ezzatahmed aneyetrackingbasedroboticscrubnurseproofofconcept
AT kogkasalexandros aneyetrackingbasedroboticscrubnurseproofofconcept
AT holtjosephine aneyetrackingbasedroboticscrubnurseproofofconcept
AT thakkarrudrik aneyetrackingbasedroboticscrubnurseproofofconcept
AT darziara aneyetrackingbasedroboticscrubnurseproofofconcept
AT mylonasgeorge aneyetrackingbasedroboticscrubnurseproofofconcept
AT ezzatahmed eyetrackingbasedroboticscrubnurseproofofconcept
AT kogkasalexandros eyetrackingbasedroboticscrubnurseproofofconcept
AT holtjosephine eyetrackingbasedroboticscrubnurseproofofconcept
AT thakkarrudrik eyetrackingbasedroboticscrubnurseproofofconcept
AT darziara eyetrackingbasedroboticscrubnurseproofofconcept
AT mylonasgeorge eyetrackingbasedroboticscrubnurseproofofconcept