Cargando…
An eye-tracking based robotic scrub nurse: proof of concept
BACKGROUND: Within surgery, assistive robotic devices (ARD) have reported improved patient outcomes. ARD can offer the surgical team a “third hand” to perform wider tasks and more degrees of motion in comparison with conventional laparoscopy. We test an eye-tracking based robotic scrub nurse (RSN) i...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer US
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8186017/ https://www.ncbi.nlm.nih.gov/pubmed/34101012 http://dx.doi.org/10.1007/s00464-021-08569-w |
_version_ | 1783704876460539904 |
---|---|
author | Ezzat, Ahmed Kogkas, Alexandros Holt, Josephine Thakkar, Rudrik Darzi, Ara Mylonas, George |
author_facet | Ezzat, Ahmed Kogkas, Alexandros Holt, Josephine Thakkar, Rudrik Darzi, Ara Mylonas, George |
author_sort | Ezzat, Ahmed |
collection | PubMed |
description | BACKGROUND: Within surgery, assistive robotic devices (ARD) have reported improved patient outcomes. ARD can offer the surgical team a “third hand” to perform wider tasks and more degrees of motion in comparison with conventional laparoscopy. We test an eye-tracking based robotic scrub nurse (RSN) in a simulated operating room based on a novel real-time framework for theatre-wide 3D gaze localization in a mobile fashion. METHODS: Surgeons performed segmental resection of pig colon and handsewn end-to-end anastomosis while wearing eye-tracking glasses (ETG) assisted by distributed RGB-D motion sensors. To select instruments, surgeons (ST) fixed their gaze on a screen, initiating the RSN to pick up and transfer the item. Comparison was made between the task with the assistance of a human scrub nurse (HSNt) versus the task with the assistance of robotic and human scrub nurse (R&HSNt). Task load (NASA-TLX), technology acceptance (Van der Laan’s), metric data on performance and team communication were measured. RESULTS: Overall, 10 ST participated. NASA-TLX feedback for ST on HSNt vs R&HSNt usage revealed no significant difference in mental, physical or temporal demands and no change in task performance. ST reported significantly higher frustration score with R&HSNt. Van der Laan’s scores showed positive usefulness and satisfaction scores in using the RSN. No significant difference in operating time was observed. CONCLUSIONS: We report initial findings of our eye-tracking based RSN. This enables mobile, unrestricted hands-free human–robot interaction intra-operatively. Importantly, this platform is deemed non-inferior to HSNt and accepted by ST and HSN test users. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00464-021-08569-w. |
format | Online Article Text |
id | pubmed-8186017 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Springer US |
record_format | MEDLINE/PubMed |
spelling | pubmed-81860172021-06-08 An eye-tracking based robotic scrub nurse: proof of concept Ezzat, Ahmed Kogkas, Alexandros Holt, Josephine Thakkar, Rudrik Darzi, Ara Mylonas, George Surg Endosc New Technology BACKGROUND: Within surgery, assistive robotic devices (ARD) have reported improved patient outcomes. ARD can offer the surgical team a “third hand” to perform wider tasks and more degrees of motion in comparison with conventional laparoscopy. We test an eye-tracking based robotic scrub nurse (RSN) in a simulated operating room based on a novel real-time framework for theatre-wide 3D gaze localization in a mobile fashion. METHODS: Surgeons performed segmental resection of pig colon and handsewn end-to-end anastomosis while wearing eye-tracking glasses (ETG) assisted by distributed RGB-D motion sensors. To select instruments, surgeons (ST) fixed their gaze on a screen, initiating the RSN to pick up and transfer the item. Comparison was made between the task with the assistance of a human scrub nurse (HSNt) versus the task with the assistance of robotic and human scrub nurse (R&HSNt). Task load (NASA-TLX), technology acceptance (Van der Laan’s), metric data on performance and team communication were measured. RESULTS: Overall, 10 ST participated. NASA-TLX feedback for ST on HSNt vs R&HSNt usage revealed no significant difference in mental, physical or temporal demands and no change in task performance. ST reported significantly higher frustration score with R&HSNt. Van der Laan’s scores showed positive usefulness and satisfaction scores in using the RSN. No significant difference in operating time was observed. CONCLUSIONS: We report initial findings of our eye-tracking based RSN. This enables mobile, unrestricted hands-free human–robot interaction intra-operatively. Importantly, this platform is deemed non-inferior to HSNt and accepted by ST and HSN test users. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00464-021-08569-w. Springer US 2021-06-08 2021 /pmc/articles/PMC8186017/ /pubmed/34101012 http://dx.doi.org/10.1007/s00464-021-08569-w Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | New Technology Ezzat, Ahmed Kogkas, Alexandros Holt, Josephine Thakkar, Rudrik Darzi, Ara Mylonas, George An eye-tracking based robotic scrub nurse: proof of concept |
title | An eye-tracking based robotic scrub nurse: proof of concept |
title_full | An eye-tracking based robotic scrub nurse: proof of concept |
title_fullStr | An eye-tracking based robotic scrub nurse: proof of concept |
title_full_unstemmed | An eye-tracking based robotic scrub nurse: proof of concept |
title_short | An eye-tracking based robotic scrub nurse: proof of concept |
title_sort | eye-tracking based robotic scrub nurse: proof of concept |
topic | New Technology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8186017/ https://www.ncbi.nlm.nih.gov/pubmed/34101012 http://dx.doi.org/10.1007/s00464-021-08569-w |
work_keys_str_mv | AT ezzatahmed aneyetrackingbasedroboticscrubnurseproofofconcept AT kogkasalexandros aneyetrackingbasedroboticscrubnurseproofofconcept AT holtjosephine aneyetrackingbasedroboticscrubnurseproofofconcept AT thakkarrudrik aneyetrackingbasedroboticscrubnurseproofofconcept AT darziara aneyetrackingbasedroboticscrubnurseproofofconcept AT mylonasgeorge aneyetrackingbasedroboticscrubnurseproofofconcept AT ezzatahmed eyetrackingbasedroboticscrubnurseproofofconcept AT kogkasalexandros eyetrackingbasedroboticscrubnurseproofofconcept AT holtjosephine eyetrackingbasedroboticscrubnurseproofofconcept AT thakkarrudrik eyetrackingbasedroboticscrubnurseproofofconcept AT darziara eyetrackingbasedroboticscrubnurseproofofconcept AT mylonasgeorge eyetrackingbasedroboticscrubnurseproofofconcept |