Cargando…

Exodex Adam—A Reconfigurable Dexterous Haptic User Interface for the Whole Hand

Applications for dexterous robot teleoperation and immersive virtual reality are growing. Haptic user input devices need to allow the user to intuitively command and seamlessly “feel” the environment they work in, whether virtual or a remote site through an avatar. We introduce the DLR Exodex Adam,...

Descripción completa

Detalles Bibliográficos
Autores principales: Lii, Neal Y., Pereira, Aaron, Dietl, Julian, Stillfried, Georg, Schmidt, Annika, Beik-Mohammadi, Hadi, Baker, Thomas, Maier, Annika, Pleintinger, Benedikt, Chen, Zhaopeng, Elawad, Amal, Mentzer , Lauren, Pineault, Austin, Reisich, Philipp, Albu-Schäffer, Alin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8927287/
https://www.ncbi.nlm.nih.gov/pubmed/35309724
http://dx.doi.org/10.3389/frobt.2021.716598
_version_ 1784670413779894272
author Lii, Neal Y.
Pereira, Aaron
Dietl, Julian
Stillfried, Georg
Schmidt, Annika
Beik-Mohammadi, Hadi
Baker, Thomas
Maier, Annika
Pleintinger, Benedikt
Chen, Zhaopeng
Elawad, Amal
Mentzer , Lauren
Pineault, Austin
Reisich, Philipp
Albu-Schäffer, Alin
author_facet Lii, Neal Y.
Pereira, Aaron
Dietl, Julian
Stillfried, Georg
Schmidt, Annika
Beik-Mohammadi, Hadi
Baker, Thomas
Maier, Annika
Pleintinger, Benedikt
Chen, Zhaopeng
Elawad, Amal
Mentzer , Lauren
Pineault, Austin
Reisich, Philipp
Albu-Schäffer, Alin
author_sort Lii, Neal Y.
collection PubMed
description Applications for dexterous robot teleoperation and immersive virtual reality are growing. Haptic user input devices need to allow the user to intuitively command and seamlessly “feel” the environment they work in, whether virtual or a remote site through an avatar. We introduce the DLR Exodex Adam, a reconfigurable, dexterous, whole-hand haptic input device. The device comprises multiple modular, three degrees of freedom (3-DOF) robotic fingers, whose placement on the device can be adjusted to optimize manipulability for different user hand sizes. Additionally, the device is mounted on a 7-DOF robot arm to increase the user’s workspace. Exodex Adam uses a front-facing interface, with robotic fingers coupled to two of the user’s fingertips, the thumb, and two points on the palm. Including the palm, as opposed to only the fingertips as is common in existing devices, enables accurate tracking of the whole hand without additional sensors such as a data glove or motion capture. By providing “whole-hand” interaction with omnidirectional force-feedback at the attachment points, we enable the user to experience the environment with the complete hand instead of only the fingertips, thus realizing deeper immersion. Interaction using Exodex Adam can range from palpation of objects and surfaces to manipulation using both power and precision grasps, all while receiving haptic feedback. This article details the concept and design of the Exodex Adam, as well as use cases where it is deployed with different command modalities. These include mixed-media interaction in a virtual environment, gesture-based telemanipulation, and robotic hand–arm teleoperation using adaptive model-mediated teleoperation. Finally, we share the insights gained during our development process and use case deployments.
format Online
Article
Text
id pubmed-8927287
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-89272872022-03-18 Exodex Adam—A Reconfigurable Dexterous Haptic User Interface for the Whole Hand Lii, Neal Y. Pereira, Aaron Dietl, Julian Stillfried, Georg Schmidt, Annika Beik-Mohammadi, Hadi Baker, Thomas Maier, Annika Pleintinger, Benedikt Chen, Zhaopeng Elawad, Amal Mentzer , Lauren Pineault, Austin Reisich, Philipp Albu-Schäffer, Alin Front Robot AI Robotics and AI Applications for dexterous robot teleoperation and immersive virtual reality are growing. Haptic user input devices need to allow the user to intuitively command and seamlessly “feel” the environment they work in, whether virtual or a remote site through an avatar. We introduce the DLR Exodex Adam, a reconfigurable, dexterous, whole-hand haptic input device. The device comprises multiple modular, three degrees of freedom (3-DOF) robotic fingers, whose placement on the device can be adjusted to optimize manipulability for different user hand sizes. Additionally, the device is mounted on a 7-DOF robot arm to increase the user’s workspace. Exodex Adam uses a front-facing interface, with robotic fingers coupled to two of the user’s fingertips, the thumb, and two points on the palm. Including the palm, as opposed to only the fingertips as is common in existing devices, enables accurate tracking of the whole hand without additional sensors such as a data glove or motion capture. By providing “whole-hand” interaction with omnidirectional force-feedback at the attachment points, we enable the user to experience the environment with the complete hand instead of only the fingertips, thus realizing deeper immersion. Interaction using Exodex Adam can range from palpation of objects and surfaces to manipulation using both power and precision grasps, all while receiving haptic feedback. This article details the concept and design of the Exodex Adam, as well as use cases where it is deployed with different command modalities. These include mixed-media interaction in a virtual environment, gesture-based telemanipulation, and robotic hand–arm teleoperation using adaptive model-mediated teleoperation. Finally, we share the insights gained during our development process and use case deployments. Frontiers Media S.A. 2022-03-03 /pmc/articles/PMC8927287/ /pubmed/35309724 http://dx.doi.org/10.3389/frobt.2021.716598 Text en Copyright © 2022 Lii, Pereira, Dietl, Stillfried, Schmidt, Beik-Mohammadi, Baker, Maier, Pleintinger, Chen, Elawad, Mentzer , Pineault, Reisich and Albu-Schäffer. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Robotics and AI
Lii, Neal Y.
Pereira, Aaron
Dietl, Julian
Stillfried, Georg
Schmidt, Annika
Beik-Mohammadi, Hadi
Baker, Thomas
Maier, Annika
Pleintinger, Benedikt
Chen, Zhaopeng
Elawad, Amal
Mentzer , Lauren
Pineault, Austin
Reisich, Philipp
Albu-Schäffer, Alin
Exodex Adam—A Reconfigurable Dexterous Haptic User Interface for the Whole Hand
title Exodex Adam—A Reconfigurable Dexterous Haptic User Interface for the Whole Hand
title_full Exodex Adam—A Reconfigurable Dexterous Haptic User Interface for the Whole Hand
title_fullStr Exodex Adam—A Reconfigurable Dexterous Haptic User Interface for the Whole Hand
title_full_unstemmed Exodex Adam—A Reconfigurable Dexterous Haptic User Interface for the Whole Hand
title_short Exodex Adam—A Reconfigurable Dexterous Haptic User Interface for the Whole Hand
title_sort exodex adam—a reconfigurable dexterous haptic user interface for the whole hand
topic Robotics and AI
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8927287/
https://www.ncbi.nlm.nih.gov/pubmed/35309724
http://dx.doi.org/10.3389/frobt.2021.716598
work_keys_str_mv AT liinealy exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT pereiraaaron exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT dietljulian exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT stillfriedgeorg exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT schmidtannika exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT beikmohammadihadi exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT bakerthomas exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT maierannika exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT pleintingerbenedikt exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT chenzhaopeng exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT elawadamal exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT mentzerlauren exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT pineaultaustin exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT reisichphilipp exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand
AT albuschafferalin exodexadamareconfigurabledexteroushapticuserinterfaceforthewholehand