Cargando…

Electrode-free visual prosthesis/exoskeleton control using augmented reality glasses in a first proof-of-technical-concept study

In the field of neuroprosthetics, the current state-of-the-art method involves controlling the prosthesis with electromyography (EMG) or electrooculography/electroencephalography (EOG/EEG). However, these systems are both expensive and time consuming to calibrate, susceptible to interference, and re...

Descripción completa

Detalles Bibliográficos
Autores principales: Hazubski, Simon, Hoppe, Harald, Otte, Andreas
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7530745/
https://www.ncbi.nlm.nih.gov/pubmed/33004950
http://dx.doi.org/10.1038/s41598-020-73250-6
_version_ 1783589630567776256
author Hazubski, Simon
Hoppe, Harald
Otte, Andreas
author_facet Hazubski, Simon
Hoppe, Harald
Otte, Andreas
author_sort Hazubski, Simon
collection PubMed
description In the field of neuroprosthetics, the current state-of-the-art method involves controlling the prosthesis with electromyography (EMG) or electrooculography/electroencephalography (EOG/EEG). However, these systems are both expensive and time consuming to calibrate, susceptible to interference, and require a lengthy learning phase by the patient. Therefore, it is an open challenge to design more robust systems that are suitable for everyday use and meet the needs of patients. In this paper, we present a new concept of complete visual control for a prosthesis, an exoskeleton or another end effector using augmented reality (AR) glasses presented for the first time in a proof-of-concept study. By using AR glasses equipped with a monocular camera, a marker attached to the prosthesis is tracked. Minimal relative movements of the head with respect to the prosthesis are registered by tracking and used for control. Two possible control mechanisms including visual feedback are presented and implemented for both a motorized hand orthosis and a motorized hand prosthesis. Since the grasping process is mainly controlled by vision, the proposed approach appears to be natural and intuitive.
format Online
Article
Text
id pubmed-7530745
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-75307452020-10-02 Electrode-free visual prosthesis/exoskeleton control using augmented reality glasses in a first proof-of-technical-concept study Hazubski, Simon Hoppe, Harald Otte, Andreas Sci Rep Article In the field of neuroprosthetics, the current state-of-the-art method involves controlling the prosthesis with electromyography (EMG) or electrooculography/electroencephalography (EOG/EEG). However, these systems are both expensive and time consuming to calibrate, susceptible to interference, and require a lengthy learning phase by the patient. Therefore, it is an open challenge to design more robust systems that are suitable for everyday use and meet the needs of patients. In this paper, we present a new concept of complete visual control for a prosthesis, an exoskeleton or another end effector using augmented reality (AR) glasses presented for the first time in a proof-of-concept study. By using AR glasses equipped with a monocular camera, a marker attached to the prosthesis is tracked. Minimal relative movements of the head with respect to the prosthesis are registered by tracking and used for control. Two possible control mechanisms including visual feedback are presented and implemented for both a motorized hand orthosis and a motorized hand prosthesis. Since the grasping process is mainly controlled by vision, the proposed approach appears to be natural and intuitive. Nature Publishing Group UK 2020-10-01 /pmc/articles/PMC7530745/ /pubmed/33004950 http://dx.doi.org/10.1038/s41598-020-73250-6 Text en © The Author(s) 2020 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Hazubski, Simon
Hoppe, Harald
Otte, Andreas
Electrode-free visual prosthesis/exoskeleton control using augmented reality glasses in a first proof-of-technical-concept study
title Electrode-free visual prosthesis/exoskeleton control using augmented reality glasses in a first proof-of-technical-concept study
title_full Electrode-free visual prosthesis/exoskeleton control using augmented reality glasses in a first proof-of-technical-concept study
title_fullStr Electrode-free visual prosthesis/exoskeleton control using augmented reality glasses in a first proof-of-technical-concept study
title_full_unstemmed Electrode-free visual prosthesis/exoskeleton control using augmented reality glasses in a first proof-of-technical-concept study
title_short Electrode-free visual prosthesis/exoskeleton control using augmented reality glasses in a first proof-of-technical-concept study
title_sort electrode-free visual prosthesis/exoskeleton control using augmented reality glasses in a first proof-of-technical-concept study
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7530745/
https://www.ncbi.nlm.nih.gov/pubmed/33004950
http://dx.doi.org/10.1038/s41598-020-73250-6
work_keys_str_mv AT hazubskisimon electrodefreevisualprosthesisexoskeletoncontrolusingaugmentedrealityglassesinafirstproofoftechnicalconceptstudy
AT hoppeharald electrodefreevisualprosthesisexoskeletoncontrolusingaugmentedrealityglassesinafirstproofoftechnicalconceptstudy
AT otteandreas electrodefreevisualprosthesisexoskeletoncontrolusingaugmentedrealityglassesinafirstproofoftechnicalconceptstudy