Cargando…

Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications

Human-machine interfaces (HMIs) experience increasing requirements for intuitive and effective manipulation. Current commercialized solutions of glove-based HMI are limited by either detectable motions or the huge cost on fabrication, energy, and computing power. We propose the haptic-feedback smart...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhu, Minglu, Sun, Zhongda, Zhang, Zixuan, Shi, Qiongfeng, He, Tianyiyi, Liu, Huicong, Chen, Tao, Lee, Chengkuo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Association for the Advancement of Science 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7209995/
https://www.ncbi.nlm.nih.gov/pubmed/32494718
http://dx.doi.org/10.1126/sciadv.aaz8693
_version_ 1783531193579339776
author Zhu, Minglu
Sun, Zhongda
Zhang, Zixuan
Shi, Qiongfeng
He, Tianyiyi
Liu, Huicong
Chen, Tao
Lee, Chengkuo
author_facet Zhu, Minglu
Sun, Zhongda
Zhang, Zixuan
Shi, Qiongfeng
He, Tianyiyi
Liu, Huicong
Chen, Tao
Lee, Chengkuo
author_sort Zhu, Minglu
collection PubMed
description Human-machine interfaces (HMIs) experience increasing requirements for intuitive and effective manipulation. Current commercialized solutions of glove-based HMI are limited by either detectable motions or the huge cost on fabrication, energy, and computing power. We propose the haptic-feedback smart glove with triboelectric-based finger bending sensors, palm sliding sensor, and piezoelectric mechanical stimulators. The detection of multidirectional bending and sliding events is demonstrated in virtual space using the self-generated triboelectric signals for various degrees of freedom on human hand. We also perform haptic mechanical stimulation via piezoelectric chips to realize the augmented HMI. The smart glove achieves object recognition using machine learning technique, with an accuracy of 96%. Through the integrated demonstration of multidimensional manipulation, haptic feedback, and AI-based object recognition, our glove reveals its potential as a promising solution for low-cost and advanced human-machine interaction, which can benefit diversified areas, including entertainment, home healthcare, sports training, and medical industry.
format Online
Article
Text
id pubmed-7209995
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher American Association for the Advancement of Science
record_format MEDLINE/PubMed
spelling pubmed-72099952020-06-02 Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications Zhu, Minglu Sun, Zhongda Zhang, Zixuan Shi, Qiongfeng He, Tianyiyi Liu, Huicong Chen, Tao Lee, Chengkuo Sci Adv Research Articles Human-machine interfaces (HMIs) experience increasing requirements for intuitive and effective manipulation. Current commercialized solutions of glove-based HMI are limited by either detectable motions or the huge cost on fabrication, energy, and computing power. We propose the haptic-feedback smart glove with triboelectric-based finger bending sensors, palm sliding sensor, and piezoelectric mechanical stimulators. The detection of multidirectional bending and sliding events is demonstrated in virtual space using the self-generated triboelectric signals for various degrees of freedom on human hand. We also perform haptic mechanical stimulation via piezoelectric chips to realize the augmented HMI. The smart glove achieves object recognition using machine learning technique, with an accuracy of 96%. Through the integrated demonstration of multidimensional manipulation, haptic feedback, and AI-based object recognition, our glove reveals its potential as a promising solution for low-cost and advanced human-machine interaction, which can benefit diversified areas, including entertainment, home healthcare, sports training, and medical industry. American Association for the Advancement of Science 2020-05-08 /pmc/articles/PMC7209995/ /pubmed/32494718 http://dx.doi.org/10.1126/sciadv.aaz8693 Text en Copyright © 2020 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC). http://creativecommons.org/licenses/by-nc/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial license (http://creativecommons.org/licenses/by-nc/4.0/) , which permits use, distribution, and reproduction in any medium, so long as the resultant use is not for commercial advantage and provided the original work is properly cited.
spellingShingle Research Articles
Zhu, Minglu
Sun, Zhongda
Zhang, Zixuan
Shi, Qiongfeng
He, Tianyiyi
Liu, Huicong
Chen, Tao
Lee, Chengkuo
Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications
title Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications
title_full Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications
title_fullStr Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications
title_full_unstemmed Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications
title_short Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications
title_sort haptic-feedback smart glove as a creative human-machine interface (hmi) for virtual/augmented reality applications
topic Research Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7209995/
https://www.ncbi.nlm.nih.gov/pubmed/32494718
http://dx.doi.org/10.1126/sciadv.aaz8693
work_keys_str_mv AT zhuminglu hapticfeedbacksmartgloveasacreativehumanmachineinterfacehmiforvirtualaugmentedrealityapplications
AT sunzhongda hapticfeedbacksmartgloveasacreativehumanmachineinterfacehmiforvirtualaugmentedrealityapplications
AT zhangzixuan hapticfeedbacksmartgloveasacreativehumanmachineinterfacehmiforvirtualaugmentedrealityapplications
AT shiqiongfeng hapticfeedbacksmartgloveasacreativehumanmachineinterfacehmiforvirtualaugmentedrealityapplications
AT hetianyiyi hapticfeedbacksmartgloveasacreativehumanmachineinterfacehmiforvirtualaugmentedrealityapplications
AT liuhuicong hapticfeedbacksmartgloveasacreativehumanmachineinterfacehmiforvirtualaugmentedrealityapplications
AT chentao hapticfeedbacksmartgloveasacreativehumanmachineinterfacehmiforvirtualaugmentedrealityapplications
AT leechengkuo hapticfeedbacksmartgloveasacreativehumanmachineinterfacehmiforvirtualaugmentedrealityapplications