Cargando…

Motion Similarity Evaluation between Human and a Tri-Co Robot during Real-Time Imitation with a Trajectory Dynamic Time Warping Model

Precisely imitating human motions in real-time poses a challenge for the robots due to difference in their physical structures. This paper proposes a human–computer interaction method for remotely manipulating life-size humanoid robots with a new metrics for evaluating motion similarity. First, we e...

Descripción completa

Detalles Bibliográficos
Autores principales: Gong, Liang, Chen, Binhao, Xu, Wenbin, Liu, Chengliang, Li, Xudong, Zhao, Zelin, Zhao, Lujie
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8914699/
https://www.ncbi.nlm.nih.gov/pubmed/35271114
http://dx.doi.org/10.3390/s22051968
_version_ 1784667787016273920
author Gong, Liang
Chen, Binhao
Xu, Wenbin
Liu, Chengliang
Li, Xudong
Zhao, Zelin
Zhao, Lujie
author_facet Gong, Liang
Chen, Binhao
Xu, Wenbin
Liu, Chengliang
Li, Xudong
Zhao, Zelin
Zhao, Lujie
author_sort Gong, Liang
collection PubMed
description Precisely imitating human motions in real-time poses a challenge for the robots due to difference in their physical structures. This paper proposes a human–computer interaction method for remotely manipulating life-size humanoid robots with a new metrics for evaluating motion similarity. First, we establish a motion capture system to acquire the operator’s motion data and retarget it to the standard bone model. Secondly, we develop a fast mapping algorithm, by mapping the BVH (BioVision Hierarchy) data collected by the motion capture system to each joint motion angle of the robot to realize the imitated motion control of the humanoid robot. Thirdly, a DTW (Dynamic Time Warping)-based trajectory evaluation method is proposed to quantitatively evaluate the difference between robot trajectory and human motion, and meanwhile, visualization terminals render it more convenient to make comparisons between two different but simultaneous motion systems. We design a complex gesture simulation experiment to verify the feasibility and real-time performance of the control method. The proposed human-in-the-loop imitation control method addresses a prominent non-isostructural retargeting problem between human and robot, enhances robot interaction capability in a more natural way, and improves robot adaptability to uncertain and dynamic environments.
format Online
Article
Text
id pubmed-8914699
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-89146992022-03-12 Motion Similarity Evaluation between Human and a Tri-Co Robot during Real-Time Imitation with a Trajectory Dynamic Time Warping Model Gong, Liang Chen, Binhao Xu, Wenbin Liu, Chengliang Li, Xudong Zhao, Zelin Zhao, Lujie Sensors (Basel) Article Precisely imitating human motions in real-time poses a challenge for the robots due to difference in their physical structures. This paper proposes a human–computer interaction method for remotely manipulating life-size humanoid robots with a new metrics for evaluating motion similarity. First, we establish a motion capture system to acquire the operator’s motion data and retarget it to the standard bone model. Secondly, we develop a fast mapping algorithm, by mapping the BVH (BioVision Hierarchy) data collected by the motion capture system to each joint motion angle of the robot to realize the imitated motion control of the humanoid robot. Thirdly, a DTW (Dynamic Time Warping)-based trajectory evaluation method is proposed to quantitatively evaluate the difference between robot trajectory and human motion, and meanwhile, visualization terminals render it more convenient to make comparisons between two different but simultaneous motion systems. We design a complex gesture simulation experiment to verify the feasibility and real-time performance of the control method. The proposed human-in-the-loop imitation control method addresses a prominent non-isostructural retargeting problem between human and robot, enhances robot interaction capability in a more natural way, and improves robot adaptability to uncertain and dynamic environments. MDPI 2022-03-02 /pmc/articles/PMC8914699/ /pubmed/35271114 http://dx.doi.org/10.3390/s22051968 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Gong, Liang
Chen, Binhao
Xu, Wenbin
Liu, Chengliang
Li, Xudong
Zhao, Zelin
Zhao, Lujie
Motion Similarity Evaluation between Human and a Tri-Co Robot during Real-Time Imitation with a Trajectory Dynamic Time Warping Model
title Motion Similarity Evaluation between Human and a Tri-Co Robot during Real-Time Imitation with a Trajectory Dynamic Time Warping Model
title_full Motion Similarity Evaluation between Human and a Tri-Co Robot during Real-Time Imitation with a Trajectory Dynamic Time Warping Model
title_fullStr Motion Similarity Evaluation between Human and a Tri-Co Robot during Real-Time Imitation with a Trajectory Dynamic Time Warping Model
title_full_unstemmed Motion Similarity Evaluation between Human and a Tri-Co Robot during Real-Time Imitation with a Trajectory Dynamic Time Warping Model
title_short Motion Similarity Evaluation between Human and a Tri-Co Robot during Real-Time Imitation with a Trajectory Dynamic Time Warping Model
title_sort motion similarity evaluation between human and a tri-co robot during real-time imitation with a trajectory dynamic time warping model
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8914699/
https://www.ncbi.nlm.nih.gov/pubmed/35271114
http://dx.doi.org/10.3390/s22051968
work_keys_str_mv AT gongliang motionsimilarityevaluationbetweenhumanandatricorobotduringrealtimeimitationwithatrajectorydynamictimewarpingmodel
AT chenbinhao motionsimilarityevaluationbetweenhumanandatricorobotduringrealtimeimitationwithatrajectorydynamictimewarpingmodel
AT xuwenbin motionsimilarityevaluationbetweenhumanandatricorobotduringrealtimeimitationwithatrajectorydynamictimewarpingmodel
AT liuchengliang motionsimilarityevaluationbetweenhumanandatricorobotduringrealtimeimitationwithatrajectorydynamictimewarpingmodel
AT lixudong motionsimilarityevaluationbetweenhumanandatricorobotduringrealtimeimitationwithatrajectorydynamictimewarpingmodel
AT zhaozelin motionsimilarityevaluationbetweenhumanandatricorobotduringrealtimeimitationwithatrajectorydynamictimewarpingmodel
AT zhaolujie motionsimilarityevaluationbetweenhumanandatricorobotduringrealtimeimitationwithatrajectorydynamictimewarpingmodel