Cargando…

Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning

Continuous mode adaptation is very important and useful to satisfy the different user rehabilitation needs and improve human–robot interaction (HRI) performance for rehabilitation robots. Hence, we propose a reinforcement-learning-based optimal admittance control (RLOAC) strategy for a cable-driven...

Descripción completa

Detalles Bibliográficos
Autores principales: Yang, Renyu, Zheng, Jianlin, Song, Rong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9813438/
https://www.ncbi.nlm.nih.gov/pubmed/36620486
http://dx.doi.org/10.3389/fnbot.2022.1068706
_version_ 1784863919969402880
author Yang, Renyu
Zheng, Jianlin
Song, Rong
author_facet Yang, Renyu
Zheng, Jianlin
Song, Rong
author_sort Yang, Renyu
collection PubMed
description Continuous mode adaptation is very important and useful to satisfy the different user rehabilitation needs and improve human–robot interaction (HRI) performance for rehabilitation robots. Hence, we propose a reinforcement-learning-based optimal admittance control (RLOAC) strategy for a cable-driven rehabilitation robot (CDRR), which can realize continuous mode adaptation between passive and active working mode. To obviate the requirement of the knowledge of human and robot dynamics model, a reinforcement learning algorithm was employed to obtain the optimal admittance parameters by minimizing a cost function composed of trajectory error and human voluntary force. Secondly, the contribution weights of the cost function were modulated according to the human voluntary force, which enabled the CDRR to achieve continuous mode adaptation between passive and active working mode. Finally, simulation and experiments were conducted with 10 subjects to investigate the feasibility and effectiveness of the RLOAC strategy. The experimental results indicated that the desired performances could be obtained; further, the tracking error and energy per unit distance of the RLOAC strategy were notably lower than those of the traditional admittance control method. The RLOAC strategy is effective in improving the tracking accuracy and robot compliance. Based on its performance, we believe that the proposed RLOAC strategy has potential for use in rehabilitation robots.
format Online
Article
Text
id pubmed-9813438
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-98134382023-01-06 Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning Yang, Renyu Zheng, Jianlin Song, Rong Front Neurorobot Neuroscience Continuous mode adaptation is very important and useful to satisfy the different user rehabilitation needs and improve human–robot interaction (HRI) performance for rehabilitation robots. Hence, we propose a reinforcement-learning-based optimal admittance control (RLOAC) strategy for a cable-driven rehabilitation robot (CDRR), which can realize continuous mode adaptation between passive and active working mode. To obviate the requirement of the knowledge of human and robot dynamics model, a reinforcement learning algorithm was employed to obtain the optimal admittance parameters by minimizing a cost function composed of trajectory error and human voluntary force. Secondly, the contribution weights of the cost function were modulated according to the human voluntary force, which enabled the CDRR to achieve continuous mode adaptation between passive and active working mode. Finally, simulation and experiments were conducted with 10 subjects to investigate the feasibility and effectiveness of the RLOAC strategy. The experimental results indicated that the desired performances could be obtained; further, the tracking error and energy per unit distance of the RLOAC strategy were notably lower than those of the traditional admittance control method. The RLOAC strategy is effective in improving the tracking accuracy and robot compliance. Based on its performance, we believe that the proposed RLOAC strategy has potential for use in rehabilitation robots. Frontiers Media S.A. 2022-12-22 /pmc/articles/PMC9813438/ /pubmed/36620486 http://dx.doi.org/10.3389/fnbot.2022.1068706 Text en Copyright © 2022 Yang, Zheng and Song. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Yang, Renyu
Zheng, Jianlin
Song, Rong
Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning
title Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning
title_full Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning
title_fullStr Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning
title_full_unstemmed Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning
title_short Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning
title_sort continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9813438/
https://www.ncbi.nlm.nih.gov/pubmed/36620486
http://dx.doi.org/10.3389/fnbot.2022.1068706
work_keys_str_mv AT yangrenyu continuousmodeadaptationforcabledrivenrehabilitationrobotusingreinforcementlearning
AT zhengjianlin continuousmodeadaptationforcabledrivenrehabilitationrobotusingreinforcementlearning
AT songrong continuousmodeadaptationforcabledrivenrehabilitationrobotusingreinforcementlearning