Cargando…
Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning
Continuous mode adaptation is very important and useful to satisfy the different user rehabilitation needs and improve human–robot interaction (HRI) performance for rehabilitation robots. Hence, we propose a reinforcement-learning-based optimal admittance control (RLOAC) strategy for a cable-driven...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9813438/ https://www.ncbi.nlm.nih.gov/pubmed/36620486 http://dx.doi.org/10.3389/fnbot.2022.1068706 |
_version_ | 1784863919969402880 |
---|---|
author | Yang, Renyu Zheng, Jianlin Song, Rong |
author_facet | Yang, Renyu Zheng, Jianlin Song, Rong |
author_sort | Yang, Renyu |
collection | PubMed |
description | Continuous mode adaptation is very important and useful to satisfy the different user rehabilitation needs and improve human–robot interaction (HRI) performance for rehabilitation robots. Hence, we propose a reinforcement-learning-based optimal admittance control (RLOAC) strategy for a cable-driven rehabilitation robot (CDRR), which can realize continuous mode adaptation between passive and active working mode. To obviate the requirement of the knowledge of human and robot dynamics model, a reinforcement learning algorithm was employed to obtain the optimal admittance parameters by minimizing a cost function composed of trajectory error and human voluntary force. Secondly, the contribution weights of the cost function were modulated according to the human voluntary force, which enabled the CDRR to achieve continuous mode adaptation between passive and active working mode. Finally, simulation and experiments were conducted with 10 subjects to investigate the feasibility and effectiveness of the RLOAC strategy. The experimental results indicated that the desired performances could be obtained; further, the tracking error and energy per unit distance of the RLOAC strategy were notably lower than those of the traditional admittance control method. The RLOAC strategy is effective in improving the tracking accuracy and robot compliance. Based on its performance, we believe that the proposed RLOAC strategy has potential for use in rehabilitation robots. |
format | Online Article Text |
id | pubmed-9813438 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-98134382023-01-06 Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning Yang, Renyu Zheng, Jianlin Song, Rong Front Neurorobot Neuroscience Continuous mode adaptation is very important and useful to satisfy the different user rehabilitation needs and improve human–robot interaction (HRI) performance for rehabilitation robots. Hence, we propose a reinforcement-learning-based optimal admittance control (RLOAC) strategy for a cable-driven rehabilitation robot (CDRR), which can realize continuous mode adaptation between passive and active working mode. To obviate the requirement of the knowledge of human and robot dynamics model, a reinforcement learning algorithm was employed to obtain the optimal admittance parameters by minimizing a cost function composed of trajectory error and human voluntary force. Secondly, the contribution weights of the cost function were modulated according to the human voluntary force, which enabled the CDRR to achieve continuous mode adaptation between passive and active working mode. Finally, simulation and experiments were conducted with 10 subjects to investigate the feasibility and effectiveness of the RLOAC strategy. The experimental results indicated that the desired performances could be obtained; further, the tracking error and energy per unit distance of the RLOAC strategy were notably lower than those of the traditional admittance control method. The RLOAC strategy is effective in improving the tracking accuracy and robot compliance. Based on its performance, we believe that the proposed RLOAC strategy has potential for use in rehabilitation robots. Frontiers Media S.A. 2022-12-22 /pmc/articles/PMC9813438/ /pubmed/36620486 http://dx.doi.org/10.3389/fnbot.2022.1068706 Text en Copyright © 2022 Yang, Zheng and Song. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Yang, Renyu Zheng, Jianlin Song, Rong Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning |
title | Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning |
title_full | Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning |
title_fullStr | Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning |
title_full_unstemmed | Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning |
title_short | Continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning |
title_sort | continuous mode adaptation for cable-driven rehabilitation robot using reinforcement learning |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9813438/ https://www.ncbi.nlm.nih.gov/pubmed/36620486 http://dx.doi.org/10.3389/fnbot.2022.1068706 |
work_keys_str_mv | AT yangrenyu continuousmodeadaptationforcabledrivenrehabilitationrobotusingreinforcementlearning AT zhengjianlin continuousmodeadaptationforcabledrivenrehabilitationrobotusingreinforcementlearning AT songrong continuousmodeadaptationforcabledrivenrehabilitationrobotusingreinforcementlearning |