Cargando…
An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms
Aiming at the poor robustness and adaptability of traditional control methods for different situations, the deep deterministic policy gradient (DDPG) algorithm is improved by designing a hybrid function that includes different rewards superimposed on each other. In addition, the experience replay me...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9899791/ https://www.ncbi.nlm.nih.gov/pubmed/36756212 http://dx.doi.org/10.3389/fninf.2023.1096053 |
_version_ | 1784882707881263104 |
---|---|
author | Dong, Ruyi Du, Junjie Liu, Yanan Heidari, Ali Asghar Chen, Huiling |
author_facet | Dong, Ruyi Du, Junjie Liu, Yanan Heidari, Ali Asghar Chen, Huiling |
author_sort | Dong, Ruyi |
collection | PubMed |
description | Aiming at the poor robustness and adaptability of traditional control methods for different situations, the deep deterministic policy gradient (DDPG) algorithm is improved by designing a hybrid function that includes different rewards superimposed on each other. In addition, the experience replay mechanism of DDPG is also improved by combining priority sampling and uniform sampling to accelerate the DDPG’s convergence. Finally, it is verified in the simulation environment that the improved DDPG algorithm can achieve accurate control of the robot arm motion. The experimental results show that the improved DDPG algorithm can converge in a shorter time, and the average success rate in the robotic arm end-reaching task is as high as 91.27%. Compared with the original DDPG algorithm, it has more robust environmental adaptability. |
format | Online Article Text |
id | pubmed-9899791 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-98997912023-02-07 An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms Dong, Ruyi Du, Junjie Liu, Yanan Heidari, Ali Asghar Chen, Huiling Front Neuroinform Neuroscience Aiming at the poor robustness and adaptability of traditional control methods for different situations, the deep deterministic policy gradient (DDPG) algorithm is improved by designing a hybrid function that includes different rewards superimposed on each other. In addition, the experience replay mechanism of DDPG is also improved by combining priority sampling and uniform sampling to accelerate the DDPG’s convergence. Finally, it is verified in the simulation environment that the improved DDPG algorithm can achieve accurate control of the robot arm motion. The experimental results show that the improved DDPG algorithm can converge in a shorter time, and the average success rate in the robotic arm end-reaching task is as high as 91.27%. Compared with the original DDPG algorithm, it has more robust environmental adaptability. Frontiers Media S.A. 2023-01-23 /pmc/articles/PMC9899791/ /pubmed/36756212 http://dx.doi.org/10.3389/fninf.2023.1096053 Text en Copyright © 2023 Dong, Du, Liu, Heidari and Chen. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Dong, Ruyi Du, Junjie Liu, Yanan Heidari, Ali Asghar Chen, Huiling An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms |
title | An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms |
title_full | An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms |
title_fullStr | An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms |
title_full_unstemmed | An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms |
title_short | An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms |
title_sort | enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9899791/ https://www.ncbi.nlm.nih.gov/pubmed/36756212 http://dx.doi.org/10.3389/fninf.2023.1096053 |
work_keys_str_mv | AT dongruyi anenhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms AT dujunjie anenhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms AT liuyanan anenhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms AT heidarialiasghar anenhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms AT chenhuiling anenhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms AT dongruyi enhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms AT dujunjie enhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms AT liuyanan enhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms AT heidarialiasghar enhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms AT chenhuiling enhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms |