Cargando…

An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms

Aiming at the poor robustness and adaptability of traditional control methods for different situations, the deep deterministic policy gradient (DDPG) algorithm is improved by designing a hybrid function that includes different rewards superimposed on each other. In addition, the experience replay me...

Descripción completa

Detalles Bibliográficos
Autores principales: Dong, Ruyi, Du, Junjie, Liu, Yanan, Heidari, Ali Asghar, Chen, Huiling
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9899791/
https://www.ncbi.nlm.nih.gov/pubmed/36756212
http://dx.doi.org/10.3389/fninf.2023.1096053
_version_ 1784882707881263104
author Dong, Ruyi
Du, Junjie
Liu, Yanan
Heidari, Ali Asghar
Chen, Huiling
author_facet Dong, Ruyi
Du, Junjie
Liu, Yanan
Heidari, Ali Asghar
Chen, Huiling
author_sort Dong, Ruyi
collection PubMed
description Aiming at the poor robustness and adaptability of traditional control methods for different situations, the deep deterministic policy gradient (DDPG) algorithm is improved by designing a hybrid function that includes different rewards superimposed on each other. In addition, the experience replay mechanism of DDPG is also improved by combining priority sampling and uniform sampling to accelerate the DDPG’s convergence. Finally, it is verified in the simulation environment that the improved DDPG algorithm can achieve accurate control of the robot arm motion. The experimental results show that the improved DDPG algorithm can converge in a shorter time, and the average success rate in the robotic arm end-reaching task is as high as 91.27%. Compared with the original DDPG algorithm, it has more robust environmental adaptability.
format Online
Article
Text
id pubmed-9899791
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-98997912023-02-07 An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms Dong, Ruyi Du, Junjie Liu, Yanan Heidari, Ali Asghar Chen, Huiling Front Neuroinform Neuroscience Aiming at the poor robustness and adaptability of traditional control methods for different situations, the deep deterministic policy gradient (DDPG) algorithm is improved by designing a hybrid function that includes different rewards superimposed on each other. In addition, the experience replay mechanism of DDPG is also improved by combining priority sampling and uniform sampling to accelerate the DDPG’s convergence. Finally, it is verified in the simulation environment that the improved DDPG algorithm can achieve accurate control of the robot arm motion. The experimental results show that the improved DDPG algorithm can converge in a shorter time, and the average success rate in the robotic arm end-reaching task is as high as 91.27%. Compared with the original DDPG algorithm, it has more robust environmental adaptability. Frontiers Media S.A. 2023-01-23 /pmc/articles/PMC9899791/ /pubmed/36756212 http://dx.doi.org/10.3389/fninf.2023.1096053 Text en Copyright © 2023 Dong, Du, Liu, Heidari and Chen. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Dong, Ruyi
Du, Junjie
Liu, Yanan
Heidari, Ali Asghar
Chen, Huiling
An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms
title An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms
title_full An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms
title_fullStr An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms
title_full_unstemmed An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms
title_short An enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms
title_sort enhanced deep deterministic policy gradient algorithm for intelligent control of robotic arms
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9899791/
https://www.ncbi.nlm.nih.gov/pubmed/36756212
http://dx.doi.org/10.3389/fninf.2023.1096053
work_keys_str_mv AT dongruyi anenhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms
AT dujunjie anenhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms
AT liuyanan anenhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms
AT heidarialiasghar anenhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms
AT chenhuiling anenhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms
AT dongruyi enhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms
AT dujunjie enhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms
AT liuyanan enhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms
AT heidarialiasghar enhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms
AT chenhuiling enhanceddeepdeterministicpolicygradientalgorithmforintelligentcontrolofroboticarms