Cargando…

Improved reinforcement learning path planning algorithm integrating prior knowledge

In order to realize the optimization of autonomous navigation of mobile robot under the condition of partial environmental knowledge known. An improved Q-learning reinforcement learning algorithm based on prior knowledge is proposed to solve the problem of slow convergence and low learning efficienc...

Descripción completa

Detalles Bibliográficos
Autores principales: Shi, Zhen, Wang, Keyin, Zhang, Jianhui
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10159141/
https://www.ncbi.nlm.nih.gov/pubmed/37141236
http://dx.doi.org/10.1371/journal.pone.0284942
_version_ 1785037070661582848
author Shi, Zhen
Wang, Keyin
Zhang, Jianhui
author_facet Shi, Zhen
Wang, Keyin
Zhang, Jianhui
author_sort Shi, Zhen
collection PubMed
description In order to realize the optimization of autonomous navigation of mobile robot under the condition of partial environmental knowledge known. An improved Q-learning reinforcement learning algorithm based on prior knowledge is proposed to solve the problem of slow convergence and low learning efficiency in mobile robot path planning. Prior knowledge is used to initialize the Q-value, so as to guide the agent to move toward the target direction with a greater probability from the early stage of the algorithm, eliminating a large number of invalid iterations. The greedy factor ε is dynamically adjusted based on the number of times the agent successfully reaches the target position, so as to better balance exploration and exploitation and accelerate convergence. Simulation results show that the improved Q-learning algorithm has a faster convergence rate and higher learning efficiency than the traditional algorithm. The improved algorithm has practical significance for improving the efficiency of autonomous navigation of mobile robots.
format Online
Article
Text
id pubmed-10159141
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-101591412023-05-05 Improved reinforcement learning path planning algorithm integrating prior knowledge Shi, Zhen Wang, Keyin Zhang, Jianhui PLoS One Research Article In order to realize the optimization of autonomous navigation of mobile robot under the condition of partial environmental knowledge known. An improved Q-learning reinforcement learning algorithm based on prior knowledge is proposed to solve the problem of slow convergence and low learning efficiency in mobile robot path planning. Prior knowledge is used to initialize the Q-value, so as to guide the agent to move toward the target direction with a greater probability from the early stage of the algorithm, eliminating a large number of invalid iterations. The greedy factor ε is dynamically adjusted based on the number of times the agent successfully reaches the target position, so as to better balance exploration and exploitation and accelerate convergence. Simulation results show that the improved Q-learning algorithm has a faster convergence rate and higher learning efficiency than the traditional algorithm. The improved algorithm has practical significance for improving the efficiency of autonomous navigation of mobile robots. Public Library of Science 2023-05-04 /pmc/articles/PMC10159141/ /pubmed/37141236 http://dx.doi.org/10.1371/journal.pone.0284942 Text en © 2023 Shi et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Shi, Zhen
Wang, Keyin
Zhang, Jianhui
Improved reinforcement learning path planning algorithm integrating prior knowledge
title Improved reinforcement learning path planning algorithm integrating prior knowledge
title_full Improved reinforcement learning path planning algorithm integrating prior knowledge
title_fullStr Improved reinforcement learning path planning algorithm integrating prior knowledge
title_full_unstemmed Improved reinforcement learning path planning algorithm integrating prior knowledge
title_short Improved reinforcement learning path planning algorithm integrating prior knowledge
title_sort improved reinforcement learning path planning algorithm integrating prior knowledge
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10159141/
https://www.ncbi.nlm.nih.gov/pubmed/37141236
http://dx.doi.org/10.1371/journal.pone.0284942
work_keys_str_mv AT shizhen improvedreinforcementlearningpathplanningalgorithmintegratingpriorknowledge
AT wangkeyin improvedreinforcementlearningpathplanningalgorithmintegratingpriorknowledge
AT zhangjianhui improvedreinforcementlearningpathplanningalgorithmintegratingpriorknowledge