Cargando…
Improved reinforcement learning path planning algorithm integrating prior knowledge
In order to realize the optimization of autonomous navigation of mobile robot under the condition of partial environmental knowledge known. An improved Q-learning reinforcement learning algorithm based on prior knowledge is proposed to solve the problem of slow convergence and low learning efficienc...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10159141/ https://www.ncbi.nlm.nih.gov/pubmed/37141236 http://dx.doi.org/10.1371/journal.pone.0284942 |
_version_ | 1785037070661582848 |
---|---|
author | Shi, Zhen Wang, Keyin Zhang, Jianhui |
author_facet | Shi, Zhen Wang, Keyin Zhang, Jianhui |
author_sort | Shi, Zhen |
collection | PubMed |
description | In order to realize the optimization of autonomous navigation of mobile robot under the condition of partial environmental knowledge known. An improved Q-learning reinforcement learning algorithm based on prior knowledge is proposed to solve the problem of slow convergence and low learning efficiency in mobile robot path planning. Prior knowledge is used to initialize the Q-value, so as to guide the agent to move toward the target direction with a greater probability from the early stage of the algorithm, eliminating a large number of invalid iterations. The greedy factor ε is dynamically adjusted based on the number of times the agent successfully reaches the target position, so as to better balance exploration and exploitation and accelerate convergence. Simulation results show that the improved Q-learning algorithm has a faster convergence rate and higher learning efficiency than the traditional algorithm. The improved algorithm has practical significance for improving the efficiency of autonomous navigation of mobile robots. |
format | Online Article Text |
id | pubmed-10159141 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-101591412023-05-05 Improved reinforcement learning path planning algorithm integrating prior knowledge Shi, Zhen Wang, Keyin Zhang, Jianhui PLoS One Research Article In order to realize the optimization of autonomous navigation of mobile robot under the condition of partial environmental knowledge known. An improved Q-learning reinforcement learning algorithm based on prior knowledge is proposed to solve the problem of slow convergence and low learning efficiency in mobile robot path planning. Prior knowledge is used to initialize the Q-value, so as to guide the agent to move toward the target direction with a greater probability from the early stage of the algorithm, eliminating a large number of invalid iterations. The greedy factor ε is dynamically adjusted based on the number of times the agent successfully reaches the target position, so as to better balance exploration and exploitation and accelerate convergence. Simulation results show that the improved Q-learning algorithm has a faster convergence rate and higher learning efficiency than the traditional algorithm. The improved algorithm has practical significance for improving the efficiency of autonomous navigation of mobile robots. Public Library of Science 2023-05-04 /pmc/articles/PMC10159141/ /pubmed/37141236 http://dx.doi.org/10.1371/journal.pone.0284942 Text en © 2023 Shi et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Shi, Zhen Wang, Keyin Zhang, Jianhui Improved reinforcement learning path planning algorithm integrating prior knowledge |
title | Improved reinforcement learning path planning algorithm integrating prior knowledge |
title_full | Improved reinforcement learning path planning algorithm integrating prior knowledge |
title_fullStr | Improved reinforcement learning path planning algorithm integrating prior knowledge |
title_full_unstemmed | Improved reinforcement learning path planning algorithm integrating prior knowledge |
title_short | Improved reinforcement learning path planning algorithm integrating prior knowledge |
title_sort | improved reinforcement learning path planning algorithm integrating prior knowledge |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10159141/ https://www.ncbi.nlm.nih.gov/pubmed/37141236 http://dx.doi.org/10.1371/journal.pone.0284942 |
work_keys_str_mv | AT shizhen improvedreinforcementlearningpathplanningalgorithmintegratingpriorknowledge AT wangkeyin improvedreinforcementlearningpathplanningalgorithmintegratingpriorknowledge AT zhangjianhui improvedreinforcementlearningpathplanningalgorithmintegratingpriorknowledge |