Cargando…

Reinforcement learning-based dynamic obstacle avoidance and integration of path planning

Deep reinforcement learning has the advantage of being able to encode fairly complex behaviors by collecting and learning empirical information. In the current study, we have proposed a framework for reinforcement learning in decentralized collision avoidance where each agent independently makes its...

Descripción completa

Detalles Bibliográficos
Autores principales: Choi, Jaewan, Lee, Geonhee, Lee, Chibum
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Berlin Heidelberg 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8493784/
https://www.ncbi.nlm.nih.gov/pubmed/34642589
http://dx.doi.org/10.1007/s11370-021-00387-2
_version_ 1784579187854540800
author Choi, Jaewan
Lee, Geonhee
Lee, Chibum
author_facet Choi, Jaewan
Lee, Geonhee
Lee, Chibum
author_sort Choi, Jaewan
collection PubMed
description Deep reinforcement learning has the advantage of being able to encode fairly complex behaviors by collecting and learning empirical information. In the current study, we have proposed a framework for reinforcement learning in decentralized collision avoidance where each agent independently makes its decision without communication with others. In an environment exposed to various kinds of dynamic obstacles with irregular movements, mobile robot agents could learn how to avoid obstacles and reach a target point efficiently. Moreover, a path planner was integrated with the reinforcement learning-based obstacle avoidance to solve the problem of not finding a path in a specific situation, thereby imposing path efficiency. The robots were trained about the policy of obstacle avoidance in environments where dynamic characteristics were considered with soft actor critic algorithm. The trained policy was implemented in the robot operating system (ROS), tested in virtual and real environments for the differential drive wheel robot to prove the effectiveness of the proposed method. Videos are available at https://youtu.be/xxzoh1XbAl0.
format Online
Article
Text
id pubmed-8493784
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Springer Berlin Heidelberg
record_format MEDLINE/PubMed
spelling pubmed-84937842021-10-08 Reinforcement learning-based dynamic obstacle avoidance and integration of path planning Choi, Jaewan Lee, Geonhee Lee, Chibum Intell Serv Robot Original Research Paper Deep reinforcement learning has the advantage of being able to encode fairly complex behaviors by collecting and learning empirical information. In the current study, we have proposed a framework for reinforcement learning in decentralized collision avoidance where each agent independently makes its decision without communication with others. In an environment exposed to various kinds of dynamic obstacles with irregular movements, mobile robot agents could learn how to avoid obstacles and reach a target point efficiently. Moreover, a path planner was integrated with the reinforcement learning-based obstacle avoidance to solve the problem of not finding a path in a specific situation, thereby imposing path efficiency. The robots were trained about the policy of obstacle avoidance in environments where dynamic characteristics were considered with soft actor critic algorithm. The trained policy was implemented in the robot operating system (ROS), tested in virtual and real environments for the differential drive wheel robot to prove the effectiveness of the proposed method. Videos are available at https://youtu.be/xxzoh1XbAl0. Springer Berlin Heidelberg 2021-10-06 2021 /pmc/articles/PMC8493784/ /pubmed/34642589 http://dx.doi.org/10.1007/s11370-021-00387-2 Text en © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2021 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Original Research Paper
Choi, Jaewan
Lee, Geonhee
Lee, Chibum
Reinforcement learning-based dynamic obstacle avoidance and integration of path planning
title Reinforcement learning-based dynamic obstacle avoidance and integration of path planning
title_full Reinforcement learning-based dynamic obstacle avoidance and integration of path planning
title_fullStr Reinforcement learning-based dynamic obstacle avoidance and integration of path planning
title_full_unstemmed Reinforcement learning-based dynamic obstacle avoidance and integration of path planning
title_short Reinforcement learning-based dynamic obstacle avoidance and integration of path planning
title_sort reinforcement learning-based dynamic obstacle avoidance and integration of path planning
topic Original Research Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8493784/
https://www.ncbi.nlm.nih.gov/pubmed/34642589
http://dx.doi.org/10.1007/s11370-021-00387-2
work_keys_str_mv AT choijaewan reinforcementlearningbaseddynamicobstacleavoidanceandintegrationofpathplanning
AT leegeonhee reinforcementlearningbaseddynamicobstacleavoidanceandintegrationofpathplanning
AT leechibum reinforcementlearningbaseddynamicobstacleavoidanceandintegrationofpathplanning