Cargando…
Reinforcement learning-based dynamic obstacle avoidance and integration of path planning
Deep reinforcement learning has the advantage of being able to encode fairly complex behaviors by collecting and learning empirical information. In the current study, we have proposed a framework for reinforcement learning in decentralized collision avoidance where each agent independently makes its...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer Berlin Heidelberg
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8493784/ https://www.ncbi.nlm.nih.gov/pubmed/34642589 http://dx.doi.org/10.1007/s11370-021-00387-2 |
_version_ | 1784579187854540800 |
---|---|
author | Choi, Jaewan Lee, Geonhee Lee, Chibum |
author_facet | Choi, Jaewan Lee, Geonhee Lee, Chibum |
author_sort | Choi, Jaewan |
collection | PubMed |
description | Deep reinforcement learning has the advantage of being able to encode fairly complex behaviors by collecting and learning empirical information. In the current study, we have proposed a framework for reinforcement learning in decentralized collision avoidance where each agent independently makes its decision without communication with others. In an environment exposed to various kinds of dynamic obstacles with irregular movements, mobile robot agents could learn how to avoid obstacles and reach a target point efficiently. Moreover, a path planner was integrated with the reinforcement learning-based obstacle avoidance to solve the problem of not finding a path in a specific situation, thereby imposing path efficiency. The robots were trained about the policy of obstacle avoidance in environments where dynamic characteristics were considered with soft actor critic algorithm. The trained policy was implemented in the robot operating system (ROS), tested in virtual and real environments for the differential drive wheel robot to prove the effectiveness of the proposed method. Videos are available at https://youtu.be/xxzoh1XbAl0. |
format | Online Article Text |
id | pubmed-8493784 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Springer Berlin Heidelberg |
record_format | MEDLINE/PubMed |
spelling | pubmed-84937842021-10-08 Reinforcement learning-based dynamic obstacle avoidance and integration of path planning Choi, Jaewan Lee, Geonhee Lee, Chibum Intell Serv Robot Original Research Paper Deep reinforcement learning has the advantage of being able to encode fairly complex behaviors by collecting and learning empirical information. In the current study, we have proposed a framework for reinforcement learning in decentralized collision avoidance where each agent independently makes its decision without communication with others. In an environment exposed to various kinds of dynamic obstacles with irregular movements, mobile robot agents could learn how to avoid obstacles and reach a target point efficiently. Moreover, a path planner was integrated with the reinforcement learning-based obstacle avoidance to solve the problem of not finding a path in a specific situation, thereby imposing path efficiency. The robots were trained about the policy of obstacle avoidance in environments where dynamic characteristics were considered with soft actor critic algorithm. The trained policy was implemented in the robot operating system (ROS), tested in virtual and real environments for the differential drive wheel robot to prove the effectiveness of the proposed method. Videos are available at https://youtu.be/xxzoh1XbAl0. Springer Berlin Heidelberg 2021-10-06 2021 /pmc/articles/PMC8493784/ /pubmed/34642589 http://dx.doi.org/10.1007/s11370-021-00387-2 Text en © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2021 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Original Research Paper Choi, Jaewan Lee, Geonhee Lee, Chibum Reinforcement learning-based dynamic obstacle avoidance and integration of path planning |
title | Reinforcement learning-based dynamic obstacle avoidance and integration of path planning |
title_full | Reinforcement learning-based dynamic obstacle avoidance and integration of path planning |
title_fullStr | Reinforcement learning-based dynamic obstacle avoidance and integration of path planning |
title_full_unstemmed | Reinforcement learning-based dynamic obstacle avoidance and integration of path planning |
title_short | Reinforcement learning-based dynamic obstacle avoidance and integration of path planning |
title_sort | reinforcement learning-based dynamic obstacle avoidance and integration of path planning |
topic | Original Research Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8493784/ https://www.ncbi.nlm.nih.gov/pubmed/34642589 http://dx.doi.org/10.1007/s11370-021-00387-2 |
work_keys_str_mv | AT choijaewan reinforcementlearningbaseddynamicobstacleavoidanceandintegrationofpathplanning AT leegeonhee reinforcementlearningbaseddynamicobstacleavoidanceandintegrationofpathplanning AT leechibum reinforcementlearningbaseddynamicobstacleavoidanceandintegrationofpathplanning |