Cargando…

Overcoming Challenges of Applying Reinforcement Learning for Intelligent Vehicle Control

Reinforcement learning (RL) is a booming area in artificial intelligence. The applications of RL are endless nowadays, ranging from fields such as medicine or finance to manufacturing or the gaming industry. Although multiple works argue that RL can be key to a great part of intelligent vehicle cont...

Descripción completa

Detalles Bibliográficos
Autores principales: Pina, Rafael, Tibebu, Haileleol, Hook, Joosep, De Silva, Varuna, Kondoz, Ahmet
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8659501/
https://www.ncbi.nlm.nih.gov/pubmed/34883832
http://dx.doi.org/10.3390/s21237829
_version_ 1784612977523032064
author Pina, Rafael
Tibebu, Haileleol
Hook, Joosep
De Silva, Varuna
Kondoz, Ahmet
author_facet Pina, Rafael
Tibebu, Haileleol
Hook, Joosep
De Silva, Varuna
Kondoz, Ahmet
author_sort Pina, Rafael
collection PubMed
description Reinforcement learning (RL) is a booming area in artificial intelligence. The applications of RL are endless nowadays, ranging from fields such as medicine or finance to manufacturing or the gaming industry. Although multiple works argue that RL can be key to a great part of intelligent vehicle control related problems, there are many practical problems that need to be addressed, such as safety related problems that can result from non-optimal training in RL. For instance, for an RL agent to be effective it should first cover all the situations during training that it may face later. This is often difficult when applied to the real-world. In this work we investigate the impact of RL applied to the context of intelligent vehicle control. We analyse the implications of RL in path planning tasks and we discuss two possible approaches to overcome the gap between the theorical developments of RL and its practical applications. Specifically, firstly this paper discusses the role of Curriculum Learning (CL) to structure the learning process of intelligent vehicle control in a gradual way. The results show how CL can play an important role in training agents in such context. Secondly, we discuss a method of transferring RL policies from simulation to reality in order to make the agent experience situations in simulation, so it knows how to react to them in reality. For that, we use Arduino Yún controlled robots as our platforms. The results enhance the effectiveness of the presented approach and show how RL policies can be transferred from simulation to reality even when the platforms are resource limited.
format Online
Article
Text
id pubmed-8659501
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-86595012021-12-10 Overcoming Challenges of Applying Reinforcement Learning for Intelligent Vehicle Control Pina, Rafael Tibebu, Haileleol Hook, Joosep De Silva, Varuna Kondoz, Ahmet Sensors (Basel) Article Reinforcement learning (RL) is a booming area in artificial intelligence. The applications of RL are endless nowadays, ranging from fields such as medicine or finance to manufacturing or the gaming industry. Although multiple works argue that RL can be key to a great part of intelligent vehicle control related problems, there are many practical problems that need to be addressed, such as safety related problems that can result from non-optimal training in RL. For instance, for an RL agent to be effective it should first cover all the situations during training that it may face later. This is often difficult when applied to the real-world. In this work we investigate the impact of RL applied to the context of intelligent vehicle control. We analyse the implications of RL in path planning tasks and we discuss two possible approaches to overcome the gap between the theorical developments of RL and its practical applications. Specifically, firstly this paper discusses the role of Curriculum Learning (CL) to structure the learning process of intelligent vehicle control in a gradual way. The results show how CL can play an important role in training agents in such context. Secondly, we discuss a method of transferring RL policies from simulation to reality in order to make the agent experience situations in simulation, so it knows how to react to them in reality. For that, we use Arduino Yún controlled robots as our platforms. The results enhance the effectiveness of the presented approach and show how RL policies can be transferred from simulation to reality even when the platforms are resource limited. MDPI 2021-11-25 /pmc/articles/PMC8659501/ /pubmed/34883832 http://dx.doi.org/10.3390/s21237829 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Pina, Rafael
Tibebu, Haileleol
Hook, Joosep
De Silva, Varuna
Kondoz, Ahmet
Overcoming Challenges of Applying Reinforcement Learning for Intelligent Vehicle Control
title Overcoming Challenges of Applying Reinforcement Learning for Intelligent Vehicle Control
title_full Overcoming Challenges of Applying Reinforcement Learning for Intelligent Vehicle Control
title_fullStr Overcoming Challenges of Applying Reinforcement Learning for Intelligent Vehicle Control
title_full_unstemmed Overcoming Challenges of Applying Reinforcement Learning for Intelligent Vehicle Control
title_short Overcoming Challenges of Applying Reinforcement Learning for Intelligent Vehicle Control
title_sort overcoming challenges of applying reinforcement learning for intelligent vehicle control
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8659501/
https://www.ncbi.nlm.nih.gov/pubmed/34883832
http://dx.doi.org/10.3390/s21237829
work_keys_str_mv AT pinarafael overcomingchallengesofapplyingreinforcementlearningforintelligentvehiclecontrol
AT tibebuhaileleol overcomingchallengesofapplyingreinforcementlearningforintelligentvehiclecontrol
AT hookjoosep overcomingchallengesofapplyingreinforcementlearningforintelligentvehiclecontrol
AT desilvavaruna overcomingchallengesofapplyingreinforcementlearningforintelligentvehiclecontrol
AT kondozahmet overcomingchallengesofapplyingreinforcementlearningforintelligentvehiclecontrol