Cargando…

Sharing diverse information gets driver agents to learn faster: an application in en route trip building

With the increase in the use of private transportation, developing more efficient ways to distribute routes in a traffic network has become more and more important. Several attempts to address this issue have already been proposed, either by using a central authority to assign routes to the vehicles...

Descripción completa

Detalles Bibliográficos
Autores principales: dos Santos, Guilherme Dytz, Bazzan, Ana L.C.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: PeerJ Inc. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8022632/
https://www.ncbi.nlm.nih.gov/pubmed/33834104
http://dx.doi.org/10.7717/peerj-cs.428
_version_ 1783674971852111872
author dos Santos, Guilherme Dytz
Bazzan, Ana L.C.
author_facet dos Santos, Guilherme Dytz
Bazzan, Ana L.C.
author_sort dos Santos, Guilherme Dytz
collection PubMed
description With the increase in the use of private transportation, developing more efficient ways to distribute routes in a traffic network has become more and more important. Several attempts to address this issue have already been proposed, either by using a central authority to assign routes to the vehicles, or by means of a learning process where drivers select their best routes based on their previous experiences. The present work addresses a way to connect reinforcement learning to new technologies such as car-to-infrastructure communication in order to augment the drivers knowledge in an attempt to accelerate the learning process. Our method was compared to both a classical, iterative approach, as well as to standard reinforcement learning without communication. Results show that our method outperforms both of them. Further, we have performed robustness tests, by allowing messages to be lost, and by reducing the storage capacity of the communication devices. We were able to show that our method is not only tolerant to information loss, but also points out to improved performance when not all agents get the same information. Hence, we stress the fact that, before deploying communication in urban scenarios, it is necessary to take into consideration that the quality and diversity of information shared are key aspects.
format Online
Article
Text
id pubmed-8022632
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher PeerJ Inc.
record_format MEDLINE/PubMed
spelling pubmed-80226322021-04-07 Sharing diverse information gets driver agents to learn faster: an application in en route trip building dos Santos, Guilherme Dytz Bazzan, Ana L.C. PeerJ Comput Sci Agents and Multi-Agent Systems With the increase in the use of private transportation, developing more efficient ways to distribute routes in a traffic network has become more and more important. Several attempts to address this issue have already been proposed, either by using a central authority to assign routes to the vehicles, or by means of a learning process where drivers select their best routes based on their previous experiences. The present work addresses a way to connect reinforcement learning to new technologies such as car-to-infrastructure communication in order to augment the drivers knowledge in an attempt to accelerate the learning process. Our method was compared to both a classical, iterative approach, as well as to standard reinforcement learning without communication. Results show that our method outperforms both of them. Further, we have performed robustness tests, by allowing messages to be lost, and by reducing the storage capacity of the communication devices. We were able to show that our method is not only tolerant to information loss, but also points out to improved performance when not all agents get the same information. Hence, we stress the fact that, before deploying communication in urban scenarios, it is necessary to take into consideration that the quality and diversity of information shared are key aspects. PeerJ Inc. 2021-03-16 /pmc/articles/PMC8022632/ /pubmed/33834104 http://dx.doi.org/10.7717/peerj-cs.428 Text en © 2021 dos Santos and Bazzan https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited.
spellingShingle Agents and Multi-Agent Systems
dos Santos, Guilherme Dytz
Bazzan, Ana L.C.
Sharing diverse information gets driver agents to learn faster: an application in en route trip building
title Sharing diverse information gets driver agents to learn faster: an application in en route trip building
title_full Sharing diverse information gets driver agents to learn faster: an application in en route trip building
title_fullStr Sharing diverse information gets driver agents to learn faster: an application in en route trip building
title_full_unstemmed Sharing diverse information gets driver agents to learn faster: an application in en route trip building
title_short Sharing diverse information gets driver agents to learn faster: an application in en route trip building
title_sort sharing diverse information gets driver agents to learn faster: an application in en route trip building
topic Agents and Multi-Agent Systems
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8022632/
https://www.ncbi.nlm.nih.gov/pubmed/33834104
http://dx.doi.org/10.7717/peerj-cs.428
work_keys_str_mv AT dossantosguilhermedytz sharingdiverseinformationgetsdriveragentstolearnfasteranapplicationinenroutetripbuilding
AT bazzananalc sharingdiverseinformationgetsdriveragentstolearnfasteranapplicationinenroutetripbuilding