Cargando…

Explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management

With the objective to enhance human performance and maximize engagement during the performance of tasks, we aim to advance automation for decision making in complex and large-scale multi-agent settings. Towards these goals, this paper presents a deep multi agent reinforcement learning method for res...

Descripción completa

Detalles Bibliográficos
Autores principales: Kravaris, Theocharis, Lentzos, Konstantinos, Santipantakis, Georgios, Vouros, George A., Andrienko, Gennady, Andrienko, Natalia, Crook, Ian, Garcia, Jose Manuel Cordero, Martinez, Enrique Iglesias
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9169601/
https://www.ncbi.nlm.nih.gov/pubmed/35694685
http://dx.doi.org/10.1007/s10489-022-03605-1
_version_ 1784721236726644736
author Kravaris, Theocharis
Lentzos, Konstantinos
Santipantakis, Georgios
Vouros, George A.
Andrienko, Gennady
Andrienko, Natalia
Crook, Ian
Garcia, Jose Manuel Cordero
Martinez, Enrique Iglesias
author_facet Kravaris, Theocharis
Lentzos, Konstantinos
Santipantakis, Georgios
Vouros, George A.
Andrienko, Gennady
Andrienko, Natalia
Crook, Ian
Garcia, Jose Manuel Cordero
Martinez, Enrique Iglesias
author_sort Kravaris, Theocharis
collection PubMed
description With the objective to enhance human performance and maximize engagement during the performance of tasks, we aim to advance automation for decision making in complex and large-scale multi-agent settings. Towards these goals, this paper presents a deep multi agent reinforcement learning method for resolving demand - capacity imbalances in real-world Air Traffic Management settings with thousands of agents. Agents comprising the system are able to jointly decide on the measures to be applied to resolve imbalances, while they provide explanations on their decisions: This information is rendered and explored via appropriate visual analytics tools. The paper presents how major challenges of scalability and complexity are addressed, and provides results from evaluation tests that show the abilities of models to provide high-quality solutions and high-fidelity explanations.
format Online
Article
Text
id pubmed-9169601
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-91696012022-06-07 Explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management Kravaris, Theocharis Lentzos, Konstantinos Santipantakis, Georgios Vouros, George A. Andrienko, Gennady Andrienko, Natalia Crook, Ian Garcia, Jose Manuel Cordero Martinez, Enrique Iglesias Appl Intell (Dordr) Article With the objective to enhance human performance and maximize engagement during the performance of tasks, we aim to advance automation for decision making in complex and large-scale multi-agent settings. Towards these goals, this paper presents a deep multi agent reinforcement learning method for resolving demand - capacity imbalances in real-world Air Traffic Management settings with thousands of agents. Agents comprising the system are able to jointly decide on the measures to be applied to resolve imbalances, while they provide explanations on their decisions: This information is rendered and explored via appropriate visual analytics tools. The paper presents how major challenges of scalability and complexity are addressed, and provides results from evaluation tests that show the abilities of models to provide high-quality solutions and high-fidelity explanations. Springer US 2022-06-06 2023 /pmc/articles/PMC9169601/ /pubmed/35694685 http://dx.doi.org/10.1007/s10489-022-03605-1 Text en © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Kravaris, Theocharis
Lentzos, Konstantinos
Santipantakis, Georgios
Vouros, George A.
Andrienko, Gennady
Andrienko, Natalia
Crook, Ian
Garcia, Jose Manuel Cordero
Martinez, Enrique Iglesias
Explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management
title Explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management
title_full Explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management
title_fullStr Explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management
title_full_unstemmed Explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management
title_short Explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management
title_sort explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9169601/
https://www.ncbi.nlm.nih.gov/pubmed/35694685
http://dx.doi.org/10.1007/s10489-022-03605-1
work_keys_str_mv AT kravaristheocharis explainingdeepreinforcementlearningdecisionsincomplexmultiagentsettingstowardsenablingautomationinairtrafficflowmanagement
AT lentzoskonstantinos explainingdeepreinforcementlearningdecisionsincomplexmultiagentsettingstowardsenablingautomationinairtrafficflowmanagement
AT santipantakisgeorgios explainingdeepreinforcementlearningdecisionsincomplexmultiagentsettingstowardsenablingautomationinairtrafficflowmanagement
AT vourosgeorgea explainingdeepreinforcementlearningdecisionsincomplexmultiagentsettingstowardsenablingautomationinairtrafficflowmanagement
AT andrienkogennady explainingdeepreinforcementlearningdecisionsincomplexmultiagentsettingstowardsenablingautomationinairtrafficflowmanagement
AT andrienkonatalia explainingdeepreinforcementlearningdecisionsincomplexmultiagentsettingstowardsenablingautomationinairtrafficflowmanagement
AT crookian explainingdeepreinforcementlearningdecisionsincomplexmultiagentsettingstowardsenablingautomationinairtrafficflowmanagement
AT garciajosemanuelcordero explainingdeepreinforcementlearningdecisionsincomplexmultiagentsettingstowardsenablingautomationinairtrafficflowmanagement
AT martinezenriqueiglesias explainingdeepreinforcementlearningdecisionsincomplexmultiagentsettingstowardsenablingautomationinairtrafficflowmanagement