Cargando…

Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning

Wireless networks are trending towards large scale systems, containing thousands of nodes, with multiple co-existing applications. Congestion is an inevitable consequence of this scale and complexity, which leads to inefficient use of the network capacity. This paper proposes an autonomous and adapt...

Descripción completa

Detalles Bibliográficos
Autores principales: Ivoghlian, Ameer, Salcic, Zoran, Wang, Kevin I-Kai
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8838395/
https://www.ncbi.nlm.nih.gov/pubmed/35161765
http://dx.doi.org/10.3390/s22031019
_version_ 1784650116805689344
author Ivoghlian, Ameer
Salcic, Zoran
Wang, Kevin I-Kai
author_facet Ivoghlian, Ameer
Salcic, Zoran
Wang, Kevin I-Kai
author_sort Ivoghlian, Ameer
collection PubMed
description Wireless networks are trending towards large scale systems, containing thousands of nodes, with multiple co-existing applications. Congestion is an inevitable consequence of this scale and complexity, which leads to inefficient use of the network capacity. This paper proposes an autonomous and adaptive wireless network management framework, utilising multi-agent deep reinforcement learning, to achieve efficient use of the network. Its novel reward function incorporates application awareness and fairness to address both node and network level objectives. Our experimental results demonstrate the proposed approach’s ability to be optimised for application-specific requirements, while optimising the fairness of the network. The results reveal significant performance benefits in terms of adaptive data rate and an increase in responsiveness compared to a single-agent approach. Some significant qualitative benefits of the multi-agent approach—network size independence, node-led priorities, variable iteration length, and reduced search space—are also presented and discussed.
format Online
Article
Text
id pubmed-8838395
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-88383952022-02-13 Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning Ivoghlian, Ameer Salcic, Zoran Wang, Kevin I-Kai Sensors (Basel) Article Wireless networks are trending towards large scale systems, containing thousands of nodes, with multiple co-existing applications. Congestion is an inevitable consequence of this scale and complexity, which leads to inefficient use of the network capacity. This paper proposes an autonomous and adaptive wireless network management framework, utilising multi-agent deep reinforcement learning, to achieve efficient use of the network. Its novel reward function incorporates application awareness and fairness to address both node and network level objectives. Our experimental results demonstrate the proposed approach’s ability to be optimised for application-specific requirements, while optimising the fairness of the network. The results reveal significant performance benefits in terms of adaptive data rate and an increase in responsiveness compared to a single-agent approach. Some significant qualitative benefits of the multi-agent approach—network size independence, node-led priorities, variable iteration length, and reduced search space—are also presented and discussed. MDPI 2022-01-28 /pmc/articles/PMC8838395/ /pubmed/35161765 http://dx.doi.org/10.3390/s22031019 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Ivoghlian, Ameer
Salcic, Zoran
Wang, Kevin I-Kai
Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning
title Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning
title_full Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning
title_fullStr Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning
title_full_unstemmed Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning
title_short Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning
title_sort adaptive wireless network management with multi-agent reinforcement learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8838395/
https://www.ncbi.nlm.nih.gov/pubmed/35161765
http://dx.doi.org/10.3390/s22031019
work_keys_str_mv AT ivoghlianameer adaptivewirelessnetworkmanagementwithmultiagentreinforcementlearning
AT salciczoran adaptivewirelessnetworkmanagementwithmultiagentreinforcementlearning
AT wangkevinikai adaptivewirelessnetworkmanagementwithmultiagentreinforcementlearning