Cargando…
Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning
Wireless networks are trending towards large scale systems, containing thousands of nodes, with multiple co-existing applications. Congestion is an inevitable consequence of this scale and complexity, which leads to inefficient use of the network capacity. This paper proposes an autonomous and adapt...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8838395/ https://www.ncbi.nlm.nih.gov/pubmed/35161765 http://dx.doi.org/10.3390/s22031019 |
_version_ | 1784650116805689344 |
---|---|
author | Ivoghlian, Ameer Salcic, Zoran Wang, Kevin I-Kai |
author_facet | Ivoghlian, Ameer Salcic, Zoran Wang, Kevin I-Kai |
author_sort | Ivoghlian, Ameer |
collection | PubMed |
description | Wireless networks are trending towards large scale systems, containing thousands of nodes, with multiple co-existing applications. Congestion is an inevitable consequence of this scale and complexity, which leads to inefficient use of the network capacity. This paper proposes an autonomous and adaptive wireless network management framework, utilising multi-agent deep reinforcement learning, to achieve efficient use of the network. Its novel reward function incorporates application awareness and fairness to address both node and network level objectives. Our experimental results demonstrate the proposed approach’s ability to be optimised for application-specific requirements, while optimising the fairness of the network. The results reveal significant performance benefits in terms of adaptive data rate and an increase in responsiveness compared to a single-agent approach. Some significant qualitative benefits of the multi-agent approach—network size independence, node-led priorities, variable iteration length, and reduced search space—are also presented and discussed. |
format | Online Article Text |
id | pubmed-8838395 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-88383952022-02-13 Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning Ivoghlian, Ameer Salcic, Zoran Wang, Kevin I-Kai Sensors (Basel) Article Wireless networks are trending towards large scale systems, containing thousands of nodes, with multiple co-existing applications. Congestion is an inevitable consequence of this scale and complexity, which leads to inefficient use of the network capacity. This paper proposes an autonomous and adaptive wireless network management framework, utilising multi-agent deep reinforcement learning, to achieve efficient use of the network. Its novel reward function incorporates application awareness and fairness to address both node and network level objectives. Our experimental results demonstrate the proposed approach’s ability to be optimised for application-specific requirements, while optimising the fairness of the network. The results reveal significant performance benefits in terms of adaptive data rate and an increase in responsiveness compared to a single-agent approach. Some significant qualitative benefits of the multi-agent approach—network size independence, node-led priorities, variable iteration length, and reduced search space—are also presented and discussed. MDPI 2022-01-28 /pmc/articles/PMC8838395/ /pubmed/35161765 http://dx.doi.org/10.3390/s22031019 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Ivoghlian, Ameer Salcic, Zoran Wang, Kevin I-Kai Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning |
title | Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning |
title_full | Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning |
title_fullStr | Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning |
title_full_unstemmed | Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning |
title_short | Adaptive Wireless Network Management with Multi-Agent Reinforcement Learning |
title_sort | adaptive wireless network management with multi-agent reinforcement learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8838395/ https://www.ncbi.nlm.nih.gov/pubmed/35161765 http://dx.doi.org/10.3390/s22031019 |
work_keys_str_mv | AT ivoghlianameer adaptivewirelessnetworkmanagementwithmultiagentreinforcementlearning AT salciczoran adaptivewirelessnetworkmanagementwithmultiagentreinforcementlearning AT wangkevinikai adaptivewirelessnetworkmanagementwithmultiagentreinforcementlearning |