Cargando…

Enhancing Handover for 5G mmWave Mobile Networks Using Jump Markov Linear System and Deep Reinforcement Learning

The Fifth Generation (5G) mobile networks use millimeter waves (mmWaves) to offer gigabit data rates. However, unlike microwaves, mmWave links are prone to user and topographic dynamics. They easily get blocked and end up forming irregular cell patterns for 5G. This in turn causes too early, too lat...

Descripción completa

Detalles Bibliográficos
Autores principales: Chiputa, Masoto, Zhang, Minglong, Ali, G. G. Md. Nawaz, Chong, Peter Han Joo, Sabit, Hakilo, Kumar, Arun, Li, Hui
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8838663/
https://www.ncbi.nlm.nih.gov/pubmed/35161492
http://dx.doi.org/10.3390/s22030746
_version_ 1784650181718835200
author Chiputa, Masoto
Zhang, Minglong
Ali, G. G. Md. Nawaz
Chong, Peter Han Joo
Sabit, Hakilo
Kumar, Arun
Li, Hui
author_facet Chiputa, Masoto
Zhang, Minglong
Ali, G. G. Md. Nawaz
Chong, Peter Han Joo
Sabit, Hakilo
Kumar, Arun
Li, Hui
author_sort Chiputa, Masoto
collection PubMed
description The Fifth Generation (5G) mobile networks use millimeter waves (mmWaves) to offer gigabit data rates. However, unlike microwaves, mmWave links are prone to user and topographic dynamics. They easily get blocked and end up forming irregular cell patterns for 5G. This in turn causes too early, too late, or wrong handoffs (HOs). To mitigate HO challenges, sustain connectivity, and avert unnecessary HO, we propose an HO scheme based on a jump Markov linear system (JMLS) and deep reinforcement learning (DRL). JMLS is widely known to account for abrupt changes in system dynamics. DRL likewise emerges as an artificial intelligence technique for learning highly dimensional and time-varying behaviors. We combine the two techniques to account for time-varying, abrupt, and irregular changes in mmWave link behavior by predicting likely deterioration patterns of target links. The prediction is optimized by meta training techniques that also reduce training sample size. Thus, the JMLS–DRL platform formulates intelligent and versatile HO policies for 5G. When compared to a signal and interference noise ratio (SINR) and DRL-based HO scheme, our HO scheme becomes more reliable in selecting reliable target links. In particular, our proposed scheme is able to reduce wasteful HO to less than 5% within 200 training episodes compared to the DRL-based HO scheme that needs more than 200 training episodes to get to less than 5%. It supports longer dew time between HOs and high sum rates by ably averting unnecessary HOs with almost half the HOs compared to a DRL-based HO scheme.
format Online
Article
Text
id pubmed-8838663
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-88386632022-02-13 Enhancing Handover for 5G mmWave Mobile Networks Using Jump Markov Linear System and Deep Reinforcement Learning Chiputa, Masoto Zhang, Minglong Ali, G. G. Md. Nawaz Chong, Peter Han Joo Sabit, Hakilo Kumar, Arun Li, Hui Sensors (Basel) Article The Fifth Generation (5G) mobile networks use millimeter waves (mmWaves) to offer gigabit data rates. However, unlike microwaves, mmWave links are prone to user and topographic dynamics. They easily get blocked and end up forming irregular cell patterns for 5G. This in turn causes too early, too late, or wrong handoffs (HOs). To mitigate HO challenges, sustain connectivity, and avert unnecessary HO, we propose an HO scheme based on a jump Markov linear system (JMLS) and deep reinforcement learning (DRL). JMLS is widely known to account for abrupt changes in system dynamics. DRL likewise emerges as an artificial intelligence technique for learning highly dimensional and time-varying behaviors. We combine the two techniques to account for time-varying, abrupt, and irregular changes in mmWave link behavior by predicting likely deterioration patterns of target links. The prediction is optimized by meta training techniques that also reduce training sample size. Thus, the JMLS–DRL platform formulates intelligent and versatile HO policies for 5G. When compared to a signal and interference noise ratio (SINR) and DRL-based HO scheme, our HO scheme becomes more reliable in selecting reliable target links. In particular, our proposed scheme is able to reduce wasteful HO to less than 5% within 200 training episodes compared to the DRL-based HO scheme that needs more than 200 training episodes to get to less than 5%. It supports longer dew time between HOs and high sum rates by ably averting unnecessary HOs with almost half the HOs compared to a DRL-based HO scheme. MDPI 2022-01-19 /pmc/articles/PMC8838663/ /pubmed/35161492 http://dx.doi.org/10.3390/s22030746 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Chiputa, Masoto
Zhang, Minglong
Ali, G. G. Md. Nawaz
Chong, Peter Han Joo
Sabit, Hakilo
Kumar, Arun
Li, Hui
Enhancing Handover for 5G mmWave Mobile Networks Using Jump Markov Linear System and Deep Reinforcement Learning
title Enhancing Handover for 5G mmWave Mobile Networks Using Jump Markov Linear System and Deep Reinforcement Learning
title_full Enhancing Handover for 5G mmWave Mobile Networks Using Jump Markov Linear System and Deep Reinforcement Learning
title_fullStr Enhancing Handover for 5G mmWave Mobile Networks Using Jump Markov Linear System and Deep Reinforcement Learning
title_full_unstemmed Enhancing Handover for 5G mmWave Mobile Networks Using Jump Markov Linear System and Deep Reinforcement Learning
title_short Enhancing Handover for 5G mmWave Mobile Networks Using Jump Markov Linear System and Deep Reinforcement Learning
title_sort enhancing handover for 5g mmwave mobile networks using jump markov linear system and deep reinforcement learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8838663/
https://www.ncbi.nlm.nih.gov/pubmed/35161492
http://dx.doi.org/10.3390/s22030746
work_keys_str_mv AT chiputamasoto enhancinghandoverfor5gmmwavemobilenetworksusingjumpmarkovlinearsystemanddeepreinforcementlearning
AT zhangminglong enhancinghandoverfor5gmmwavemobilenetworksusingjumpmarkovlinearsystemanddeepreinforcementlearning
AT aliggmdnawaz enhancinghandoverfor5gmmwavemobilenetworksusingjumpmarkovlinearsystemanddeepreinforcementlearning
AT chongpeterhanjoo enhancinghandoverfor5gmmwavemobilenetworksusingjumpmarkovlinearsystemanddeepreinforcementlearning
AT sabithakilo enhancinghandoverfor5gmmwavemobilenetworksusingjumpmarkovlinearsystemanddeepreinforcementlearning
AT kumararun enhancinghandoverfor5gmmwavemobilenetworksusingjumpmarkovlinearsystemanddeepreinforcementlearning
AT lihui enhancinghandoverfor5gmmwavemobilenetworksusingjumpmarkovlinearsystemanddeepreinforcementlearning