Cargando…

Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios

Higher standards for reliability and efficiency apply to the connection between vehicle terminals and infrastructure by the fifth-generation mobile communication technology (5G). A vehicle-to-infrastructure system uses a communication system called NR-V2I (New Radio-Vehicle to Infrastructure), which...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Jizhe, Zheng, Yuanbing, Wang, Jian, Shen, Zhenghua, Tong, Lei, Jing, Yahao, Luo, Yu, Liao, Yong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10611140/
https://www.ncbi.nlm.nih.gov/pubmed/37896547
http://dx.doi.org/10.3390/s23208454
_version_ 1785128421791105024
author Wang, Jizhe
Zheng, Yuanbing
Wang, Jian
Shen, Zhenghua
Tong, Lei
Jing, Yahao
Luo, Yu
Liao, Yong
author_facet Wang, Jizhe
Zheng, Yuanbing
Wang, Jian
Shen, Zhenghua
Tong, Lei
Jing, Yahao
Luo, Yu
Liao, Yong
author_sort Wang, Jizhe
collection PubMed
description Higher standards for reliability and efficiency apply to the connection between vehicle terminals and infrastructure by the fifth-generation mobile communication technology (5G). A vehicle-to-infrastructure system uses a communication system called NR-V2I (New Radio-Vehicle to Infrastructure), which uses Link Adaptation (LA) technology to communicate in constantly changing V2I to increase the efficacy and reliability of V2I information transmission. This paper proposes a Double Deep Q-learning (DDQL) LA scheduling algorithm for optimizing the modulation and coding scheme (MCS) of autonomous driving vehicles in V2I communication. The problem with the Doppler shift and complex fast time-varying channels reducing the reliability of information transmission in V2I scenarios is that they make it less likely that the information will be transmitted accurately. Schedules for autonomous vehicles using Space Division Multiplexing (SDM) and MCS are used in V2I communications. To address the issue of Deep Q-learning (DQL) overestimation in the Q-Network learning process, the approach integrates Deep Neural Network (DNN) and Double Q-Network (DDQN). The findings of this study demonstrate that the suggested algorithm can adapt to complex channel environments with varying vehicle speeds in V2I scenarios and by choosing the best scheduling scheme for V2I road information transmission using a combination of MCS. SDM not only increases the accuracy of the transmission of road safety information but also helps to foster cooperation and communication between vehicle terminals to realize cooperative driving.
format Online
Article
Text
id pubmed-10611140
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106111402023-10-28 Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios Wang, Jizhe Zheng, Yuanbing Wang, Jian Shen, Zhenghua Tong, Lei Jing, Yahao Luo, Yu Liao, Yong Sensors (Basel) Article Higher standards for reliability and efficiency apply to the connection between vehicle terminals and infrastructure by the fifth-generation mobile communication technology (5G). A vehicle-to-infrastructure system uses a communication system called NR-V2I (New Radio-Vehicle to Infrastructure), which uses Link Adaptation (LA) technology to communicate in constantly changing V2I to increase the efficacy and reliability of V2I information transmission. This paper proposes a Double Deep Q-learning (DDQL) LA scheduling algorithm for optimizing the modulation and coding scheme (MCS) of autonomous driving vehicles in V2I communication. The problem with the Doppler shift and complex fast time-varying channels reducing the reliability of information transmission in V2I scenarios is that they make it less likely that the information will be transmitted accurately. Schedules for autonomous vehicles using Space Division Multiplexing (SDM) and MCS are used in V2I communications. To address the issue of Deep Q-learning (DQL) overestimation in the Q-Network learning process, the approach integrates Deep Neural Network (DNN) and Double Q-Network (DDQN). The findings of this study demonstrate that the suggested algorithm can adapt to complex channel environments with varying vehicle speeds in V2I scenarios and by choosing the best scheduling scheme for V2I road information transmission using a combination of MCS. SDM not only increases the accuracy of the transmission of road safety information but also helps to foster cooperation and communication between vehicle terminals to realize cooperative driving. MDPI 2023-10-13 /pmc/articles/PMC10611140/ /pubmed/37896547 http://dx.doi.org/10.3390/s23208454 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Jizhe
Zheng, Yuanbing
Wang, Jian
Shen, Zhenghua
Tong, Lei
Jing, Yahao
Luo, Yu
Liao, Yong
Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios
title Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios
title_full Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios
title_fullStr Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios
title_full_unstemmed Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios
title_short Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios
title_sort ultra-reliable deep-reinforcement-learning-based intelligent downlink scheduling for 5g new radio-vehicle to infrastructure scenarios
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10611140/
https://www.ncbi.nlm.nih.gov/pubmed/37896547
http://dx.doi.org/10.3390/s23208454
work_keys_str_mv AT wangjizhe ultrareliabledeepreinforcementlearningbasedintelligentdownlinkschedulingfor5gnewradiovehicletoinfrastructurescenarios
AT zhengyuanbing ultrareliabledeepreinforcementlearningbasedintelligentdownlinkschedulingfor5gnewradiovehicletoinfrastructurescenarios
AT wangjian ultrareliabledeepreinforcementlearningbasedintelligentdownlinkschedulingfor5gnewradiovehicletoinfrastructurescenarios
AT shenzhenghua ultrareliabledeepreinforcementlearningbasedintelligentdownlinkschedulingfor5gnewradiovehicletoinfrastructurescenarios
AT tonglei ultrareliabledeepreinforcementlearningbasedintelligentdownlinkschedulingfor5gnewradiovehicletoinfrastructurescenarios
AT jingyahao ultrareliabledeepreinforcementlearningbasedintelligentdownlinkschedulingfor5gnewradiovehicletoinfrastructurescenarios
AT luoyu ultrareliabledeepreinforcementlearningbasedintelligentdownlinkschedulingfor5gnewradiovehicletoinfrastructurescenarios
AT liaoyong ultrareliabledeepreinforcementlearningbasedintelligentdownlinkschedulingfor5gnewradiovehicletoinfrastructurescenarios