Cargando…

A Power Allocation Scheme for MIMO-NOMA and D2D Vehicular Edge Computing Based on Decentralized DRL

In vehicular edge computing (VEC), some tasks can be processed either locally or on the mobile edge computing (MEC) server at a base station (BS) or a nearby vehicle. In fact, tasks are offloaded or not, based on the status of vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) communicatio...

Descripción completa

Detalles Bibliográficos
Autores principales: Long, Dunxing, Wu, Qiong, Fan, Qiang, Fan, Pingyi, Li, Zhengquan, Fan, Jing
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10098596/
https://www.ncbi.nlm.nih.gov/pubmed/37050509
http://dx.doi.org/10.3390/s23073449
_version_ 1785024847917613056
author Long, Dunxing
Wu, Qiong
Fan, Qiang
Fan, Pingyi
Li, Zhengquan
Fan, Jing
author_facet Long, Dunxing
Wu, Qiong
Fan, Qiang
Fan, Pingyi
Li, Zhengquan
Fan, Jing
author_sort Long, Dunxing
collection PubMed
description In vehicular edge computing (VEC), some tasks can be processed either locally or on the mobile edge computing (MEC) server at a base station (BS) or a nearby vehicle. In fact, tasks are offloaded or not, based on the status of vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) communication. In this paper, device-to-device (D2D)-based V2V communication and multiple-input multiple-output and nonorthogonal multiple access (MIMO-NOMA)-based V2I communication are considered. In actual communication scenarios, the channel conditions for MIMO-NOMA-based V2I communication are uncertain, and the task arrival is random, leading to a highly complex environment for VEC systems. To solve this problem, we propose a power allocation scheme based on decentralized deep reinforcement learning (DRL). Since the action space is continuous, we employ the deep deterministic policy gradient (DDPG) algorithm to obtain the optimal policy. Extensive experiments demonstrate that our proposed approach with DRL and DDPG outperforms existing greedy strategies in terms of power consumption and reward.
format Online
Article
Text
id pubmed-10098596
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-100985962023-04-14 A Power Allocation Scheme for MIMO-NOMA and D2D Vehicular Edge Computing Based on Decentralized DRL Long, Dunxing Wu, Qiong Fan, Qiang Fan, Pingyi Li, Zhengquan Fan, Jing Sensors (Basel) Article In vehicular edge computing (VEC), some tasks can be processed either locally or on the mobile edge computing (MEC) server at a base station (BS) or a nearby vehicle. In fact, tasks are offloaded or not, based on the status of vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) communication. In this paper, device-to-device (D2D)-based V2V communication and multiple-input multiple-output and nonorthogonal multiple access (MIMO-NOMA)-based V2I communication are considered. In actual communication scenarios, the channel conditions for MIMO-NOMA-based V2I communication are uncertain, and the task arrival is random, leading to a highly complex environment for VEC systems. To solve this problem, we propose a power allocation scheme based on decentralized deep reinforcement learning (DRL). Since the action space is continuous, we employ the deep deterministic policy gradient (DDPG) algorithm to obtain the optimal policy. Extensive experiments demonstrate that our proposed approach with DRL and DDPG outperforms existing greedy strategies in terms of power consumption and reward. MDPI 2023-03-25 /pmc/articles/PMC10098596/ /pubmed/37050509 http://dx.doi.org/10.3390/s23073449 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Long, Dunxing
Wu, Qiong
Fan, Qiang
Fan, Pingyi
Li, Zhengquan
Fan, Jing
A Power Allocation Scheme for MIMO-NOMA and D2D Vehicular Edge Computing Based on Decentralized DRL
title A Power Allocation Scheme for MIMO-NOMA and D2D Vehicular Edge Computing Based on Decentralized DRL
title_full A Power Allocation Scheme for MIMO-NOMA and D2D Vehicular Edge Computing Based on Decentralized DRL
title_fullStr A Power Allocation Scheme for MIMO-NOMA and D2D Vehicular Edge Computing Based on Decentralized DRL
title_full_unstemmed A Power Allocation Scheme for MIMO-NOMA and D2D Vehicular Edge Computing Based on Decentralized DRL
title_short A Power Allocation Scheme for MIMO-NOMA and D2D Vehicular Edge Computing Based on Decentralized DRL
title_sort power allocation scheme for mimo-noma and d2d vehicular edge computing based on decentralized drl
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10098596/
https://www.ncbi.nlm.nih.gov/pubmed/37050509
http://dx.doi.org/10.3390/s23073449
work_keys_str_mv AT longdunxing apowerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl
AT wuqiong apowerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl
AT fanqiang apowerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl
AT fanpingyi apowerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl
AT lizhengquan apowerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl
AT fanjing apowerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl
AT longdunxing powerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl
AT wuqiong powerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl
AT fanqiang powerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl
AT fanpingyi powerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl
AT lizhengquan powerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl
AT fanjing powerallocationschemeformimonomaandd2dvehicularedgecomputingbasedondecentralizeddrl