Cargando…

Deep Q-Learning for Two-Hop Communications of Drone Base Stations

In this paper, we address the application of the flying Drone Base Stations (DBS) in order to improve the network performance. Given the high degrees of freedom of a DBS, it can change its position and adapt its trajectory according to the users movements and the target environment. A two-hop commun...

Descripción completa

Detalles Bibliográficos
Autores principales: Fotouhi, Azade, Ding, Ming, Hassan, Mahbub
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7999891/
https://www.ncbi.nlm.nih.gov/pubmed/33799546
http://dx.doi.org/10.3390/s21061960
_version_ 1783670884504961024
author Fotouhi, Azade
Ding, Ming
Hassan, Mahbub
author_facet Fotouhi, Azade
Ding, Ming
Hassan, Mahbub
author_sort Fotouhi, Azade
collection PubMed
description In this paper, we address the application of the flying Drone Base Stations (DBS) in order to improve the network performance. Given the high degrees of freedom of a DBS, it can change its position and adapt its trajectory according to the users movements and the target environment. A two-hop communication model, between an end-user and a macrocell through a DBS, is studied in this work. We propose Q-learning and Deep Q-learning based solutions to optimize the drone’s trajectory. Simulation results show that, by employing our proposed models, the drone can autonomously fly and adapts its mobility according to the users’ movements. Additionally, the Deep Q-learning model outperforms the Q-learning model and can be applied in more complex environments.
format Online
Article
Text
id pubmed-7999891
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-79998912021-03-28 Deep Q-Learning for Two-Hop Communications of Drone Base Stations Fotouhi, Azade Ding, Ming Hassan, Mahbub Sensors (Basel) Article In this paper, we address the application of the flying Drone Base Stations (DBS) in order to improve the network performance. Given the high degrees of freedom of a DBS, it can change its position and adapt its trajectory according to the users movements and the target environment. A two-hop communication model, between an end-user and a macrocell through a DBS, is studied in this work. We propose Q-learning and Deep Q-learning based solutions to optimize the drone’s trajectory. Simulation results show that, by employing our proposed models, the drone can autonomously fly and adapts its mobility according to the users’ movements. Additionally, the Deep Q-learning model outperforms the Q-learning model and can be applied in more complex environments. MDPI 2021-03-11 /pmc/articles/PMC7999891/ /pubmed/33799546 http://dx.doi.org/10.3390/s21061960 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Fotouhi, Azade
Ding, Ming
Hassan, Mahbub
Deep Q-Learning for Two-Hop Communications of Drone Base Stations
title Deep Q-Learning for Two-Hop Communications of Drone Base Stations
title_full Deep Q-Learning for Two-Hop Communications of Drone Base Stations
title_fullStr Deep Q-Learning for Two-Hop Communications of Drone Base Stations
title_full_unstemmed Deep Q-Learning for Two-Hop Communications of Drone Base Stations
title_short Deep Q-Learning for Two-Hop Communications of Drone Base Stations
title_sort deep q-learning for two-hop communications of drone base stations
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7999891/
https://www.ncbi.nlm.nih.gov/pubmed/33799546
http://dx.doi.org/10.3390/s21061960
work_keys_str_mv AT fotouhiazade deepqlearningfortwohopcommunicationsofdronebasestations
AT dingming deepqlearningfortwohopcommunicationsofdronebasestations
AT hassanmahbub deepqlearningfortwohopcommunicationsofdronebasestations