Cargando…

A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning

How to operate an unmanned aerial vehicle (UAV) safely and efficiently in an interactive environment is challenging. A large amount of research has been devoted to improve the intelligence of a UAV while performing a mission, where finding an optimal maneuver decision-making policy of the UAV has be...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Ke, Zhang, Kun, Zhang, Zhenchong, Liu, Zekun, Hua, Shuai, He, Jianliang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8004906/
https://www.ncbi.nlm.nih.gov/pubmed/33806886
http://dx.doi.org/10.3390/s21062233
_version_ 1783672010656710656
author Li, Ke
Zhang, Kun
Zhang, Zhenchong
Liu, Zekun
Hua, Shuai
He, Jianliang
author_facet Li, Ke
Zhang, Kun
Zhang, Zhenchong
Liu, Zekun
Hua, Shuai
He, Jianliang
author_sort Li, Ke
collection PubMed
description How to operate an unmanned aerial vehicle (UAV) safely and efficiently in an interactive environment is challenging. A large amount of research has been devoted to improve the intelligence of a UAV while performing a mission, where finding an optimal maneuver decision-making policy of the UAV has become one of the key issues when we attempt to enable the UAV autonomy. In this paper, we propose a maneuver decision-making algorithm based on deep reinforcement learning, which generates efficient maneuvers for a UAV agent to execute the airdrop mission autonomously in an interactive environment. Particularly, the training set of the learning algorithm by the Prioritized Experience Replay is constructed, that can accelerate the convergence speed of decision network training in the algorithm. It is shown that a desirable and effective maneuver decision-making policy can be found by extensive experimental results.
format Online
Article
Text
id pubmed-8004906
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-80049062021-03-29 A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning Li, Ke Zhang, Kun Zhang, Zhenchong Liu, Zekun Hua, Shuai He, Jianliang Sensors (Basel) Article How to operate an unmanned aerial vehicle (UAV) safely and efficiently in an interactive environment is challenging. A large amount of research has been devoted to improve the intelligence of a UAV while performing a mission, where finding an optimal maneuver decision-making policy of the UAV has become one of the key issues when we attempt to enable the UAV autonomy. In this paper, we propose a maneuver decision-making algorithm based on deep reinforcement learning, which generates efficient maneuvers for a UAV agent to execute the airdrop mission autonomously in an interactive environment. Particularly, the training set of the learning algorithm by the Prioritized Experience Replay is constructed, that can accelerate the convergence speed of decision network training in the algorithm. It is shown that a desirable and effective maneuver decision-making policy can be found by extensive experimental results. MDPI 2021-03-23 /pmc/articles/PMC8004906/ /pubmed/33806886 http://dx.doi.org/10.3390/s21062233 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Li, Ke
Zhang, Kun
Zhang, Zhenchong
Liu, Zekun
Hua, Shuai
He, Jianliang
A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
title A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
title_full A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
title_fullStr A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
title_full_unstemmed A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
title_short A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
title_sort uav maneuver decision-making algorithm for autonomous airdrop based on deep reinforcement learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8004906/
https://www.ncbi.nlm.nih.gov/pubmed/33806886
http://dx.doi.org/10.3390/s21062233
work_keys_str_mv AT like auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning
AT zhangkun auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning
AT zhangzhenchong auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning
AT liuzekun auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning
AT huashuai auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning
AT hejianliang auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning
AT like uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning
AT zhangkun uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning
AT zhangzhenchong uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning
AT liuzekun uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning
AT huashuai uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning
AT hejianliang uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning