Cargando…
A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
How to operate an unmanned aerial vehicle (UAV) safely and efficiently in an interactive environment is challenging. A large amount of research has been devoted to improve the intelligence of a UAV while performing a mission, where finding an optimal maneuver decision-making policy of the UAV has be...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8004906/ https://www.ncbi.nlm.nih.gov/pubmed/33806886 http://dx.doi.org/10.3390/s21062233 |
_version_ | 1783672010656710656 |
---|---|
author | Li, Ke Zhang, Kun Zhang, Zhenchong Liu, Zekun Hua, Shuai He, Jianliang |
author_facet | Li, Ke Zhang, Kun Zhang, Zhenchong Liu, Zekun Hua, Shuai He, Jianliang |
author_sort | Li, Ke |
collection | PubMed |
description | How to operate an unmanned aerial vehicle (UAV) safely and efficiently in an interactive environment is challenging. A large amount of research has been devoted to improve the intelligence of a UAV while performing a mission, where finding an optimal maneuver decision-making policy of the UAV has become one of the key issues when we attempt to enable the UAV autonomy. In this paper, we propose a maneuver decision-making algorithm based on deep reinforcement learning, which generates efficient maneuvers for a UAV agent to execute the airdrop mission autonomously in an interactive environment. Particularly, the training set of the learning algorithm by the Prioritized Experience Replay is constructed, that can accelerate the convergence speed of decision network training in the algorithm. It is shown that a desirable and effective maneuver decision-making policy can be found by extensive experimental results. |
format | Online Article Text |
id | pubmed-8004906 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-80049062021-03-29 A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning Li, Ke Zhang, Kun Zhang, Zhenchong Liu, Zekun Hua, Shuai He, Jianliang Sensors (Basel) Article How to operate an unmanned aerial vehicle (UAV) safely and efficiently in an interactive environment is challenging. A large amount of research has been devoted to improve the intelligence of a UAV while performing a mission, where finding an optimal maneuver decision-making policy of the UAV has become one of the key issues when we attempt to enable the UAV autonomy. In this paper, we propose a maneuver decision-making algorithm based on deep reinforcement learning, which generates efficient maneuvers for a UAV agent to execute the airdrop mission autonomously in an interactive environment. Particularly, the training set of the learning algorithm by the Prioritized Experience Replay is constructed, that can accelerate the convergence speed of decision network training in the algorithm. It is shown that a desirable and effective maneuver decision-making policy can be found by extensive experimental results. MDPI 2021-03-23 /pmc/articles/PMC8004906/ /pubmed/33806886 http://dx.doi.org/10.3390/s21062233 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Li, Ke Zhang, Kun Zhang, Zhenchong Liu, Zekun Hua, Shuai He, Jianliang A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning |
title | A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning |
title_full | A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning |
title_fullStr | A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning |
title_full_unstemmed | A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning |
title_short | A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning |
title_sort | uav maneuver decision-making algorithm for autonomous airdrop based on deep reinforcement learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8004906/ https://www.ncbi.nlm.nih.gov/pubmed/33806886 http://dx.doi.org/10.3390/s21062233 |
work_keys_str_mv | AT like auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning AT zhangkun auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning AT zhangzhenchong auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning AT liuzekun auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning AT huashuai auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning AT hejianliang auavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning AT like uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning AT zhangkun uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning AT zhangzhenchong uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning AT liuzekun uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning AT huashuai uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning AT hejianliang uavmaneuverdecisionmakingalgorithmforautonomousairdropbasedondeepreinforcementlearning |