Cargando…
Counter a Drone in a Complex Neighborhood Area by Deep Reinforcement Learning
Counter-drone technology by using artificial intelligence (AI) is an emerging technology and it is rapidly developing. Considering the recent advances in AI, counter-drone systems with AI can be very accurate and efficient to fight against drones. The time required to engage with the target can be l...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7219666/ https://www.ncbi.nlm.nih.gov/pubmed/32325689 http://dx.doi.org/10.3390/s20082320 |
_version_ | 1783533026194489344 |
---|---|
author | Çetin, Ender Barrado, Cristina Pastor, Enric |
author_facet | Çetin, Ender Barrado, Cristina Pastor, Enric |
author_sort | Çetin, Ender |
collection | PubMed |
description | Counter-drone technology by using artificial intelligence (AI) is an emerging technology and it is rapidly developing. Considering the recent advances in AI, counter-drone systems with AI can be very accurate and efficient to fight against drones. The time required to engage with the target can be less than other methods based on human intervention, such as bringing down a malicious drone by a machine-gun. Also, AI can identify and classify the target with a high precision in order to prevent a false interdiction with the targeted object. We believe that counter-drone technology with AI will bring important advantages to the threats coming from some drones and will help the skies to become safer and more secure. In this study, a deep reinforcement learning (DRL) architecture is proposed to counter a drone with another drone, the learning drone, which will autonomously avoid all kind of obstacles inside a suburban neighborhood environment. The environment in a simulator that has stationary obstacles such as trees, cables, parked cars, and houses. In addition, another non-malicious third drone, acting as moving obstacle inside the environment was also included. In this way, the learning drone is trained to detect stationary and moving obstacles, and to counter and catch the target drone without crashing with any other obstacle inside the neighborhood. The learning drone has a front camera and it can capture continuously depth images. Every depth image is part of the state used in DRL architecture. There are also scalar state parameters such as velocities, distances to the target, distances to some defined geofences and track, and elevation angles. The state image and scalars are processed by a neural network that joints the two state parts into a unique flow. Moreover, transfer learning is tested by using the weights of the first full-trained model. With transfer learning, one of the best jump-starts achieved higher mean rewards (close to 35 more) at the beginning of training. Transfer learning also shows that the number of crashes during training can be reduced, with a total number of crashed episodes reduced by 65%, when all ground obstacles are included. |
format | Online Article Text |
id | pubmed-7219666 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-72196662020-05-22 Counter a Drone in a Complex Neighborhood Area by Deep Reinforcement Learning Çetin, Ender Barrado, Cristina Pastor, Enric Sensors (Basel) Article Counter-drone technology by using artificial intelligence (AI) is an emerging technology and it is rapidly developing. Considering the recent advances in AI, counter-drone systems with AI can be very accurate and efficient to fight against drones. The time required to engage with the target can be less than other methods based on human intervention, such as bringing down a malicious drone by a machine-gun. Also, AI can identify and classify the target with a high precision in order to prevent a false interdiction with the targeted object. We believe that counter-drone technology with AI will bring important advantages to the threats coming from some drones and will help the skies to become safer and more secure. In this study, a deep reinforcement learning (DRL) architecture is proposed to counter a drone with another drone, the learning drone, which will autonomously avoid all kind of obstacles inside a suburban neighborhood environment. The environment in a simulator that has stationary obstacles such as trees, cables, parked cars, and houses. In addition, another non-malicious third drone, acting as moving obstacle inside the environment was also included. In this way, the learning drone is trained to detect stationary and moving obstacles, and to counter and catch the target drone without crashing with any other obstacle inside the neighborhood. The learning drone has a front camera and it can capture continuously depth images. Every depth image is part of the state used in DRL architecture. There are also scalar state parameters such as velocities, distances to the target, distances to some defined geofences and track, and elevation angles. The state image and scalars are processed by a neural network that joints the two state parts into a unique flow. Moreover, transfer learning is tested by using the weights of the first full-trained model. With transfer learning, one of the best jump-starts achieved higher mean rewards (close to 35 more) at the beginning of training. Transfer learning also shows that the number of crashes during training can be reduced, with a total number of crashed episodes reduced by 65%, when all ground obstacles are included. MDPI 2020-04-18 /pmc/articles/PMC7219666/ /pubmed/32325689 http://dx.doi.org/10.3390/s20082320 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Çetin, Ender Barrado, Cristina Pastor, Enric Counter a Drone in a Complex Neighborhood Area by Deep Reinforcement Learning |
title | Counter a Drone in a Complex Neighborhood Area by Deep Reinforcement Learning |
title_full | Counter a Drone in a Complex Neighborhood Area by Deep Reinforcement Learning |
title_fullStr | Counter a Drone in a Complex Neighborhood Area by Deep Reinforcement Learning |
title_full_unstemmed | Counter a Drone in a Complex Neighborhood Area by Deep Reinforcement Learning |
title_short | Counter a Drone in a Complex Neighborhood Area by Deep Reinforcement Learning |
title_sort | counter a drone in a complex neighborhood area by deep reinforcement learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7219666/ https://www.ncbi.nlm.nih.gov/pubmed/32325689 http://dx.doi.org/10.3390/s20082320 |
work_keys_str_mv | AT cetinender counteradroneinacomplexneighborhoodareabydeepreinforcementlearning AT barradocristina counteradroneinacomplexneighborhoodareabydeepreinforcementlearning AT pastorenric counteradroneinacomplexneighborhoodareabydeepreinforcementlearning |