Cargando…

Drone Model Classification Using Convolutional Neural Network Trained on Synthetic Data

We present a convolutional neural network (CNN) that identifies drone models in real-life videos. The neural network is trained on synthetic images and tested on a real-life dataset of drone videos. To create the training and validation datasets, we show a method of generating synthetic drone images...

Descripción completa

Detalles Bibliográficos
Autores principales: Wisniewski, Mariusz, Rana, Zeeshan A., Petrunin, Ivan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9410072/
https://www.ncbi.nlm.nih.gov/pubmed/36005461
http://dx.doi.org/10.3390/jimaging8080218
_version_ 1784775005496672256
author Wisniewski, Mariusz
Rana, Zeeshan A.
Petrunin, Ivan
author_facet Wisniewski, Mariusz
Rana, Zeeshan A.
Petrunin, Ivan
author_sort Wisniewski, Mariusz
collection PubMed
description We present a convolutional neural network (CNN) that identifies drone models in real-life videos. The neural network is trained on synthetic images and tested on a real-life dataset of drone videos. To create the training and validation datasets, we show a method of generating synthetic drone images. Domain randomization is used to vary the simulation parameters such as model textures, background images, and orientation. Three common drone models are classified: DJI Phantom, DJI Mavic, and DJI Inspire. To test the performance of the neural network model, Anti-UAV, a real-life dataset of flying drones is used. The proposed method reduces the time-cost associated with manually labelling drones, and we prove that it is transferable to real-life videos. The CNN achieves an overall accuracy of 92.4%, a precision of 88.8%, a recall of 88.6%, and an f1 score of 88.7% when tested on the real-life dataset.
format Online
Article
Text
id pubmed-9410072
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-94100722022-08-26 Drone Model Classification Using Convolutional Neural Network Trained on Synthetic Data Wisniewski, Mariusz Rana, Zeeshan A. Petrunin, Ivan J Imaging Article We present a convolutional neural network (CNN) that identifies drone models in real-life videos. The neural network is trained on synthetic images and tested on a real-life dataset of drone videos. To create the training and validation datasets, we show a method of generating synthetic drone images. Domain randomization is used to vary the simulation parameters such as model textures, background images, and orientation. Three common drone models are classified: DJI Phantom, DJI Mavic, and DJI Inspire. To test the performance of the neural network model, Anti-UAV, a real-life dataset of flying drones is used. The proposed method reduces the time-cost associated with manually labelling drones, and we prove that it is transferable to real-life videos. The CNN achieves an overall accuracy of 92.4%, a precision of 88.8%, a recall of 88.6%, and an f1 score of 88.7% when tested on the real-life dataset. MDPI 2022-08-12 /pmc/articles/PMC9410072/ /pubmed/36005461 http://dx.doi.org/10.3390/jimaging8080218 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wisniewski, Mariusz
Rana, Zeeshan A.
Petrunin, Ivan
Drone Model Classification Using Convolutional Neural Network Trained on Synthetic Data
title Drone Model Classification Using Convolutional Neural Network Trained on Synthetic Data
title_full Drone Model Classification Using Convolutional Neural Network Trained on Synthetic Data
title_fullStr Drone Model Classification Using Convolutional Neural Network Trained on Synthetic Data
title_full_unstemmed Drone Model Classification Using Convolutional Neural Network Trained on Synthetic Data
title_short Drone Model Classification Using Convolutional Neural Network Trained on Synthetic Data
title_sort drone model classification using convolutional neural network trained on synthetic data
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9410072/
https://www.ncbi.nlm.nih.gov/pubmed/36005461
http://dx.doi.org/10.3390/jimaging8080218
work_keys_str_mv AT wisniewskimariusz dronemodelclassificationusingconvolutionalneuralnetworktrainedonsyntheticdata
AT ranazeeshana dronemodelclassificationusingconvolutionalneuralnetworktrainedonsyntheticdata
AT petruninivan dronemodelclassificationusingconvolutionalneuralnetworktrainedonsyntheticdata