Cargando…

A Visual Positioning Method of UAV in a Large-Scale Outdoor Environment

Visual positioning is a basic component for UAV operation. The structure-based methods are, widely applied in most literature, based on local feature matching between a query image that needs to be localized and a reference image with a known pose and feature points. However, the existing methods st...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhao, Chenhao, Wu, Dewei, He, Jing, Dai, Chuanjin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422297/
https://www.ncbi.nlm.nih.gov/pubmed/37571724
http://dx.doi.org/10.3390/s23156941
_version_ 1785089174140878848
author Zhao, Chenhao
Wu, Dewei
He, Jing
Dai, Chuanjin
author_facet Zhao, Chenhao
Wu, Dewei
He, Jing
Dai, Chuanjin
author_sort Zhao, Chenhao
collection PubMed
description Visual positioning is a basic component for UAV operation. The structure-based methods are, widely applied in most literature, based on local feature matching between a query image that needs to be localized and a reference image with a known pose and feature points. However, the existing methods still struggle with the different illumination and seasonal changes. In outdoor regions, the feature points and descriptors are similar, and the number of mismatches will increase rapidly, leading to the visual positioning becoming unreliable. Moreover, with the database growing, the image retrieval and feature matching are time-consuming. Therefore, in this paper, we propose a novel hierarchical visual positioning method, which includes map construction, landmark matching and pose calculation. First, we combine brain-inspired mechanisms and landmarks to construct a cognitive map, which can make image retrieval efficient. Second, the graph neural network is utilized to learn the inner relations of the feature points. To improve matching accuracy, the network uses the semantic confidence in matching score calculations. Besides, the system can eliminate the mismatches by analyzing all the matching results in the same landmark. Finally, we calculate the pose by using a PnP solver. Furthermore, we evaluate both the matching algorithm and the visual positioning method experimentally in the simulation datasets, where the matching algorithm performs better in some scenes. The results demonstrate that the retrieval time can be shortened by three-thirds with an average positioning error of 10.8 m.
format Online
Article
Text
id pubmed-10422297
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104222972023-08-13 A Visual Positioning Method of UAV in a Large-Scale Outdoor Environment Zhao, Chenhao Wu, Dewei He, Jing Dai, Chuanjin Sensors (Basel) Article Visual positioning is a basic component for UAV operation. The structure-based methods are, widely applied in most literature, based on local feature matching between a query image that needs to be localized and a reference image with a known pose and feature points. However, the existing methods still struggle with the different illumination and seasonal changes. In outdoor regions, the feature points and descriptors are similar, and the number of mismatches will increase rapidly, leading to the visual positioning becoming unreliable. Moreover, with the database growing, the image retrieval and feature matching are time-consuming. Therefore, in this paper, we propose a novel hierarchical visual positioning method, which includes map construction, landmark matching and pose calculation. First, we combine brain-inspired mechanisms and landmarks to construct a cognitive map, which can make image retrieval efficient. Second, the graph neural network is utilized to learn the inner relations of the feature points. To improve matching accuracy, the network uses the semantic confidence in matching score calculations. Besides, the system can eliminate the mismatches by analyzing all the matching results in the same landmark. Finally, we calculate the pose by using a PnP solver. Furthermore, we evaluate both the matching algorithm and the visual positioning method experimentally in the simulation datasets, where the matching algorithm performs better in some scenes. The results demonstrate that the retrieval time can be shortened by three-thirds with an average positioning error of 10.8 m. MDPI 2023-08-04 /pmc/articles/PMC10422297/ /pubmed/37571724 http://dx.doi.org/10.3390/s23156941 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhao, Chenhao
Wu, Dewei
He, Jing
Dai, Chuanjin
A Visual Positioning Method of UAV in a Large-Scale Outdoor Environment
title A Visual Positioning Method of UAV in a Large-Scale Outdoor Environment
title_full A Visual Positioning Method of UAV in a Large-Scale Outdoor Environment
title_fullStr A Visual Positioning Method of UAV in a Large-Scale Outdoor Environment
title_full_unstemmed A Visual Positioning Method of UAV in a Large-Scale Outdoor Environment
title_short A Visual Positioning Method of UAV in a Large-Scale Outdoor Environment
title_sort visual positioning method of uav in a large-scale outdoor environment
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422297/
https://www.ncbi.nlm.nih.gov/pubmed/37571724
http://dx.doi.org/10.3390/s23156941
work_keys_str_mv AT zhaochenhao avisualpositioningmethodofuavinalargescaleoutdoorenvironment
AT wudewei avisualpositioningmethodofuavinalargescaleoutdoorenvironment
AT hejing avisualpositioningmethodofuavinalargescaleoutdoorenvironment
AT daichuanjin avisualpositioningmethodofuavinalargescaleoutdoorenvironment
AT zhaochenhao visualpositioningmethodofuavinalargescaleoutdoorenvironment
AT wudewei visualpositioningmethodofuavinalargescaleoutdoorenvironment
AT hejing visualpositioningmethodofuavinalargescaleoutdoorenvironment
AT daichuanjin visualpositioningmethodofuavinalargescaleoutdoorenvironment