Cargando…

DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network

In view of the poor performance of traditional feature point detection methods in low-texture situations, we design a new self-supervised feature extraction network that can be applied to the visual odometer (VO) front-end feature extraction module based on the deep learning method. First, the netwo...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Zhaoyang, Cao, Jie, Hao, Qun, Zhao, Xue, Ning, Yaqian, Li, Dongxing
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8914829/
https://www.ncbi.nlm.nih.gov/pubmed/35271087
http://dx.doi.org/10.3390/s22051940
_version_ 1784667846732677120
author Li, Zhaoyang
Cao, Jie
Hao, Qun
Zhao, Xue
Ning, Yaqian
Li, Dongxing
author_facet Li, Zhaoyang
Cao, Jie
Hao, Qun
Zhao, Xue
Ning, Yaqian
Li, Dongxing
author_sort Li, Zhaoyang
collection PubMed
description In view of the poor performance of traditional feature point detection methods in low-texture situations, we design a new self-supervised feature extraction network that can be applied to the visual odometer (VO) front-end feature extraction module based on the deep learning method. First, the network uses the feature pyramid structure to perform multi-scale feature fusion to obtain a feature map containing multi-scale information. Then, the feature map is passed through the position attention module and the channel attention module to obtain the feature dependency relationship of the spatial dimension and the channel dimension, respectively, and the weighted spatial feature map and the channel feature map are added element by element to enhance the feature representation. Finally, the weighted feature maps are trained for detectors and descriptors respectively. In addition, in order to improve the prediction accuracy of feature point locations and speed up the network convergence, we add a confidence loss term and a tolerance loss term to the loss functions of the detector and descriptor, respectively. The experiments show that our network achieves satisfactory performance under the Hpatches dataset and KITTI dataset, indicating the reliability of the network.
format Online
Article
Text
id pubmed-8914829
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-89148292022-03-12 DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network Li, Zhaoyang Cao, Jie Hao, Qun Zhao, Xue Ning, Yaqian Li, Dongxing Sensors (Basel) Article In view of the poor performance of traditional feature point detection methods in low-texture situations, we design a new self-supervised feature extraction network that can be applied to the visual odometer (VO) front-end feature extraction module based on the deep learning method. First, the network uses the feature pyramid structure to perform multi-scale feature fusion to obtain a feature map containing multi-scale information. Then, the feature map is passed through the position attention module and the channel attention module to obtain the feature dependency relationship of the spatial dimension and the channel dimension, respectively, and the weighted spatial feature map and the channel feature map are added element by element to enhance the feature representation. Finally, the weighted feature maps are trained for detectors and descriptors respectively. In addition, in order to improve the prediction accuracy of feature point locations and speed up the network convergence, we add a confidence loss term and a tolerance loss term to the loss functions of the detector and descriptor, respectively. The experiments show that our network achieves satisfactory performance under the Hpatches dataset and KITTI dataset, indicating the reliability of the network. MDPI 2022-03-02 /pmc/articles/PMC8914829/ /pubmed/35271087 http://dx.doi.org/10.3390/s22051940 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Li, Zhaoyang
Cao, Jie
Hao, Qun
Zhao, Xue
Ning, Yaqian
Li, Dongxing
DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network
title DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network
title_full DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network
title_fullStr DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network
title_full_unstemmed DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network
title_short DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network
title_sort dan-superpoint: self-supervised feature point detection algorithm with dual attention network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8914829/
https://www.ncbi.nlm.nih.gov/pubmed/35271087
http://dx.doi.org/10.3390/s22051940
work_keys_str_mv AT lizhaoyang dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork
AT caojie dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork
AT haoqun dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork
AT zhaoxue dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork
AT ningyaqian dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork
AT lidongxing dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork