Cargando…
DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network
In view of the poor performance of traditional feature point detection methods in low-texture situations, we design a new self-supervised feature extraction network that can be applied to the visual odometer (VO) front-end feature extraction module based on the deep learning method. First, the netwo...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8914829/ https://www.ncbi.nlm.nih.gov/pubmed/35271087 http://dx.doi.org/10.3390/s22051940 |
_version_ | 1784667846732677120 |
---|---|
author | Li, Zhaoyang Cao, Jie Hao, Qun Zhao, Xue Ning, Yaqian Li, Dongxing |
author_facet | Li, Zhaoyang Cao, Jie Hao, Qun Zhao, Xue Ning, Yaqian Li, Dongxing |
author_sort | Li, Zhaoyang |
collection | PubMed |
description | In view of the poor performance of traditional feature point detection methods in low-texture situations, we design a new self-supervised feature extraction network that can be applied to the visual odometer (VO) front-end feature extraction module based on the deep learning method. First, the network uses the feature pyramid structure to perform multi-scale feature fusion to obtain a feature map containing multi-scale information. Then, the feature map is passed through the position attention module and the channel attention module to obtain the feature dependency relationship of the spatial dimension and the channel dimension, respectively, and the weighted spatial feature map and the channel feature map are added element by element to enhance the feature representation. Finally, the weighted feature maps are trained for detectors and descriptors respectively. In addition, in order to improve the prediction accuracy of feature point locations and speed up the network convergence, we add a confidence loss term and a tolerance loss term to the loss functions of the detector and descriptor, respectively. The experiments show that our network achieves satisfactory performance under the Hpatches dataset and KITTI dataset, indicating the reliability of the network. |
format | Online Article Text |
id | pubmed-8914829 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-89148292022-03-12 DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network Li, Zhaoyang Cao, Jie Hao, Qun Zhao, Xue Ning, Yaqian Li, Dongxing Sensors (Basel) Article In view of the poor performance of traditional feature point detection methods in low-texture situations, we design a new self-supervised feature extraction network that can be applied to the visual odometer (VO) front-end feature extraction module based on the deep learning method. First, the network uses the feature pyramid structure to perform multi-scale feature fusion to obtain a feature map containing multi-scale information. Then, the feature map is passed through the position attention module and the channel attention module to obtain the feature dependency relationship of the spatial dimension and the channel dimension, respectively, and the weighted spatial feature map and the channel feature map are added element by element to enhance the feature representation. Finally, the weighted feature maps are trained for detectors and descriptors respectively. In addition, in order to improve the prediction accuracy of feature point locations and speed up the network convergence, we add a confidence loss term and a tolerance loss term to the loss functions of the detector and descriptor, respectively. The experiments show that our network achieves satisfactory performance under the Hpatches dataset and KITTI dataset, indicating the reliability of the network. MDPI 2022-03-02 /pmc/articles/PMC8914829/ /pubmed/35271087 http://dx.doi.org/10.3390/s22051940 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Li, Zhaoyang Cao, Jie Hao, Qun Zhao, Xue Ning, Yaqian Li, Dongxing DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network |
title | DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network |
title_full | DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network |
title_fullStr | DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network |
title_full_unstemmed | DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network |
title_short | DAN-SuperPoint: Self-Supervised Feature Point Detection Algorithm with Dual Attention Network |
title_sort | dan-superpoint: self-supervised feature point detection algorithm with dual attention network |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8914829/ https://www.ncbi.nlm.nih.gov/pubmed/35271087 http://dx.doi.org/10.3390/s22051940 |
work_keys_str_mv | AT lizhaoyang dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork AT caojie dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork AT haoqun dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork AT zhaoxue dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork AT ningyaqian dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork AT lidongxing dansuperpointselfsupervisedfeaturepointdetectionalgorithmwithdualattentionnetwork |