Cargando…

Deep parameter-free attention hashing for image retrieval

Deep hashing method is widely applied in the field of image retrieval because of its advantages of low storage consumption and fast retrieval speed. There is a defect of insufficiency feature extraction when existing deep hashing method uses the convolutional neural network (CNN) to extract images s...

Descripción completa

Detalles Bibliográficos
Autores principales: Yang, Wenjing, Wang, Liejun, Cheng, Shuli
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9056524/
https://www.ncbi.nlm.nih.gov/pubmed/35490175
http://dx.doi.org/10.1038/s41598-022-11217-5
_version_ 1784697682453856256
author Yang, Wenjing
Wang, Liejun
Cheng, Shuli
author_facet Yang, Wenjing
Wang, Liejun
Cheng, Shuli
author_sort Yang, Wenjing
collection PubMed
description Deep hashing method is widely applied in the field of image retrieval because of its advantages of low storage consumption and fast retrieval speed. There is a defect of insufficiency feature extraction when existing deep hashing method uses the convolutional neural network (CNN) to extract images semantic features. Some studies propose to add channel-based or spatial-based attention modules. However, embedding these modules into the network can increase the complexity of model and lead to over fitting in the training process. In this study, a novel deep parameter-free attention hashing (DPFAH) is proposed to solve these problems, that designs a parameter-free attention (PFA) module in ResNet18 network. PFA is a lightweight module that defines an energy function to measure the importance of each neuron and infers 3-D attention weights for feature map in a layer. A fast closed-form solution for this energy function proves that the PFA module does not add any parameters to the network. Otherwise, this paper designs a novel hashing framework that includes the hash codes learning branch and the classification branch to explore more label information. The like-binary codes are constrained by a regulation term to reduce the quantization error in the continuous relaxation. Experiments on CIFAR-10, NUS-WIDE and Imagenet-100 show that DPFAH method achieves better performance.
format Online
Article
Text
id pubmed-9056524
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-90565242022-05-02 Deep parameter-free attention hashing for image retrieval Yang, Wenjing Wang, Liejun Cheng, Shuli Sci Rep Article Deep hashing method is widely applied in the field of image retrieval because of its advantages of low storage consumption and fast retrieval speed. There is a defect of insufficiency feature extraction when existing deep hashing method uses the convolutional neural network (CNN) to extract images semantic features. Some studies propose to add channel-based or spatial-based attention modules. However, embedding these modules into the network can increase the complexity of model and lead to over fitting in the training process. In this study, a novel deep parameter-free attention hashing (DPFAH) is proposed to solve these problems, that designs a parameter-free attention (PFA) module in ResNet18 network. PFA is a lightweight module that defines an energy function to measure the importance of each neuron and infers 3-D attention weights for feature map in a layer. A fast closed-form solution for this energy function proves that the PFA module does not add any parameters to the network. Otherwise, this paper designs a novel hashing framework that includes the hash codes learning branch and the classification branch to explore more label information. The like-binary codes are constrained by a regulation term to reduce the quantization error in the continuous relaxation. Experiments on CIFAR-10, NUS-WIDE and Imagenet-100 show that DPFAH method achieves better performance. Nature Publishing Group UK 2022-04-30 /pmc/articles/PMC9056524/ /pubmed/35490175 http://dx.doi.org/10.1038/s41598-022-11217-5 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Yang, Wenjing
Wang, Liejun
Cheng, Shuli
Deep parameter-free attention hashing for image retrieval
title Deep parameter-free attention hashing for image retrieval
title_full Deep parameter-free attention hashing for image retrieval
title_fullStr Deep parameter-free attention hashing for image retrieval
title_full_unstemmed Deep parameter-free attention hashing for image retrieval
title_short Deep parameter-free attention hashing for image retrieval
title_sort deep parameter-free attention hashing for image retrieval
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9056524/
https://www.ncbi.nlm.nih.gov/pubmed/35490175
http://dx.doi.org/10.1038/s41598-022-11217-5
work_keys_str_mv AT yangwenjing deepparameterfreeattentionhashingforimageretrieval
AT wangliejun deepparameterfreeattentionhashingforimageretrieval
AT chengshuli deepparameterfreeattentionhashingforimageretrieval