Cargando…
Deep parameter-free attention hashing for image retrieval
Deep hashing method is widely applied in the field of image retrieval because of its advantages of low storage consumption and fast retrieval speed. There is a defect of insufficiency feature extraction when existing deep hashing method uses the convolutional neural network (CNN) to extract images s...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9056524/ https://www.ncbi.nlm.nih.gov/pubmed/35490175 http://dx.doi.org/10.1038/s41598-022-11217-5 |
_version_ | 1784697682453856256 |
---|---|
author | Yang, Wenjing Wang, Liejun Cheng, Shuli |
author_facet | Yang, Wenjing Wang, Liejun Cheng, Shuli |
author_sort | Yang, Wenjing |
collection | PubMed |
description | Deep hashing method is widely applied in the field of image retrieval because of its advantages of low storage consumption and fast retrieval speed. There is a defect of insufficiency feature extraction when existing deep hashing method uses the convolutional neural network (CNN) to extract images semantic features. Some studies propose to add channel-based or spatial-based attention modules. However, embedding these modules into the network can increase the complexity of model and lead to over fitting in the training process. In this study, a novel deep parameter-free attention hashing (DPFAH) is proposed to solve these problems, that designs a parameter-free attention (PFA) module in ResNet18 network. PFA is a lightweight module that defines an energy function to measure the importance of each neuron and infers 3-D attention weights for feature map in a layer. A fast closed-form solution for this energy function proves that the PFA module does not add any parameters to the network. Otherwise, this paper designs a novel hashing framework that includes the hash codes learning branch and the classification branch to explore more label information. The like-binary codes are constrained by a regulation term to reduce the quantization error in the continuous relaxation. Experiments on CIFAR-10, NUS-WIDE and Imagenet-100 show that DPFAH method achieves better performance. |
format | Online Article Text |
id | pubmed-9056524 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-90565242022-05-02 Deep parameter-free attention hashing for image retrieval Yang, Wenjing Wang, Liejun Cheng, Shuli Sci Rep Article Deep hashing method is widely applied in the field of image retrieval because of its advantages of low storage consumption and fast retrieval speed. There is a defect of insufficiency feature extraction when existing deep hashing method uses the convolutional neural network (CNN) to extract images semantic features. Some studies propose to add channel-based or spatial-based attention modules. However, embedding these modules into the network can increase the complexity of model and lead to over fitting in the training process. In this study, a novel deep parameter-free attention hashing (DPFAH) is proposed to solve these problems, that designs a parameter-free attention (PFA) module in ResNet18 network. PFA is a lightweight module that defines an energy function to measure the importance of each neuron and infers 3-D attention weights for feature map in a layer. A fast closed-form solution for this energy function proves that the PFA module does not add any parameters to the network. Otherwise, this paper designs a novel hashing framework that includes the hash codes learning branch and the classification branch to explore more label information. The like-binary codes are constrained by a regulation term to reduce the quantization error in the continuous relaxation. Experiments on CIFAR-10, NUS-WIDE and Imagenet-100 show that DPFAH method achieves better performance. Nature Publishing Group UK 2022-04-30 /pmc/articles/PMC9056524/ /pubmed/35490175 http://dx.doi.org/10.1038/s41598-022-11217-5 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Yang, Wenjing Wang, Liejun Cheng, Shuli Deep parameter-free attention hashing for image retrieval |
title | Deep parameter-free attention hashing for image retrieval |
title_full | Deep parameter-free attention hashing for image retrieval |
title_fullStr | Deep parameter-free attention hashing for image retrieval |
title_full_unstemmed | Deep parameter-free attention hashing for image retrieval |
title_short | Deep parameter-free attention hashing for image retrieval |
title_sort | deep parameter-free attention hashing for image retrieval |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9056524/ https://www.ncbi.nlm.nih.gov/pubmed/35490175 http://dx.doi.org/10.1038/s41598-022-11217-5 |
work_keys_str_mv | AT yangwenjing deepparameterfreeattentionhashingforimageretrieval AT wangliejun deepparameterfreeattentionhashingforimageretrieval AT chengshuli deepparameterfreeattentionhashingforimageretrieval |