Cargando…

Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting

In this study, we address the class-agnostic counting (CAC) challenge, aiming to count instances in a query image, using just a few exemplars. Recent research has shifted towards few-shot counting (FSC), which involves counting previously unseen object classes. We present ACECount, an FSC framework...

Descripción completa

Detalles Bibliográficos
Autores principales: Dong, Liang, Yu, Yian, Zhang, Di, Huo, Yan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10675645/
https://www.ncbi.nlm.nih.gov/pubmed/38005514
http://dx.doi.org/10.3390/s23229126
_version_ 1785141113808486400
author Dong, Liang
Yu, Yian
Zhang, Di
Huo, Yan
author_facet Dong, Liang
Yu, Yian
Zhang, Di
Huo, Yan
author_sort Dong, Liang
collection PubMed
description In this study, we address the class-agnostic counting (CAC) challenge, aiming to count instances in a query image, using just a few exemplars. Recent research has shifted towards few-shot counting (FSC), which involves counting previously unseen object classes. We present ACECount, an FSC framework that combines attention mechanisms and convolutional neural networks (CNNs). ACECount identifies query image–exemplar similarities, using cross-attention mechanisms, enhances feature representations with a feature attention module, and employs a multi-scale regression head, to handle scale variations in CAC. ACECount’s experiments on theFSC-147 dataset exhibited the expected performance. ACECount achieved a reduction of 0.3 in the mean absolute error (MAE) on the validation set and a reduction of 0.26 on the test set of FSC-147, compared to previous methods. Notably, ACECount also demonstrated convincing performance in class-specific counting (CSC) tasks. Evaluation on crowd and vehicle counting datasets revealed that ACECount surpasses FSC algorithms like GMN, FamNet, SAFECount, LOCA, and SPDCN, in terms of performance. These results highlight the robust dataset generalization capabilities of our proposed algorithm.
format Online
Article
Text
id pubmed-10675645
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106756452023-11-11 Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting Dong, Liang Yu, Yian Zhang, Di Huo, Yan Sensors (Basel) Article In this study, we address the class-agnostic counting (CAC) challenge, aiming to count instances in a query image, using just a few exemplars. Recent research has shifted towards few-shot counting (FSC), which involves counting previously unseen object classes. We present ACECount, an FSC framework that combines attention mechanisms and convolutional neural networks (CNNs). ACECount identifies query image–exemplar similarities, using cross-attention mechanisms, enhances feature representations with a feature attention module, and employs a multi-scale regression head, to handle scale variations in CAC. ACECount’s experiments on theFSC-147 dataset exhibited the expected performance. ACECount achieved a reduction of 0.3 in the mean absolute error (MAE) on the validation set and a reduction of 0.26 on the test set of FSC-147, compared to previous methods. Notably, ACECount also demonstrated convincing performance in class-specific counting (CSC) tasks. Evaluation on crowd and vehicle counting datasets revealed that ACECount surpasses FSC algorithms like GMN, FamNet, SAFECount, LOCA, and SPDCN, in terms of performance. These results highlight the robust dataset generalization capabilities of our proposed algorithm. MDPI 2023-11-11 /pmc/articles/PMC10675645/ /pubmed/38005514 http://dx.doi.org/10.3390/s23229126 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Dong, Liang
Yu, Yian
Zhang, Di
Huo, Yan
Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting
title Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting
title_full Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting
title_fullStr Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting
title_full_unstemmed Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting
title_short Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting
title_sort attention-assisted feature comparison and feature enhancement for class-agnostic counting
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10675645/
https://www.ncbi.nlm.nih.gov/pubmed/38005514
http://dx.doi.org/10.3390/s23229126
work_keys_str_mv AT dongliang attentionassistedfeaturecomparisonandfeatureenhancementforclassagnosticcounting
AT yuyian attentionassistedfeaturecomparisonandfeatureenhancementforclassagnosticcounting
AT zhangdi attentionassistedfeaturecomparisonandfeatureenhancementforclassagnosticcounting
AT huoyan attentionassistedfeaturecomparisonandfeatureenhancementforclassagnosticcounting