Cargando…
Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting
In this study, we address the class-agnostic counting (CAC) challenge, aiming to count instances in a query image, using just a few exemplars. Recent research has shifted towards few-shot counting (FSC), which involves counting previously unseen object classes. We present ACECount, an FSC framework...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10675645/ https://www.ncbi.nlm.nih.gov/pubmed/38005514 http://dx.doi.org/10.3390/s23229126 |
_version_ | 1785141113808486400 |
---|---|
author | Dong, Liang Yu, Yian Zhang, Di Huo, Yan |
author_facet | Dong, Liang Yu, Yian Zhang, Di Huo, Yan |
author_sort | Dong, Liang |
collection | PubMed |
description | In this study, we address the class-agnostic counting (CAC) challenge, aiming to count instances in a query image, using just a few exemplars. Recent research has shifted towards few-shot counting (FSC), which involves counting previously unseen object classes. We present ACECount, an FSC framework that combines attention mechanisms and convolutional neural networks (CNNs). ACECount identifies query image–exemplar similarities, using cross-attention mechanisms, enhances feature representations with a feature attention module, and employs a multi-scale regression head, to handle scale variations in CAC. ACECount’s experiments on theFSC-147 dataset exhibited the expected performance. ACECount achieved a reduction of 0.3 in the mean absolute error (MAE) on the validation set and a reduction of 0.26 on the test set of FSC-147, compared to previous methods. Notably, ACECount also demonstrated convincing performance in class-specific counting (CSC) tasks. Evaluation on crowd and vehicle counting datasets revealed that ACECount surpasses FSC algorithms like GMN, FamNet, SAFECount, LOCA, and SPDCN, in terms of performance. These results highlight the robust dataset generalization capabilities of our proposed algorithm. |
format | Online Article Text |
id | pubmed-10675645 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-106756452023-11-11 Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting Dong, Liang Yu, Yian Zhang, Di Huo, Yan Sensors (Basel) Article In this study, we address the class-agnostic counting (CAC) challenge, aiming to count instances in a query image, using just a few exemplars. Recent research has shifted towards few-shot counting (FSC), which involves counting previously unseen object classes. We present ACECount, an FSC framework that combines attention mechanisms and convolutional neural networks (CNNs). ACECount identifies query image–exemplar similarities, using cross-attention mechanisms, enhances feature representations with a feature attention module, and employs a multi-scale regression head, to handle scale variations in CAC. ACECount’s experiments on theFSC-147 dataset exhibited the expected performance. ACECount achieved a reduction of 0.3 in the mean absolute error (MAE) on the validation set and a reduction of 0.26 on the test set of FSC-147, compared to previous methods. Notably, ACECount also demonstrated convincing performance in class-specific counting (CSC) tasks. Evaluation on crowd and vehicle counting datasets revealed that ACECount surpasses FSC algorithms like GMN, FamNet, SAFECount, LOCA, and SPDCN, in terms of performance. These results highlight the robust dataset generalization capabilities of our proposed algorithm. MDPI 2023-11-11 /pmc/articles/PMC10675645/ /pubmed/38005514 http://dx.doi.org/10.3390/s23229126 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Dong, Liang Yu, Yian Zhang, Di Huo, Yan Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting |
title | Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting |
title_full | Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting |
title_fullStr | Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting |
title_full_unstemmed | Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting |
title_short | Attention-Assisted Feature Comparison and Feature Enhancement for Class-Agnostic Counting |
title_sort | attention-assisted feature comparison and feature enhancement for class-agnostic counting |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10675645/ https://www.ncbi.nlm.nih.gov/pubmed/38005514 http://dx.doi.org/10.3390/s23229126 |
work_keys_str_mv | AT dongliang attentionassistedfeaturecomparisonandfeatureenhancementforclassagnosticcounting AT yuyian attentionassistedfeaturecomparisonandfeatureenhancementforclassagnosticcounting AT zhangdi attentionassistedfeaturecomparisonandfeatureenhancementforclassagnosticcounting AT huoyan attentionassistedfeaturecomparisonandfeatureenhancementforclassagnosticcounting |