Cargando…
Few-shot segmentation with duplex network and attention augmented module
Establishing the relationship between a limited number of samples and segmented objects in diverse scenarios is the primary challenge in few-shot segmentation. However, many previous works overlooked the crucial support-query set interaction and the deeper information that needs to be explored. This...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10320285/ https://www.ncbi.nlm.nih.gov/pubmed/37416851 http://dx.doi.org/10.3389/fnbot.2023.1206189 |
_version_ | 1785068421546770432 |
---|---|
author | Zeng, Sifu Yang, Jie Luo, Wang Ruan, Yudi |
author_facet | Zeng, Sifu Yang, Jie Luo, Wang Ruan, Yudi |
author_sort | Zeng, Sifu |
collection | PubMed |
description | Establishing the relationship between a limited number of samples and segmented objects in diverse scenarios is the primary challenge in few-shot segmentation. However, many previous works overlooked the crucial support-query set interaction and the deeper information that needs to be explored. This oversight can lead to model failure when confronted with complex scenarios, such as ambiguous boundaries. To solve this problem, a duplex network that utilizes the suppression and focus concept is proposed to effectively suppress the background and focus on the foreground. Our network includes dynamic convolution to enhance the support-query interaction and a prototype match structure to fully extract information from support and query. The proposed model is called dynamic prototype mixture convolutional networks (DPMC). To minimize the impact of redundant information, we have incorporated a hybrid attentional module called double-layer attention augmented convolutional module (DAAConv) into DPMC. This module enables the network to concentrate more on foreground information. Our experiments on PASCAL-5i and COCO-20i datasets suggested that DPMC and DAAConv outperform traditional prototype-based methods by up to 5–8% on average. |
format | Online Article Text |
id | pubmed-10320285 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-103202852023-07-06 Few-shot segmentation with duplex network and attention augmented module Zeng, Sifu Yang, Jie Luo, Wang Ruan, Yudi Front Neurorobot Neuroscience Establishing the relationship between a limited number of samples and segmented objects in diverse scenarios is the primary challenge in few-shot segmentation. However, many previous works overlooked the crucial support-query set interaction and the deeper information that needs to be explored. This oversight can lead to model failure when confronted with complex scenarios, such as ambiguous boundaries. To solve this problem, a duplex network that utilizes the suppression and focus concept is proposed to effectively suppress the background and focus on the foreground. Our network includes dynamic convolution to enhance the support-query interaction and a prototype match structure to fully extract information from support and query. The proposed model is called dynamic prototype mixture convolutional networks (DPMC). To minimize the impact of redundant information, we have incorporated a hybrid attentional module called double-layer attention augmented convolutional module (DAAConv) into DPMC. This module enables the network to concentrate more on foreground information. Our experiments on PASCAL-5i and COCO-20i datasets suggested that DPMC and DAAConv outperform traditional prototype-based methods by up to 5–8% on average. Frontiers Media S.A. 2023-06-21 /pmc/articles/PMC10320285/ /pubmed/37416851 http://dx.doi.org/10.3389/fnbot.2023.1206189 Text en Copyright © 2023 Zeng, Yang, Luo and Ruan. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Zeng, Sifu Yang, Jie Luo, Wang Ruan, Yudi Few-shot segmentation with duplex network and attention augmented module |
title | Few-shot segmentation with duplex network and attention augmented module |
title_full | Few-shot segmentation with duplex network and attention augmented module |
title_fullStr | Few-shot segmentation with duplex network and attention augmented module |
title_full_unstemmed | Few-shot segmentation with duplex network and attention augmented module |
title_short | Few-shot segmentation with duplex network and attention augmented module |
title_sort | few-shot segmentation with duplex network and attention augmented module |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10320285/ https://www.ncbi.nlm.nih.gov/pubmed/37416851 http://dx.doi.org/10.3389/fnbot.2023.1206189 |
work_keys_str_mv | AT zengsifu fewshotsegmentationwithduplexnetworkandattentionaugmentedmodule AT yangjie fewshotsegmentationwithduplexnetworkandattentionaugmentedmodule AT luowang fewshotsegmentationwithduplexnetworkandattentionaugmentedmodule AT ruanyudi fewshotsegmentationwithduplexnetworkandattentionaugmentedmodule |