Cargando…

Few-shot segmentation with duplex network and attention augmented module

Establishing the relationship between a limited number of samples and segmented objects in diverse scenarios is the primary challenge in few-shot segmentation. However, many previous works overlooked the crucial support-query set interaction and the deeper information that needs to be explored. This...

Descripción completa

Detalles Bibliográficos
Autores principales: Zeng, Sifu, Yang, Jie, Luo, Wang, Ruan, Yudi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10320285/
https://www.ncbi.nlm.nih.gov/pubmed/37416851
http://dx.doi.org/10.3389/fnbot.2023.1206189
_version_ 1785068421546770432
author Zeng, Sifu
Yang, Jie
Luo, Wang
Ruan, Yudi
author_facet Zeng, Sifu
Yang, Jie
Luo, Wang
Ruan, Yudi
author_sort Zeng, Sifu
collection PubMed
description Establishing the relationship between a limited number of samples and segmented objects in diverse scenarios is the primary challenge in few-shot segmentation. However, many previous works overlooked the crucial support-query set interaction and the deeper information that needs to be explored. This oversight can lead to model failure when confronted with complex scenarios, such as ambiguous boundaries. To solve this problem, a duplex network that utilizes the suppression and focus concept is proposed to effectively suppress the background and focus on the foreground. Our network includes dynamic convolution to enhance the support-query interaction and a prototype match structure to fully extract information from support and query. The proposed model is called dynamic prototype mixture convolutional networks (DPMC). To minimize the impact of redundant information, we have incorporated a hybrid attentional module called double-layer attention augmented convolutional module (DAAConv) into DPMC. This module enables the network to concentrate more on foreground information. Our experiments on PASCAL-5i and COCO-20i datasets suggested that DPMC and DAAConv outperform traditional prototype-based methods by up to 5–8% on average.
format Online
Article
Text
id pubmed-10320285
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-103202852023-07-06 Few-shot segmentation with duplex network and attention augmented module Zeng, Sifu Yang, Jie Luo, Wang Ruan, Yudi Front Neurorobot Neuroscience Establishing the relationship between a limited number of samples and segmented objects in diverse scenarios is the primary challenge in few-shot segmentation. However, many previous works overlooked the crucial support-query set interaction and the deeper information that needs to be explored. This oversight can lead to model failure when confronted with complex scenarios, such as ambiguous boundaries. To solve this problem, a duplex network that utilizes the suppression and focus concept is proposed to effectively suppress the background and focus on the foreground. Our network includes dynamic convolution to enhance the support-query interaction and a prototype match structure to fully extract information from support and query. The proposed model is called dynamic prototype mixture convolutional networks (DPMC). To minimize the impact of redundant information, we have incorporated a hybrid attentional module called double-layer attention augmented convolutional module (DAAConv) into DPMC. This module enables the network to concentrate more on foreground information. Our experiments on PASCAL-5i and COCO-20i datasets suggested that DPMC and DAAConv outperform traditional prototype-based methods by up to 5–8% on average. Frontiers Media S.A. 2023-06-21 /pmc/articles/PMC10320285/ /pubmed/37416851 http://dx.doi.org/10.3389/fnbot.2023.1206189 Text en Copyright © 2023 Zeng, Yang, Luo and Ruan. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Zeng, Sifu
Yang, Jie
Luo, Wang
Ruan, Yudi
Few-shot segmentation with duplex network and attention augmented module
title Few-shot segmentation with duplex network and attention augmented module
title_full Few-shot segmentation with duplex network and attention augmented module
title_fullStr Few-shot segmentation with duplex network and attention augmented module
title_full_unstemmed Few-shot segmentation with duplex network and attention augmented module
title_short Few-shot segmentation with duplex network and attention augmented module
title_sort few-shot segmentation with duplex network and attention augmented module
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10320285/
https://www.ncbi.nlm.nih.gov/pubmed/37416851
http://dx.doi.org/10.3389/fnbot.2023.1206189
work_keys_str_mv AT zengsifu fewshotsegmentationwithduplexnetworkandattentionaugmentedmodule
AT yangjie fewshotsegmentationwithduplexnetworkandattentionaugmentedmodule
AT luowang fewshotsegmentationwithduplexnetworkandattentionaugmentedmodule
AT ruanyudi fewshotsegmentationwithduplexnetworkandattentionaugmentedmodule