Cargando…

A Novel Pyramid Network with Feature Fusion and Disentanglement for Object Detection

In order to alleviate the scale variation problem in object detection, many feature pyramid networks are developed. In this paper, we rethink the issues existing in current methods and design a more effective module for feature fusion, called multiflow feature fusion module (MF(3)M). We first constr...

Descripción completa

Detalles Bibliográficos
Autores principales: Yu, Guoyi, Wu, You, Xiao, Jing, Cao, Yang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7987438/
https://www.ncbi.nlm.nih.gov/pubmed/33815497
http://dx.doi.org/10.1155/2021/6685954
_version_ 1783668610716139520
author Yu, Guoyi
Wu, You
Xiao, Jing
Cao, Yang
author_facet Yu, Guoyi
Wu, You
Xiao, Jing
Cao, Yang
author_sort Yu, Guoyi
collection PubMed
description In order to alleviate the scale variation problem in object detection, many feature pyramid networks are developed. In this paper, we rethink the issues existing in current methods and design a more effective module for feature fusion, called multiflow feature fusion module (MF(3)M). We first construct gate modules and multiple information flows in MF(3)M to avoid information redundancy and enhance the completeness and accuracy of information transfer between feature maps. Furtherore, in order to reduce the discrepancy of classification and regression in object detection, a modified deformable convolution which is termed task adaptive convolution (TaConv) is proposed in this study. Different offsets and masks are predicted to achieve the disentanglement of features for classification and regression in TaConv. By integrating the above two designs, we build a novel feature pyramid network with feature fusion and disentanglement (FFAD) which can mitigate the scale misalignment and task misalignment simultaneously. Experimental results show that FFAD can boost the performance in most models.
format Online
Article
Text
id pubmed-7987438
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-79874382021-04-02 A Novel Pyramid Network with Feature Fusion and Disentanglement for Object Detection Yu, Guoyi Wu, You Xiao, Jing Cao, Yang Comput Intell Neurosci Research Article In order to alleviate the scale variation problem in object detection, many feature pyramid networks are developed. In this paper, we rethink the issues existing in current methods and design a more effective module for feature fusion, called multiflow feature fusion module (MF(3)M). We first construct gate modules and multiple information flows in MF(3)M to avoid information redundancy and enhance the completeness and accuracy of information transfer between feature maps. Furtherore, in order to reduce the discrepancy of classification and regression in object detection, a modified deformable convolution which is termed task adaptive convolution (TaConv) is proposed in this study. Different offsets and masks are predicted to achieve the disentanglement of features for classification and regression in TaConv. By integrating the above two designs, we build a novel feature pyramid network with feature fusion and disentanglement (FFAD) which can mitigate the scale misalignment and task misalignment simultaneously. Experimental results show that FFAD can boost the performance in most models. Hindawi 2021-03-15 /pmc/articles/PMC7987438/ /pubmed/33815497 http://dx.doi.org/10.1155/2021/6685954 Text en Copyright © 2021 Guoyi Yu et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Yu, Guoyi
Wu, You
Xiao, Jing
Cao, Yang
A Novel Pyramid Network with Feature Fusion and Disentanglement for Object Detection
title A Novel Pyramid Network with Feature Fusion and Disentanglement for Object Detection
title_full A Novel Pyramid Network with Feature Fusion and Disentanglement for Object Detection
title_fullStr A Novel Pyramid Network with Feature Fusion and Disentanglement for Object Detection
title_full_unstemmed A Novel Pyramid Network with Feature Fusion and Disentanglement for Object Detection
title_short A Novel Pyramid Network with Feature Fusion and Disentanglement for Object Detection
title_sort novel pyramid network with feature fusion and disentanglement for object detection
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7987438/
https://www.ncbi.nlm.nih.gov/pubmed/33815497
http://dx.doi.org/10.1155/2021/6685954
work_keys_str_mv AT yuguoyi anovelpyramidnetworkwithfeaturefusionanddisentanglementforobjectdetection
AT wuyou anovelpyramidnetworkwithfeaturefusionanddisentanglementforobjectdetection
AT xiaojing anovelpyramidnetworkwithfeaturefusionanddisentanglementforobjectdetection
AT caoyang anovelpyramidnetworkwithfeaturefusionanddisentanglementforobjectdetection
AT yuguoyi novelpyramidnetworkwithfeaturefusionanddisentanglementforobjectdetection
AT wuyou novelpyramidnetworkwithfeaturefusionanddisentanglementforobjectdetection
AT xiaojing novelpyramidnetworkwithfeaturefusionanddisentanglementforobjectdetection
AT caoyang novelpyramidnetworkwithfeaturefusionanddisentanglementforobjectdetection