Cargando…

3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection

Salient object detection is a hot spot of current computer vision. The emergence of the convolutional neural network (CNN) greatly improves the existing detection methods. In this paper, we present 3MNet, which is based on the CNN, to make the utmost of various features of the image and utilize the...

Descripción completa

Detalles Bibliográficos
Autores principales: Yan, Xinghe, Chen, Zhenxue, Wu, Q. M. Jonathan, Lu, Mengxu, Sun, Luna
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Berlin Heidelberg 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7891124/
https://www.ncbi.nlm.nih.gov/pubmed/33623184
http://dx.doi.org/10.1007/s00138-021-01172-y
_version_ 1783652639955746816
author Yan, Xinghe
Chen, Zhenxue
Wu, Q. M. Jonathan
Lu, Mengxu
Sun, Luna
author_facet Yan, Xinghe
Chen, Zhenxue
Wu, Q. M. Jonathan
Lu, Mengxu
Sun, Luna
author_sort Yan, Xinghe
collection PubMed
description Salient object detection is a hot spot of current computer vision. The emergence of the convolutional neural network (CNN) greatly improves the existing detection methods. In this paper, we present 3MNet, which is based on the CNN, to make the utmost of various features of the image and utilize the contour detection task of the salient object to explicitly model the features of multi-level structures, multiple tasks and multiple channels, so as to obtain the final saliency map of the fusion of these features. Specifically, we first utilize contour detection task for auxiliary detection and then utilize use multi-layer network structure to extract multi-scale image information. Finally, we introduce a unique module into the network to model the channel information of the image. Our network has produced good results on five widely used datasets. In addition, we also conducted a series of ablation experiments to verify the effectiveness of some components in the network.
format Online
Article
Text
id pubmed-7891124
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Springer Berlin Heidelberg
record_format MEDLINE/PubMed
spelling pubmed-78911242021-02-19 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection Yan, Xinghe Chen, Zhenxue Wu, Q. M. Jonathan Lu, Mengxu Sun, Luna Mach Vis Appl Original Paper Salient object detection is a hot spot of current computer vision. The emergence of the convolutional neural network (CNN) greatly improves the existing detection methods. In this paper, we present 3MNet, which is based on the CNN, to make the utmost of various features of the image and utilize the contour detection task of the salient object to explicitly model the features of multi-level structures, multiple tasks and multiple channels, so as to obtain the final saliency map of the fusion of these features. Specifically, we first utilize contour detection task for auxiliary detection and then utilize use multi-layer network structure to extract multi-scale image information. Finally, we introduce a unique module into the network to model the channel information of the image. Our network has produced good results on five widely used datasets. In addition, we also conducted a series of ablation experiments to verify the effectiveness of some components in the network. Springer Berlin Heidelberg 2021-02-18 2021 /pmc/articles/PMC7891124/ /pubmed/33623184 http://dx.doi.org/10.1007/s00138-021-01172-y Text en © The Author(s), under exclusive licence to Springer-Verlag GmbH, DE part of Springer Nature 2021 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Original Paper
Yan, Xinghe
Chen, Zhenxue
Wu, Q. M. Jonathan
Lu, Mengxu
Sun, Luna
3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection
title 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection
title_full 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection
title_fullStr 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection
title_full_unstemmed 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection
title_short 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection
title_sort 3mnet: multi-task, multi-level and multi-channel feature aggregation network for salient object detection
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7891124/
https://www.ncbi.nlm.nih.gov/pubmed/33623184
http://dx.doi.org/10.1007/s00138-021-01172-y
work_keys_str_mv AT yanxinghe 3mnetmultitaskmultilevelandmultichannelfeatureaggregationnetworkforsalientobjectdetection
AT chenzhenxue 3mnetmultitaskmultilevelandmultichannelfeatureaggregationnetworkforsalientobjectdetection
AT wuqmjonathan 3mnetmultitaskmultilevelandmultichannelfeatureaggregationnetworkforsalientobjectdetection
AT lumengxu 3mnetmultitaskmultilevelandmultichannelfeatureaggregationnetworkforsalientobjectdetection
AT sunluna 3mnetmultitaskmultilevelandmultichannelfeatureaggregationnetworkforsalientobjectdetection