Cargando…
3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection
Salient object detection is a hot spot of current computer vision. The emergence of the convolutional neural network (CNN) greatly improves the existing detection methods. In this paper, we present 3MNet, which is based on the CNN, to make the utmost of various features of the image and utilize the...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer Berlin Heidelberg
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7891124/ https://www.ncbi.nlm.nih.gov/pubmed/33623184 http://dx.doi.org/10.1007/s00138-021-01172-y |
_version_ | 1783652639955746816 |
---|---|
author | Yan, Xinghe Chen, Zhenxue Wu, Q. M. Jonathan Lu, Mengxu Sun, Luna |
author_facet | Yan, Xinghe Chen, Zhenxue Wu, Q. M. Jonathan Lu, Mengxu Sun, Luna |
author_sort | Yan, Xinghe |
collection | PubMed |
description | Salient object detection is a hot spot of current computer vision. The emergence of the convolutional neural network (CNN) greatly improves the existing detection methods. In this paper, we present 3MNet, which is based on the CNN, to make the utmost of various features of the image and utilize the contour detection task of the salient object to explicitly model the features of multi-level structures, multiple tasks and multiple channels, so as to obtain the final saliency map of the fusion of these features. Specifically, we first utilize contour detection task for auxiliary detection and then utilize use multi-layer network structure to extract multi-scale image information. Finally, we introduce a unique module into the network to model the channel information of the image. Our network has produced good results on five widely used datasets. In addition, we also conducted a series of ablation experiments to verify the effectiveness of some components in the network. |
format | Online Article Text |
id | pubmed-7891124 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Springer Berlin Heidelberg |
record_format | MEDLINE/PubMed |
spelling | pubmed-78911242021-02-19 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection Yan, Xinghe Chen, Zhenxue Wu, Q. M. Jonathan Lu, Mengxu Sun, Luna Mach Vis Appl Original Paper Salient object detection is a hot spot of current computer vision. The emergence of the convolutional neural network (CNN) greatly improves the existing detection methods. In this paper, we present 3MNet, which is based on the CNN, to make the utmost of various features of the image and utilize the contour detection task of the salient object to explicitly model the features of multi-level structures, multiple tasks and multiple channels, so as to obtain the final saliency map of the fusion of these features. Specifically, we first utilize contour detection task for auxiliary detection and then utilize use multi-layer network structure to extract multi-scale image information. Finally, we introduce a unique module into the network to model the channel information of the image. Our network has produced good results on five widely used datasets. In addition, we also conducted a series of ablation experiments to verify the effectiveness of some components in the network. Springer Berlin Heidelberg 2021-02-18 2021 /pmc/articles/PMC7891124/ /pubmed/33623184 http://dx.doi.org/10.1007/s00138-021-01172-y Text en © The Author(s), under exclusive licence to Springer-Verlag GmbH, DE part of Springer Nature 2021 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Original Paper Yan, Xinghe Chen, Zhenxue Wu, Q. M. Jonathan Lu, Mengxu Sun, Luna 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection |
title | 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection |
title_full | 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection |
title_fullStr | 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection |
title_full_unstemmed | 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection |
title_short | 3MNet: Multi-task, multi-level and multi-channel feature aggregation network for salient object detection |
title_sort | 3mnet: multi-task, multi-level and multi-channel feature aggregation network for salient object detection |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7891124/ https://www.ncbi.nlm.nih.gov/pubmed/33623184 http://dx.doi.org/10.1007/s00138-021-01172-y |
work_keys_str_mv | AT yanxinghe 3mnetmultitaskmultilevelandmultichannelfeatureaggregationnetworkforsalientobjectdetection AT chenzhenxue 3mnetmultitaskmultilevelandmultichannelfeatureaggregationnetworkforsalientobjectdetection AT wuqmjonathan 3mnetmultitaskmultilevelandmultichannelfeatureaggregationnetworkforsalientobjectdetection AT lumengxu 3mnetmultitaskmultilevelandmultichannelfeatureaggregationnetworkforsalientobjectdetection AT sunluna 3mnetmultitaskmultilevelandmultichannelfeatureaggregationnetworkforsalientobjectdetection |