Cargando…

RGB-D salient object detection: A survey

Salient object detection, which simulates human visual perception in locating the most significant object(s) in a scene, has been widely applied to various computer vision tasks. Now, the advent of depth sensors means that depth maps can easily be captured; this additional spatial information can bo...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhou, Tao, Fan, Deng-Ping, Cheng, Ming-Ming, Shen, Jianbing, Shao, Ling
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Tsinghua University Press 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7788385/
https://www.ncbi.nlm.nih.gov/pubmed/33432275
http://dx.doi.org/10.1007/s41095-020-0199-z
_version_ 1783633021497245696
author Zhou, Tao
Fan, Deng-Ping
Cheng, Ming-Ming
Shen, Jianbing
Shao, Ling
author_facet Zhou, Tao
Fan, Deng-Ping
Cheng, Ming-Ming
Shen, Jianbing
Shao, Ling
author_sort Zhou, Tao
collection PubMed
description Salient object detection, which simulates human visual perception in locating the most significant object(s) in a scene, has been widely applied to various computer vision tasks. Now, the advent of depth sensors means that depth maps can easily be captured; this additional spatial information can boost the performance of salient object detection. Although various RGB-D based salient object detection models with promising performance have been proposed over the past several years, an in-depth understanding of these models and the challenges in this field remains lacking. In this paper, we provide a comprehensive survey of RGB-D based salient object detection models from various perspectives, and review related benchmark datasets in detail. Further, as light fields can also provide depth maps, we review salient object detection models and popular benchmark datasets from this domain too. Moreover, to investigate the ability of existing models to detect salient objects, we have carried out a comprehensive attribute-based evaluation of several representative RGB-D based salient object detection models. Finally, we discuss several challenges and open directions of RGB-D based salient object detection for future research. All collected models, benchmark datasets, datasets constructed for attribute-based evaluation, and related code are publicly available at https://github.com/taozh2017/RGBD-SODsurvey.
format Online
Article
Text
id pubmed-7788385
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Tsinghua University Press
record_format MEDLINE/PubMed
spelling pubmed-77883852021-01-07 RGB-D salient object detection: A survey Zhou, Tao Fan, Deng-Ping Cheng, Ming-Ming Shen, Jianbing Shao, Ling Comput Vis Media (Beijing) Review Article Salient object detection, which simulates human visual perception in locating the most significant object(s) in a scene, has been widely applied to various computer vision tasks. Now, the advent of depth sensors means that depth maps can easily be captured; this additional spatial information can boost the performance of salient object detection. Although various RGB-D based salient object detection models with promising performance have been proposed over the past several years, an in-depth understanding of these models and the challenges in this field remains lacking. In this paper, we provide a comprehensive survey of RGB-D based salient object detection models from various perspectives, and review related benchmark datasets in detail. Further, as light fields can also provide depth maps, we review salient object detection models and popular benchmark datasets from this domain too. Moreover, to investigate the ability of existing models to detect salient objects, we have carried out a comprehensive attribute-based evaluation of several representative RGB-D based salient object detection models. Finally, we discuss several challenges and open directions of RGB-D based salient object detection for future research. All collected models, benchmark datasets, datasets constructed for attribute-based evaluation, and related code are publicly available at https://github.com/taozh2017/RGBD-SODsurvey. Tsinghua University Press 2021-01-07 2021 /pmc/articles/PMC7788385/ /pubmed/33432275 http://dx.doi.org/10.1007/s41095-020-0199-z Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www.editorialmanager.com/cvmj.
spellingShingle Review Article
Zhou, Tao
Fan, Deng-Ping
Cheng, Ming-Ming
Shen, Jianbing
Shao, Ling
RGB-D salient object detection: A survey
title RGB-D salient object detection: A survey
title_full RGB-D salient object detection: A survey
title_fullStr RGB-D salient object detection: A survey
title_full_unstemmed RGB-D salient object detection: A survey
title_short RGB-D salient object detection: A survey
title_sort rgb-d salient object detection: a survey
topic Review Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7788385/
https://www.ncbi.nlm.nih.gov/pubmed/33432275
http://dx.doi.org/10.1007/s41095-020-0199-z
work_keys_str_mv AT zhoutao rgbdsalientobjectdetectionasurvey
AT fandengping rgbdsalientobjectdetectionasurvey
AT chengmingming rgbdsalientobjectdetectionasurvey
AT shenjianbing rgbdsalientobjectdetectionasurvey
AT shaoling rgbdsalientobjectdetectionasurvey