Cargando…

Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance

A saliency attention model for predicting eye direction is proposed in this paper. This work is inspired by the success of the topological structure and Earth Mover’s Distance (EMD) approach. Firstly, we extract visual saliency features such as color contrast, intensity contrast, orientation, and te...

Descripción completa

Detalles Bibliográficos
Autores principales: Wei, Longsheng, Peng, Jian, Liu, Wei, Wang, Xinmei, Liu, Feng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5528872/
https://www.ncbi.nlm.nih.gov/pubmed/28746351
http://dx.doi.org/10.1371/journal.pone.0181543
_version_ 1783253048056872960
author Wei, Longsheng
Peng, Jian
Liu, Wei
Wang, Xinmei
Liu, Feng
author_facet Wei, Longsheng
Peng, Jian
Liu, Wei
Wang, Xinmei
Liu, Feng
author_sort Wei, Longsheng
collection PubMed
description A saliency attention model for predicting eye direction is proposed in this paper. This work is inspired by the success of the topological structure and Earth Mover’s Distance (EMD) approach. Firstly, we extract visual saliency features such as color contrast, intensity contrast, orientation, and texture. Then, we eliminate disconnected regions in the feature maps to keep topological structure. Secondly, we calculate center surround difference using across-scale EMD between different scales feature maps, rather than utilizing the Difference of Gaussian (DoG), which is used in many other saliency attention models. Thirdly, we across-scale fuse the feature maps in different scale and same feature. Lastly, we take advantage of competition function to calculate feature maps in same feature to form a saliency map, which is use to predict eye direction. Experimental results demonstrated the proposed model outperformed the state-of-the-art schemes in eye direction prediction community.
format Online
Article
Text
id pubmed-5528872
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-55288722017-08-07 Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance Wei, Longsheng Peng, Jian Liu, Wei Wang, Xinmei Liu, Feng PLoS One Research Article A saliency attention model for predicting eye direction is proposed in this paper. This work is inspired by the success of the topological structure and Earth Mover’s Distance (EMD) approach. Firstly, we extract visual saliency features such as color contrast, intensity contrast, orientation, and texture. Then, we eliminate disconnected regions in the feature maps to keep topological structure. Secondly, we calculate center surround difference using across-scale EMD between different scales feature maps, rather than utilizing the Difference of Gaussian (DoG), which is used in many other saliency attention models. Thirdly, we across-scale fuse the feature maps in different scale and same feature. Lastly, we take advantage of competition function to calculate feature maps in same feature to form a saliency map, which is use to predict eye direction. Experimental results demonstrated the proposed model outperformed the state-of-the-art schemes in eye direction prediction community. Public Library of Science 2017-07-26 /pmc/articles/PMC5528872/ /pubmed/28746351 http://dx.doi.org/10.1371/journal.pone.0181543 Text en © 2017 Wei et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Wei, Longsheng
Peng, Jian
Liu, Wei
Wang, Xinmei
Liu, Feng
Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance
title Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance
title_full Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance
title_fullStr Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance
title_full_unstemmed Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance
title_short Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance
title_sort modelling saliency attention to predict eye direction by topological structure and earth mover’s distance
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5528872/
https://www.ncbi.nlm.nih.gov/pubmed/28746351
http://dx.doi.org/10.1371/journal.pone.0181543
work_keys_str_mv AT weilongsheng modellingsaliencyattentiontopredicteyedirectionbytopologicalstructureandearthmoversdistance
AT pengjian modellingsaliencyattentiontopredicteyedirectionbytopologicalstructureandearthmoversdistance
AT liuwei modellingsaliencyattentiontopredicteyedirectionbytopologicalstructureandearthmoversdistance
AT wangxinmei modellingsaliencyattentiontopredicteyedirectionbytopologicalstructureandearthmoversdistance
AT liufeng modellingsaliencyattentiontopredicteyedirectionbytopologicalstructureandearthmoversdistance