Cargando…
Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance
A saliency attention model for predicting eye direction is proposed in this paper. This work is inspired by the success of the topological structure and Earth Mover’s Distance (EMD) approach. Firstly, we extract visual saliency features such as color contrast, intensity contrast, orientation, and te...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5528872/ https://www.ncbi.nlm.nih.gov/pubmed/28746351 http://dx.doi.org/10.1371/journal.pone.0181543 |
_version_ | 1783253048056872960 |
---|---|
author | Wei, Longsheng Peng, Jian Liu, Wei Wang, Xinmei Liu, Feng |
author_facet | Wei, Longsheng Peng, Jian Liu, Wei Wang, Xinmei Liu, Feng |
author_sort | Wei, Longsheng |
collection | PubMed |
description | A saliency attention model for predicting eye direction is proposed in this paper. This work is inspired by the success of the topological structure and Earth Mover’s Distance (EMD) approach. Firstly, we extract visual saliency features such as color contrast, intensity contrast, orientation, and texture. Then, we eliminate disconnected regions in the feature maps to keep topological structure. Secondly, we calculate center surround difference using across-scale EMD between different scales feature maps, rather than utilizing the Difference of Gaussian (DoG), which is used in many other saliency attention models. Thirdly, we across-scale fuse the feature maps in different scale and same feature. Lastly, we take advantage of competition function to calculate feature maps in same feature to form a saliency map, which is use to predict eye direction. Experimental results demonstrated the proposed model outperformed the state-of-the-art schemes in eye direction prediction community. |
format | Online Article Text |
id | pubmed-5528872 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-55288722017-08-07 Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance Wei, Longsheng Peng, Jian Liu, Wei Wang, Xinmei Liu, Feng PLoS One Research Article A saliency attention model for predicting eye direction is proposed in this paper. This work is inspired by the success of the topological structure and Earth Mover’s Distance (EMD) approach. Firstly, we extract visual saliency features such as color contrast, intensity contrast, orientation, and texture. Then, we eliminate disconnected regions in the feature maps to keep topological structure. Secondly, we calculate center surround difference using across-scale EMD between different scales feature maps, rather than utilizing the Difference of Gaussian (DoG), which is used in many other saliency attention models. Thirdly, we across-scale fuse the feature maps in different scale and same feature. Lastly, we take advantage of competition function to calculate feature maps in same feature to form a saliency map, which is use to predict eye direction. Experimental results demonstrated the proposed model outperformed the state-of-the-art schemes in eye direction prediction community. Public Library of Science 2017-07-26 /pmc/articles/PMC5528872/ /pubmed/28746351 http://dx.doi.org/10.1371/journal.pone.0181543 Text en © 2017 Wei et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Wei, Longsheng Peng, Jian Liu, Wei Wang, Xinmei Liu, Feng Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance |
title | Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance |
title_full | Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance |
title_fullStr | Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance |
title_full_unstemmed | Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance |
title_short | Modelling saliency attention to predict eye direction by topological structure and earth mover’s distance |
title_sort | modelling saliency attention to predict eye direction by topological structure and earth mover’s distance |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5528872/ https://www.ncbi.nlm.nih.gov/pubmed/28746351 http://dx.doi.org/10.1371/journal.pone.0181543 |
work_keys_str_mv | AT weilongsheng modellingsaliencyattentiontopredicteyedirectionbytopologicalstructureandearthmoversdistance AT pengjian modellingsaliencyattentiontopredicteyedirectionbytopologicalstructureandearthmoversdistance AT liuwei modellingsaliencyattentiontopredicteyedirectionbytopologicalstructureandearthmoversdistance AT wangxinmei modellingsaliencyattentiontopredicteyedirectionbytopologicalstructureandearthmoversdistance AT liufeng modellingsaliencyattentiontopredicteyedirectionbytopologicalstructureandearthmoversdistance |