Cargando…
Multi-step planning of eye movements in visual search
The capability of directing gaze to relevant parts in the environment is crucial for our survival. Computational models have proposed quantitative accounts of human gaze selection in a range of visual search tasks. Initially, models suggested that gaze is directed to the locations in a visual scene...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6333838/ https://www.ncbi.nlm.nih.gov/pubmed/30644423 http://dx.doi.org/10.1038/s41598-018-37536-0 |
_version_ | 1783387630497431552 |
---|---|
author | Hoppe, David Rothkopf, Constantin A. |
author_facet | Hoppe, David Rothkopf, Constantin A. |
author_sort | Hoppe, David |
collection | PubMed |
description | The capability of directing gaze to relevant parts in the environment is crucial for our survival. Computational models have proposed quantitative accounts of human gaze selection in a range of visual search tasks. Initially, models suggested that gaze is directed to the locations in a visual scene at which some criterion such as the probability of target location, the reduction of uncertainty or the maximization of reward appear to be maximal. But subsequent studies established, that in some tasks humans instead direct their gaze to locations, such that after the single next look the criterion is expected to become maximal. However, in tasks going beyond a single action, the entire action sequence may determine future rewards thereby necessitating planning beyond a single next gaze shift. While previous empirical studies have suggested that human gaze sequences are planned, quantitative evidence for whether the human visual system is capable of finding optimal eye movement sequences according to probabilistic planning is missing. Here we employ a series of computational models to investigate whether humans are capable of looking ahead more than the next single eye movement. We found clear evidence that subjects’ behavior was better explained by the model of a planning observer compared to a myopic, greedy observer, which selects only a single saccade at a time. In particular, the location of our subjects’ first fixation differed depending on the stimulus and the time available for the search, which was well predicted quantitatively by a probabilistic planning model. Overall, our results are the first evidence that the human visual system’s gaze selection agrees with optimal planning under uncertainty. |
format | Online Article Text |
id | pubmed-6333838 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-63338382019-01-17 Multi-step planning of eye movements in visual search Hoppe, David Rothkopf, Constantin A. Sci Rep Article The capability of directing gaze to relevant parts in the environment is crucial for our survival. Computational models have proposed quantitative accounts of human gaze selection in a range of visual search tasks. Initially, models suggested that gaze is directed to the locations in a visual scene at which some criterion such as the probability of target location, the reduction of uncertainty or the maximization of reward appear to be maximal. But subsequent studies established, that in some tasks humans instead direct their gaze to locations, such that after the single next look the criterion is expected to become maximal. However, in tasks going beyond a single action, the entire action sequence may determine future rewards thereby necessitating planning beyond a single next gaze shift. While previous empirical studies have suggested that human gaze sequences are planned, quantitative evidence for whether the human visual system is capable of finding optimal eye movement sequences according to probabilistic planning is missing. Here we employ a series of computational models to investigate whether humans are capable of looking ahead more than the next single eye movement. We found clear evidence that subjects’ behavior was better explained by the model of a planning observer compared to a myopic, greedy observer, which selects only a single saccade at a time. In particular, the location of our subjects’ first fixation differed depending on the stimulus and the time available for the search, which was well predicted quantitatively by a probabilistic planning model. Overall, our results are the first evidence that the human visual system’s gaze selection agrees with optimal planning under uncertainty. Nature Publishing Group UK 2019-01-15 /pmc/articles/PMC6333838/ /pubmed/30644423 http://dx.doi.org/10.1038/s41598-018-37536-0 Text en © The Author(s) 2019 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Hoppe, David Rothkopf, Constantin A. Multi-step planning of eye movements in visual search |
title | Multi-step planning of eye movements in visual search |
title_full | Multi-step planning of eye movements in visual search |
title_fullStr | Multi-step planning of eye movements in visual search |
title_full_unstemmed | Multi-step planning of eye movements in visual search |
title_short | Multi-step planning of eye movements in visual search |
title_sort | multi-step planning of eye movements in visual search |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6333838/ https://www.ncbi.nlm.nih.gov/pubmed/30644423 http://dx.doi.org/10.1038/s41598-018-37536-0 |
work_keys_str_mv | AT hoppedavid multistepplanningofeyemovementsinvisualsearch AT rothkopfconstantina multistepplanningofeyemovementsinvisualsearch |