Cargando…
The Influence of Visual Uncertainty on Word Surprisal and Processing Effort
A word’s predictability or surprisal, as determined by cloze probabilities or language models (Frank, 2013) is related to processing effort, in that less expected words take more effort to process (Hale, 2001; Lau et al., 2013). A word’s surprisal, however, may also be influenced by the non-linguist...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6302025/ https://www.ncbi.nlm.nih.gov/pubmed/30618905 http://dx.doi.org/10.3389/fpsyg.2018.02387 |
_version_ | 1783381901146324992 |
---|---|
author | Ankener, Christine S. Sekicki, Mirjana Staudte, Maria |
author_facet | Ankener, Christine S. Sekicki, Mirjana Staudte, Maria |
author_sort | Ankener, Christine S. |
collection | PubMed |
description | A word’s predictability or surprisal, as determined by cloze probabilities or language models (Frank, 2013) is related to processing effort, in that less expected words take more effort to process (Hale, 2001; Lau et al., 2013). A word’s surprisal, however, may also be influenced by the non-linguistic context, such as visual cues: In the visual world paradigm (VWP), anticipatory eye movements suggest that listeners exploit the scene to predict what will be mentioned next (Altmann and Kamide, 1999). How visual context affects surprisal and processing effort, however, remains unclear. Here, we present a series of four studies providing evidence on how visually-determined probabilistic expectations for a spoken target word, as indicated by anticipatory eye movements, predict graded processing effort for that word, as assessed by a pupillometric measure (the Index of Cognitive Activity, ICA). These findings are a clear and robust demonstration that the non-linguistic context can immediately influence both lexical expectations, and surprisal-based processing effort. |
format | Online Article Text |
id | pubmed-6302025 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-63020252019-01-07 The Influence of Visual Uncertainty on Word Surprisal and Processing Effort Ankener, Christine S. Sekicki, Mirjana Staudte, Maria Front Psychol Psychology A word’s predictability or surprisal, as determined by cloze probabilities or language models (Frank, 2013) is related to processing effort, in that less expected words take more effort to process (Hale, 2001; Lau et al., 2013). A word’s surprisal, however, may also be influenced by the non-linguistic context, such as visual cues: In the visual world paradigm (VWP), anticipatory eye movements suggest that listeners exploit the scene to predict what will be mentioned next (Altmann and Kamide, 1999). How visual context affects surprisal and processing effort, however, remains unclear. Here, we present a series of four studies providing evidence on how visually-determined probabilistic expectations for a spoken target word, as indicated by anticipatory eye movements, predict graded processing effort for that word, as assessed by a pupillometric measure (the Index of Cognitive Activity, ICA). These findings are a clear and robust demonstration that the non-linguistic context can immediately influence both lexical expectations, and surprisal-based processing effort. Frontiers Media S.A. 2018-12-14 /pmc/articles/PMC6302025/ /pubmed/30618905 http://dx.doi.org/10.3389/fpsyg.2018.02387 Text en Copyright © 2018 Ankener, Sekicki and Staudte. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychology Ankener, Christine S. Sekicki, Mirjana Staudte, Maria The Influence of Visual Uncertainty on Word Surprisal and Processing Effort |
title | The Influence of Visual Uncertainty on Word Surprisal and Processing Effort |
title_full | The Influence of Visual Uncertainty on Word Surprisal and Processing Effort |
title_fullStr | The Influence of Visual Uncertainty on Word Surprisal and Processing Effort |
title_full_unstemmed | The Influence of Visual Uncertainty on Word Surprisal and Processing Effort |
title_short | The Influence of Visual Uncertainty on Word Surprisal and Processing Effort |
title_sort | influence of visual uncertainty on word surprisal and processing effort |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6302025/ https://www.ncbi.nlm.nih.gov/pubmed/30618905 http://dx.doi.org/10.3389/fpsyg.2018.02387 |
work_keys_str_mv | AT ankenerchristines theinfluenceofvisualuncertaintyonwordsurprisalandprocessingeffort AT sekickimirjana theinfluenceofvisualuncertaintyonwordsurprisalandprocessingeffort AT staudtemaria theinfluenceofvisualuncertaintyonwordsurprisalandprocessingeffort AT ankenerchristines influenceofvisualuncertaintyonwordsurprisalandprocessingeffort AT sekickimirjana influenceofvisualuncertaintyonwordsurprisalandprocessingeffort AT staudtemaria influenceofvisualuncertaintyonwordsurprisalandprocessingeffort |