Cargando…
Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding
In a novel computer mouse tracking paradigm, participants read a spatial phrase such as “The blue item to the left of the red one” and then see a scene composed of 12 visual items. The task is to move the mouse cursor to the target item (here, blue), which requires perceptually grounding the spatial...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer US
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6848251/ https://www.ncbi.nlm.nih.gov/pubmed/31515771 http://dx.doi.org/10.3758/s13414-019-01847-9 |
_version_ | 1783469057293418496 |
---|---|
author | Lins, Jonas Schöner, Gregor |
author_facet | Lins, Jonas Schöner, Gregor |
author_sort | Lins, Jonas |
collection | PubMed |
description | In a novel computer mouse tracking paradigm, participants read a spatial phrase such as “The blue item to the left of the red one” and then see a scene composed of 12 visual items. The task is to move the mouse cursor to the target item (here, blue), which requires perceptually grounding the spatial phrase. This entails visually identifying the reference item (here, red) and other relevant items through attentional selection. Response trajectories are attracted toward distractors that share the target color but match the spatial relation less well. Trajectories are also attracted toward items that share the reference color. A competing pair of items that match the specified colors but are in the inverse spatial relation increases attraction over-additively compared to individual items. Trajectories are also influenced by the spatial term itself. While the distractor effect resembles deviation toward potential targets in previous studies, the reference effect suggests that the relevance of the reference item for the relational task, not its role as a potential target, was critical. This account is supported by the strengthened effect of a competing pair. We conclude, therefore, that the attraction effects in the mouse trajectories reflect the neural processes that operate on sensorimotor representations to solve the relational task. The paradigm thus provides an experimental window through motor behavior into higher cognitive function and the evolution of activation in modal substrates, a longstanding topic in the area of embodied cognition. |
format | Online Article Text |
id | pubmed-6848251 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Springer US |
record_format | MEDLINE/PubMed |
spelling | pubmed-68482512019-11-22 Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding Lins, Jonas Schöner, Gregor Atten Percept Psychophys Time for Action: Reaching for a Better Understanding of the Dynamics of Cognition In a novel computer mouse tracking paradigm, participants read a spatial phrase such as “The blue item to the left of the red one” and then see a scene composed of 12 visual items. The task is to move the mouse cursor to the target item (here, blue), which requires perceptually grounding the spatial phrase. This entails visually identifying the reference item (here, red) and other relevant items through attentional selection. Response trajectories are attracted toward distractors that share the target color but match the spatial relation less well. Trajectories are also attracted toward items that share the reference color. A competing pair of items that match the specified colors but are in the inverse spatial relation increases attraction over-additively compared to individual items. Trajectories are also influenced by the spatial term itself. While the distractor effect resembles deviation toward potential targets in previous studies, the reference effect suggests that the relevance of the reference item for the relational task, not its role as a potential target, was critical. This account is supported by the strengthened effect of a competing pair. We conclude, therefore, that the attraction effects in the mouse trajectories reflect the neural processes that operate on sensorimotor representations to solve the relational task. The paradigm thus provides an experimental window through motor behavior into higher cognitive function and the evolution of activation in modal substrates, a longstanding topic in the area of embodied cognition. Springer US 2019-09-12 2019 /pmc/articles/PMC6848251/ /pubmed/31515771 http://dx.doi.org/10.3758/s13414-019-01847-9 Text en © The Author(s) 2019 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. |
spellingShingle | Time for Action: Reaching for a Better Understanding of the Dynamics of Cognition Lins, Jonas Schöner, Gregor Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding |
title | Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding |
title_full | Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding |
title_fullStr | Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding |
title_full_unstemmed | Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding |
title_short | Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding |
title_sort | computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding |
topic | Time for Action: Reaching for a Better Understanding of the Dynamics of Cognition |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6848251/ https://www.ncbi.nlm.nih.gov/pubmed/31515771 http://dx.doi.org/10.3758/s13414-019-01847-9 |
work_keys_str_mv | AT linsjonas computermousetrackingrevealsmotorsignaturesinacognitivetaskofspatiallanguagegrounding AT schonergregor computermousetrackingrevealsmotorsignaturesinacognitivetaskofspatiallanguagegrounding |