Cargando…

Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding

In a novel computer mouse tracking paradigm, participants read a spatial phrase such as “The blue item to the left of the red one” and then see a scene composed of 12 visual items. The task is to move the mouse cursor to the target item (here, blue), which requires perceptually grounding the spatial...

Descripción completa

Detalles Bibliográficos
Autores principales: Lins, Jonas, Schöner, Gregor
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6848251/
https://www.ncbi.nlm.nih.gov/pubmed/31515771
http://dx.doi.org/10.3758/s13414-019-01847-9
_version_ 1783469057293418496
author Lins, Jonas
Schöner, Gregor
author_facet Lins, Jonas
Schöner, Gregor
author_sort Lins, Jonas
collection PubMed
description In a novel computer mouse tracking paradigm, participants read a spatial phrase such as “The blue item to the left of the red one” and then see a scene composed of 12 visual items. The task is to move the mouse cursor to the target item (here, blue), which requires perceptually grounding the spatial phrase. This entails visually identifying the reference item (here, red) and other relevant items through attentional selection. Response trajectories are attracted toward distractors that share the target color but match the spatial relation less well. Trajectories are also attracted toward items that share the reference color. A competing pair of items that match the specified colors but are in the inverse spatial relation increases attraction over-additively compared to individual items. Trajectories are also influenced by the spatial term itself. While the distractor effect resembles deviation toward potential targets in previous studies, the reference effect suggests that the relevance of the reference item for the relational task, not its role as a potential target, was critical. This account is supported by the strengthened effect of a competing pair. We conclude, therefore, that the attraction effects in the mouse trajectories reflect the neural processes that operate on sensorimotor representations to solve the relational task. The paradigm thus provides an experimental window through motor behavior into higher cognitive function and the evolution of activation in modal substrates, a longstanding topic in the area of embodied cognition.
format Online
Article
Text
id pubmed-6848251
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-68482512019-11-22 Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding Lins, Jonas Schöner, Gregor Atten Percept Psychophys Time for Action: Reaching for a Better Understanding of the Dynamics of Cognition In a novel computer mouse tracking paradigm, participants read a spatial phrase such as “The blue item to the left of the red one” and then see a scene composed of 12 visual items. The task is to move the mouse cursor to the target item (here, blue), which requires perceptually grounding the spatial phrase. This entails visually identifying the reference item (here, red) and other relevant items through attentional selection. Response trajectories are attracted toward distractors that share the target color but match the spatial relation less well. Trajectories are also attracted toward items that share the reference color. A competing pair of items that match the specified colors but are in the inverse spatial relation increases attraction over-additively compared to individual items. Trajectories are also influenced by the spatial term itself. While the distractor effect resembles deviation toward potential targets in previous studies, the reference effect suggests that the relevance of the reference item for the relational task, not its role as a potential target, was critical. This account is supported by the strengthened effect of a competing pair. We conclude, therefore, that the attraction effects in the mouse trajectories reflect the neural processes that operate on sensorimotor representations to solve the relational task. The paradigm thus provides an experimental window through motor behavior into higher cognitive function and the evolution of activation in modal substrates, a longstanding topic in the area of embodied cognition. Springer US 2019-09-12 2019 /pmc/articles/PMC6848251/ /pubmed/31515771 http://dx.doi.org/10.3758/s13414-019-01847-9 Text en © The Author(s) 2019 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
spellingShingle Time for Action: Reaching for a Better Understanding of the Dynamics of Cognition
Lins, Jonas
Schöner, Gregor
Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding
title Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding
title_full Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding
title_fullStr Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding
title_full_unstemmed Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding
title_short Computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding
title_sort computer mouse tracking reveals motor signatures in a cognitive task of spatial language grounding
topic Time for Action: Reaching for a Better Understanding of the Dynamics of Cognition
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6848251/
https://www.ncbi.nlm.nih.gov/pubmed/31515771
http://dx.doi.org/10.3758/s13414-019-01847-9
work_keys_str_mv AT linsjonas computermousetrackingrevealsmotorsignaturesinacognitivetaskofspatiallanguagegrounding
AT schonergregor computermousetrackingrevealsmotorsignaturesinacognitivetaskofspatiallanguagegrounding