Cargando…

Can you handle this? The impact of object affordances on how co-speech gestures are produced

Hand gestures are tightly coupled with speech and with action. Hence, recent accounts have emphasised the idea that simulations of spatio-motoric imagery underlie the production of co-speech gestures. In this study, we suggest that action simulations directly influence the iconic strategies used by...

Descripción completa

Detalles Bibliográficos
Autores principales: Masson-Carro, Ingrid, Goudbeek, Martijn, Krahmer, Emiel
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Routledge 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4867791/
https://www.ncbi.nlm.nih.gov/pubmed/27226970
http://dx.doi.org/10.1080/23273798.2015.1108448
_version_ 1782432090626719744
author Masson-Carro, Ingrid
Goudbeek, Martijn
Krahmer, Emiel
author_facet Masson-Carro, Ingrid
Goudbeek, Martijn
Krahmer, Emiel
author_sort Masson-Carro, Ingrid
collection PubMed
description Hand gestures are tightly coupled with speech and with action. Hence, recent accounts have emphasised the idea that simulations of spatio-motoric imagery underlie the production of co-speech gestures. In this study, we suggest that action simulations directly influence the iconic strategies used by speakers to translate aspects of their mental representations into gesture. Using a classic referential paradigm, we investigate how speakers respond gesturally to the affordances of objects, by comparing the effects of describing objects that afford action performance (such as tools) and those that do not, on gesture production. Our results suggest that affordances play a key role in determining the amount of representational (but not non-representational) gestures produced by speakers, and the techniques chosen to depict such objects. To our knowledge, this is the first study to systematically show a connection between object characteristics and representation techniques in spontaneous gesture production during the depiction of static referents.
format Online
Article
Text
id pubmed-4867791
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Routledge
record_format MEDLINE/PubMed
spelling pubmed-48677912016-05-23 Can you handle this? The impact of object affordances on how co-speech gestures are produced Masson-Carro, Ingrid Goudbeek, Martijn Krahmer, Emiel Lang Cogn Neurosci Articles Hand gestures are tightly coupled with speech and with action. Hence, recent accounts have emphasised the idea that simulations of spatio-motoric imagery underlie the production of co-speech gestures. In this study, we suggest that action simulations directly influence the iconic strategies used by speakers to translate aspects of their mental representations into gesture. Using a classic referential paradigm, we investigate how speakers respond gesturally to the affordances of objects, by comparing the effects of describing objects that afford action performance (such as tools) and those that do not, on gesture production. Our results suggest that affordances play a key role in determining the amount of representational (but not non-representational) gestures produced by speakers, and the techniques chosen to depict such objects. To our knowledge, this is the first study to systematically show a connection between object characteristics and representation techniques in spontaneous gesture production during the depiction of static referents. Routledge 2016-03-15 2015-11-04 /pmc/articles/PMC4867791/ /pubmed/27226970 http://dx.doi.org/10.1080/23273798.2015.1108448 Text en © 2015 The Author(s). Published by Taylor & Francis. http://creativecommons.org/licenses/by-nc-nd/4.0/ This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited, and is not altered, transformed, or built upon in any way.
spellingShingle Articles
Masson-Carro, Ingrid
Goudbeek, Martijn
Krahmer, Emiel
Can you handle this? The impact of object affordances on how co-speech gestures are produced
title Can you handle this? The impact of object affordances on how co-speech gestures are produced
title_full Can you handle this? The impact of object affordances on how co-speech gestures are produced
title_fullStr Can you handle this? The impact of object affordances on how co-speech gestures are produced
title_full_unstemmed Can you handle this? The impact of object affordances on how co-speech gestures are produced
title_short Can you handle this? The impact of object affordances on how co-speech gestures are produced
title_sort can you handle this? the impact of object affordances on how co-speech gestures are produced
topic Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4867791/
https://www.ncbi.nlm.nih.gov/pubmed/27226970
http://dx.doi.org/10.1080/23273798.2015.1108448
work_keys_str_mv AT massoncarroingrid canyouhandlethistheimpactofobjectaffordancesonhowcospeechgesturesareproduced
AT goudbeekmartijn canyouhandlethistheimpactofobjectaffordancesonhowcospeechgesturesareproduced
AT krahmeremiel canyouhandlethistheimpactofobjectaffordancesonhowcospeechgesturesareproduced