Cargando…

Entrainment and Modulation of Gesture–Speech Synchrony Under Delayed Auditory Feedback

Gesture–speech synchrony re‐stabilizes when hand movement or speech is disrupted by a delayed feedback manipulation, suggesting strong bidirectional coupling between gesture and speech. Yet it has also been argued from case studies in perceptual–motor pathology that hand gestures are a special kind...

Descripción completa

Detalles Bibliográficos
Autores principales: Pouw, Wim, Dixon, James A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6593786/
https://www.ncbi.nlm.nih.gov/pubmed/30900288
http://dx.doi.org/10.1111/cogs.12721
_version_ 1783430123937071104
author Pouw, Wim
Dixon, James A.
author_facet Pouw, Wim
Dixon, James A.
author_sort Pouw, Wim
collection PubMed
description Gesture–speech synchrony re‐stabilizes when hand movement or speech is disrupted by a delayed feedback manipulation, suggesting strong bidirectional coupling between gesture and speech. Yet it has also been argued from case studies in perceptual–motor pathology that hand gestures are a special kind of action that does not require closed‐loop re‐afferent feedback to maintain synchrony with speech. In the current pre‐registered within‐subject study, we used motion tracking to conceptually replicate McNeill's (1992) classic study on gesture–speech synchrony under normal and 150 ms delayed auditory feedback of speech conditions (NO DAF vs. DAF). Consistent with, and extending McNeill's original results, we obtain evidence that (a) gesture‐speech synchrony is more stable under DAF versus NO DAF (i.e., increased coupling effect), (b) that gesture and speech variably entrain to the external auditory delay as indicated by a consistent shift in gesture‐speech synchrony offsets (i.e., entrainment effect), and (c) that the coupling effect and the entrainment effect are co‐dependent. We suggest, therefore, that gesture–speech synchrony provides a way for the cognitive system to stabilize rhythmic activity under interfering conditions.
format Online
Article
Text
id pubmed-6593786
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-65937862019-07-10 Entrainment and Modulation of Gesture–Speech Synchrony Under Delayed Auditory Feedback Pouw, Wim Dixon, James A. Cogn Sci Regular Articles Gesture–speech synchrony re‐stabilizes when hand movement or speech is disrupted by a delayed feedback manipulation, suggesting strong bidirectional coupling between gesture and speech. Yet it has also been argued from case studies in perceptual–motor pathology that hand gestures are a special kind of action that does not require closed‐loop re‐afferent feedback to maintain synchrony with speech. In the current pre‐registered within‐subject study, we used motion tracking to conceptually replicate McNeill's (1992) classic study on gesture–speech synchrony under normal and 150 ms delayed auditory feedback of speech conditions (NO DAF vs. DAF). Consistent with, and extending McNeill's original results, we obtain evidence that (a) gesture‐speech synchrony is more stable under DAF versus NO DAF (i.e., increased coupling effect), (b) that gesture and speech variably entrain to the external auditory delay as indicated by a consistent shift in gesture‐speech synchrony offsets (i.e., entrainment effect), and (c) that the coupling effect and the entrainment effect are co‐dependent. We suggest, therefore, that gesture–speech synchrony provides a way for the cognitive system to stabilize rhythmic activity under interfering conditions. John Wiley and Sons Inc. 2019-03-18 2019-03 /pmc/articles/PMC6593786/ /pubmed/30900288 http://dx.doi.org/10.1111/cogs.12721 Text en © 2019 The Authors. Cognitive Science published by Wiley Periodicals, Inc. on behalf of Cognitive Science Society This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Regular Articles
Pouw, Wim
Dixon, James A.
Entrainment and Modulation of Gesture–Speech Synchrony Under Delayed Auditory Feedback
title Entrainment and Modulation of Gesture–Speech Synchrony Under Delayed Auditory Feedback
title_full Entrainment and Modulation of Gesture–Speech Synchrony Under Delayed Auditory Feedback
title_fullStr Entrainment and Modulation of Gesture–Speech Synchrony Under Delayed Auditory Feedback
title_full_unstemmed Entrainment and Modulation of Gesture–Speech Synchrony Under Delayed Auditory Feedback
title_short Entrainment and Modulation of Gesture–Speech Synchrony Under Delayed Auditory Feedback
title_sort entrainment and modulation of gesture–speech synchrony under delayed auditory feedback
topic Regular Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6593786/
https://www.ncbi.nlm.nih.gov/pubmed/30900288
http://dx.doi.org/10.1111/cogs.12721
work_keys_str_mv AT pouwwim entrainmentandmodulationofgesturespeechsynchronyunderdelayedauditoryfeedback
AT dixonjamesa entrainmentandmodulationofgesturespeechsynchronyunderdelayedauditoryfeedback