Cargando…

Gesture–speech physics in fluent speech and rhythmic upper limb movements

It is commonly understood that hand gesture and speech coordination in humans is culturally and cognitively acquired, rather than having a biological basis. Recently, however, the biomechanical physical coupling of arm movements to speech vocalization has been studied in steady‐state vocalization an...

Descripción completa

Detalles Bibliográficos
Autores principales: Pouw, Wim, de Jonge‐Hoekstra, Lisette, Harrison, Steven J., Paxton, Alexandra, Dixon, James A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8246948/
https://www.ncbi.nlm.nih.gov/pubmed/33336809
http://dx.doi.org/10.1111/nyas.14532
_version_ 1783716418822340608
author Pouw, Wim
de Jonge‐Hoekstra, Lisette
Harrison, Steven J.
Paxton, Alexandra
Dixon, James A.
author_facet Pouw, Wim
de Jonge‐Hoekstra, Lisette
Harrison, Steven J.
Paxton, Alexandra
Dixon, James A.
author_sort Pouw, Wim
collection PubMed
description It is commonly understood that hand gesture and speech coordination in humans is culturally and cognitively acquired, rather than having a biological basis. Recently, however, the biomechanical physical coupling of arm movements to speech vocalization has been studied in steady‐state vocalization and monosyllabic utterances, where forces produced during gesturing are transferred onto the tensioned body, leading to changes in respiratory‐related activity and thereby affecting vocalization F0 and intensity. In the current experiment (n = 37), we extend this previous line of work to show that gesture–speech physics also impacts fluent speech. Compared with nonmovement, participants who are producing fluent self‐formulated speech while rhythmically moving their limbs demonstrate heightened F0 and amplitude envelope, and such effects are more pronounced for higher‐impulse arm versus lower‐impulse wrist movement. We replicate that acoustic peaks arise especially during moments of peak impulse (i.e., the beat) of the movement, namely around deceleration phases of the movement. Finally, higher deceleration rates of higher‐mass arm movements were related to higher peaks in acoustics. These results confirm a role for physical impulses of gesture affecting the speech system. We discuss the implications of gesture–speech physics for understanding of the emergence of communicative gesture, both ontogenetically and phylogenetically.
format Online
Article
Text
id pubmed-8246948
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-82469482021-07-02 Gesture–speech physics in fluent speech and rhythmic upper limb movements Pouw, Wim de Jonge‐Hoekstra, Lisette Harrison, Steven J. Paxton, Alexandra Dixon, James A. Ann N Y Acad Sci Original Articles It is commonly understood that hand gesture and speech coordination in humans is culturally and cognitively acquired, rather than having a biological basis. Recently, however, the biomechanical physical coupling of arm movements to speech vocalization has been studied in steady‐state vocalization and monosyllabic utterances, where forces produced during gesturing are transferred onto the tensioned body, leading to changes in respiratory‐related activity and thereby affecting vocalization F0 and intensity. In the current experiment (n = 37), we extend this previous line of work to show that gesture–speech physics also impacts fluent speech. Compared with nonmovement, participants who are producing fluent self‐formulated speech while rhythmically moving their limbs demonstrate heightened F0 and amplitude envelope, and such effects are more pronounced for higher‐impulse arm versus lower‐impulse wrist movement. We replicate that acoustic peaks arise especially during moments of peak impulse (i.e., the beat) of the movement, namely around deceleration phases of the movement. Finally, higher deceleration rates of higher‐mass arm movements were related to higher peaks in acoustics. These results confirm a role for physical impulses of gesture affecting the speech system. We discuss the implications of gesture–speech physics for understanding of the emergence of communicative gesture, both ontogenetically and phylogenetically. John Wiley and Sons Inc. 2020-12-18 2021-05 /pmc/articles/PMC8246948/ /pubmed/33336809 http://dx.doi.org/10.1111/nyas.14532 Text en © 2020 The Authors. Annals of the New York Academy of Sciences published by Wiley Periodicals LLC on behalf of New York Academy of Sciences https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Original Articles
Pouw, Wim
de Jonge‐Hoekstra, Lisette
Harrison, Steven J.
Paxton, Alexandra
Dixon, James A.
Gesture–speech physics in fluent speech and rhythmic upper limb movements
title Gesture–speech physics in fluent speech and rhythmic upper limb movements
title_full Gesture–speech physics in fluent speech and rhythmic upper limb movements
title_fullStr Gesture–speech physics in fluent speech and rhythmic upper limb movements
title_full_unstemmed Gesture–speech physics in fluent speech and rhythmic upper limb movements
title_short Gesture–speech physics in fluent speech and rhythmic upper limb movements
title_sort gesture–speech physics in fluent speech and rhythmic upper limb movements
topic Original Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8246948/
https://www.ncbi.nlm.nih.gov/pubmed/33336809
http://dx.doi.org/10.1111/nyas.14532
work_keys_str_mv AT pouwwim gesturespeechphysicsinfluentspeechandrhythmicupperlimbmovements
AT dejongehoekstralisette gesturespeechphysicsinfluentspeechandrhythmicupperlimbmovements
AT harrisonstevenj gesturespeechphysicsinfluentspeechandrhythmicupperlimbmovements
AT paxtonalexandra gesturespeechphysicsinfluentspeechandrhythmicupperlimbmovements
AT dixonjamesa gesturespeechphysicsinfluentspeechandrhythmicupperlimbmovements