Cargando…
Gesture–speech physics in fluent speech and rhythmic upper limb movements
It is commonly understood that hand gesture and speech coordination in humans is culturally and cognitively acquired, rather than having a biological basis. Recently, however, the biomechanical physical coupling of arm movements to speech vocalization has been studied in steady‐state vocalization an...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley and Sons Inc.
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8246948/ https://www.ncbi.nlm.nih.gov/pubmed/33336809 http://dx.doi.org/10.1111/nyas.14532 |
_version_ | 1783716418822340608 |
---|---|
author | Pouw, Wim de Jonge‐Hoekstra, Lisette Harrison, Steven J. Paxton, Alexandra Dixon, James A. |
author_facet | Pouw, Wim de Jonge‐Hoekstra, Lisette Harrison, Steven J. Paxton, Alexandra Dixon, James A. |
author_sort | Pouw, Wim |
collection | PubMed |
description | It is commonly understood that hand gesture and speech coordination in humans is culturally and cognitively acquired, rather than having a biological basis. Recently, however, the biomechanical physical coupling of arm movements to speech vocalization has been studied in steady‐state vocalization and monosyllabic utterances, where forces produced during gesturing are transferred onto the tensioned body, leading to changes in respiratory‐related activity and thereby affecting vocalization F0 and intensity. In the current experiment (n = 37), we extend this previous line of work to show that gesture–speech physics also impacts fluent speech. Compared with nonmovement, participants who are producing fluent self‐formulated speech while rhythmically moving their limbs demonstrate heightened F0 and amplitude envelope, and such effects are more pronounced for higher‐impulse arm versus lower‐impulse wrist movement. We replicate that acoustic peaks arise especially during moments of peak impulse (i.e., the beat) of the movement, namely around deceleration phases of the movement. Finally, higher deceleration rates of higher‐mass arm movements were related to higher peaks in acoustics. These results confirm a role for physical impulses of gesture affecting the speech system. We discuss the implications of gesture–speech physics for understanding of the emergence of communicative gesture, both ontogenetically and phylogenetically. |
format | Online Article Text |
id | pubmed-8246948 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | John Wiley and Sons Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-82469482021-07-02 Gesture–speech physics in fluent speech and rhythmic upper limb movements Pouw, Wim de Jonge‐Hoekstra, Lisette Harrison, Steven J. Paxton, Alexandra Dixon, James A. Ann N Y Acad Sci Original Articles It is commonly understood that hand gesture and speech coordination in humans is culturally and cognitively acquired, rather than having a biological basis. Recently, however, the biomechanical physical coupling of arm movements to speech vocalization has been studied in steady‐state vocalization and monosyllabic utterances, where forces produced during gesturing are transferred onto the tensioned body, leading to changes in respiratory‐related activity and thereby affecting vocalization F0 and intensity. In the current experiment (n = 37), we extend this previous line of work to show that gesture–speech physics also impacts fluent speech. Compared with nonmovement, participants who are producing fluent self‐formulated speech while rhythmically moving their limbs demonstrate heightened F0 and amplitude envelope, and such effects are more pronounced for higher‐impulse arm versus lower‐impulse wrist movement. We replicate that acoustic peaks arise especially during moments of peak impulse (i.e., the beat) of the movement, namely around deceleration phases of the movement. Finally, higher deceleration rates of higher‐mass arm movements were related to higher peaks in acoustics. These results confirm a role for physical impulses of gesture affecting the speech system. We discuss the implications of gesture–speech physics for understanding of the emergence of communicative gesture, both ontogenetically and phylogenetically. John Wiley and Sons Inc. 2020-12-18 2021-05 /pmc/articles/PMC8246948/ /pubmed/33336809 http://dx.doi.org/10.1111/nyas.14532 Text en © 2020 The Authors. Annals of the New York Academy of Sciences published by Wiley Periodicals LLC on behalf of New York Academy of Sciences https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Original Articles Pouw, Wim de Jonge‐Hoekstra, Lisette Harrison, Steven J. Paxton, Alexandra Dixon, James A. Gesture–speech physics in fluent speech and rhythmic upper limb movements |
title | Gesture–speech physics in fluent speech and rhythmic upper limb movements |
title_full | Gesture–speech physics in fluent speech and rhythmic upper limb movements |
title_fullStr | Gesture–speech physics in fluent speech and rhythmic upper limb movements |
title_full_unstemmed | Gesture–speech physics in fluent speech and rhythmic upper limb movements |
title_short | Gesture–speech physics in fluent speech and rhythmic upper limb movements |
title_sort | gesture–speech physics in fluent speech and rhythmic upper limb movements |
topic | Original Articles |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8246948/ https://www.ncbi.nlm.nih.gov/pubmed/33336809 http://dx.doi.org/10.1111/nyas.14532 |
work_keys_str_mv | AT pouwwim gesturespeechphysicsinfluentspeechandrhythmicupperlimbmovements AT dejongehoekstralisette gesturespeechphysicsinfluentspeechandrhythmicupperlimbmovements AT harrisonstevenj gesturespeechphysicsinfluentspeechandrhythmicupperlimbmovements AT paxtonalexandra gesturespeechphysicsinfluentspeechandrhythmicupperlimbmovements AT dixonjamesa gesturespeechphysicsinfluentspeechandrhythmicupperlimbmovements |