Cargando…

When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction

The framework of depicting put forward by Clark (2016) offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify a...

Descripción completa

Detalles Bibliográficos
Autores principales: Hsu, Hui-Chieh, Brône, Geert, Feyaerts, Kurt
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7906077/
https://www.ncbi.nlm.nih.gov/pubmed/33643106
http://dx.doi.org/10.3389/fpsyg.2020.552533
_version_ 1783655222214656000
author Hsu, Hui-Chieh
Brône, Geert
Feyaerts, Kurt
author_facet Hsu, Hui-Chieh
Brône, Geert
Feyaerts, Kurt
author_sort Hsu, Hui-Chieh
collection PubMed
description The framework of depicting put forward by Clark (2016) offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: “speech-embedded nonverbal depictions,” namely cases where meaning is communicated iconically, nonverbally, and without simultaneously co-occurring speech. In addition to contextualizing the phenomenon in relation to existing research, we demonstrate, with examples from American TV talk shows, how such depictions function in real-life language use, offering a brief sketch of their complexities and arguing also for their theoretical significance.
format Online
Article
Text
id pubmed-7906077
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-79060772021-02-26 When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction Hsu, Hui-Chieh Brône, Geert Feyaerts, Kurt Front Psychol Psychology The framework of depicting put forward by Clark (2016) offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: “speech-embedded nonverbal depictions,” namely cases where meaning is communicated iconically, nonverbally, and without simultaneously co-occurring speech. In addition to contextualizing the phenomenon in relation to existing research, we demonstrate, with examples from American TV talk shows, how such depictions function in real-life language use, offering a brief sketch of their complexities and arguing also for their theoretical significance. Frontiers Media S.A. 2021-02-11 /pmc/articles/PMC7906077/ /pubmed/33643106 http://dx.doi.org/10.3389/fpsyg.2020.552533 Text en Copyright © 2021 Hsu, Brône and Feyaerts. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Hsu, Hui-Chieh
Brône, Geert
Feyaerts, Kurt
When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction
title When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction
title_full When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction
title_fullStr When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction
title_full_unstemmed When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction
title_short When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction
title_sort when gesture “takes over”: speech-embedded nonverbal depictions in multimodal interaction
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7906077/
https://www.ncbi.nlm.nih.gov/pubmed/33643106
http://dx.doi.org/10.3389/fpsyg.2020.552533
work_keys_str_mv AT hsuhuichieh whengesturetakesoverspeechembeddednonverbaldepictionsinmultimodalinteraction
AT bronegeert whengesturetakesoverspeechembeddednonverbaldepictionsinmultimodalinteraction
AT feyaertskurt whengesturetakesoverspeechembeddednonverbaldepictionsinmultimodalinteraction