Cargando…

Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners

In the McGurk effect, perception of a spoken consonant is altered when an auditory (A) syllable is presented with an incongruent visual (V) syllable (e.g., A/pa/V/ka/ is often heard as /ka/ or /ta/). The McGurk effect provides a measure for visual influence on speech perception, becoming stronger th...

Descripción completa

Detalles Bibliográficos
Autores principales: Tiippana, Kaisa, Ujiie, Yuta, Peromaa, Tarja, Takahashi, Kohske
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10452414/
https://www.ncbi.nlm.nih.gov/pubmed/37626554
http://dx.doi.org/10.3390/brainsci13081198
_version_ 1785095665429250048
author Tiippana, Kaisa
Ujiie, Yuta
Peromaa, Tarja
Takahashi, Kohske
author_facet Tiippana, Kaisa
Ujiie, Yuta
Peromaa, Tarja
Takahashi, Kohske
author_sort Tiippana, Kaisa
collection PubMed
description In the McGurk effect, perception of a spoken consonant is altered when an auditory (A) syllable is presented with an incongruent visual (V) syllable (e.g., A/pa/V/ka/ is often heard as /ka/ or /ta/). The McGurk effect provides a measure for visual influence on speech perception, becoming stronger the lower the proportion of auditory correct responses. Cross-language effects are studied to understand processing differences between one’s own and foreign languages. Regarding the McGurk effect, it has sometimes been found to be stronger with foreign speakers. However, other studies have shown the opposite, or no difference between languages. Most studies have compared English with other languages. We investigated cross-language effects with native Finnish and Japanese speakers and listeners. Both groups of listeners had 49 participants. The stimuli (/ka/, /pa/, /ta/) were uttered by two female and male Finnish and Japanese speakers and presented in A, V and AV modality, including a McGurk stimulus A/pa/V/ka/. The McGurk effect was stronger with Japanese stimuli in both groups. Differences in speech perception were prominent between individual speakers but less so between native languages. Unisensory perception correlated with McGurk perception. These findings suggest that stimulus-dependent features contribute to the McGurk effect. This may have a stronger influence on syllable perception than cross-language factors.
format Online
Article
Text
id pubmed-10452414
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104524142023-08-26 Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners Tiippana, Kaisa Ujiie, Yuta Peromaa, Tarja Takahashi, Kohske Brain Sci Article In the McGurk effect, perception of a spoken consonant is altered when an auditory (A) syllable is presented with an incongruent visual (V) syllable (e.g., A/pa/V/ka/ is often heard as /ka/ or /ta/). The McGurk effect provides a measure for visual influence on speech perception, becoming stronger the lower the proportion of auditory correct responses. Cross-language effects are studied to understand processing differences between one’s own and foreign languages. Regarding the McGurk effect, it has sometimes been found to be stronger with foreign speakers. However, other studies have shown the opposite, or no difference between languages. Most studies have compared English with other languages. We investigated cross-language effects with native Finnish and Japanese speakers and listeners. Both groups of listeners had 49 participants. The stimuli (/ka/, /pa/, /ta/) were uttered by two female and male Finnish and Japanese speakers and presented in A, V and AV modality, including a McGurk stimulus A/pa/V/ka/. The McGurk effect was stronger with Japanese stimuli in both groups. Differences in speech perception were prominent between individual speakers but less so between native languages. Unisensory perception correlated with McGurk perception. These findings suggest that stimulus-dependent features contribute to the McGurk effect. This may have a stronger influence on syllable perception than cross-language factors. MDPI 2023-08-13 /pmc/articles/PMC10452414/ /pubmed/37626554 http://dx.doi.org/10.3390/brainsci13081198 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Tiippana, Kaisa
Ujiie, Yuta
Peromaa, Tarja
Takahashi, Kohske
Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners
title Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners
title_full Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners
title_fullStr Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners
title_full_unstemmed Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners
title_short Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners
title_sort investigation of cross-language and stimulus-dependent effects on the mcgurk effect with finnish and japanese speakers and listeners
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10452414/
https://www.ncbi.nlm.nih.gov/pubmed/37626554
http://dx.doi.org/10.3390/brainsci13081198
work_keys_str_mv AT tiippanakaisa investigationofcrosslanguageandstimulusdependenteffectsonthemcgurkeffectwithfinnishandjapanesespeakersandlisteners
AT ujiieyuta investigationofcrosslanguageandstimulusdependenteffectsonthemcgurkeffectwithfinnishandjapanesespeakersandlisteners
AT peromaatarja investigationofcrosslanguageandstimulusdependenteffectsonthemcgurkeffectwithfinnishandjapanesespeakersandlisteners
AT takahashikohske investigationofcrosslanguageandstimulusdependenteffectsonthemcgurkeffectwithfinnishandjapanesespeakersandlisteners