Cargando…
Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners
In the McGurk effect, perception of a spoken consonant is altered when an auditory (A) syllable is presented with an incongruent visual (V) syllable (e.g., A/pa/V/ka/ is often heard as /ka/ or /ta/). The McGurk effect provides a measure for visual influence on speech perception, becoming stronger th...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10452414/ https://www.ncbi.nlm.nih.gov/pubmed/37626554 http://dx.doi.org/10.3390/brainsci13081198 |
_version_ | 1785095665429250048 |
---|---|
author | Tiippana, Kaisa Ujiie, Yuta Peromaa, Tarja Takahashi, Kohske |
author_facet | Tiippana, Kaisa Ujiie, Yuta Peromaa, Tarja Takahashi, Kohske |
author_sort | Tiippana, Kaisa |
collection | PubMed |
description | In the McGurk effect, perception of a spoken consonant is altered when an auditory (A) syllable is presented with an incongruent visual (V) syllable (e.g., A/pa/V/ka/ is often heard as /ka/ or /ta/). The McGurk effect provides a measure for visual influence on speech perception, becoming stronger the lower the proportion of auditory correct responses. Cross-language effects are studied to understand processing differences between one’s own and foreign languages. Regarding the McGurk effect, it has sometimes been found to be stronger with foreign speakers. However, other studies have shown the opposite, or no difference between languages. Most studies have compared English with other languages. We investigated cross-language effects with native Finnish and Japanese speakers and listeners. Both groups of listeners had 49 participants. The stimuli (/ka/, /pa/, /ta/) were uttered by two female and male Finnish and Japanese speakers and presented in A, V and AV modality, including a McGurk stimulus A/pa/V/ka/. The McGurk effect was stronger with Japanese stimuli in both groups. Differences in speech perception were prominent between individual speakers but less so between native languages. Unisensory perception correlated with McGurk perception. These findings suggest that stimulus-dependent features contribute to the McGurk effect. This may have a stronger influence on syllable perception than cross-language factors. |
format | Online Article Text |
id | pubmed-10452414 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-104524142023-08-26 Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners Tiippana, Kaisa Ujiie, Yuta Peromaa, Tarja Takahashi, Kohske Brain Sci Article In the McGurk effect, perception of a spoken consonant is altered when an auditory (A) syllable is presented with an incongruent visual (V) syllable (e.g., A/pa/V/ka/ is often heard as /ka/ or /ta/). The McGurk effect provides a measure for visual influence on speech perception, becoming stronger the lower the proportion of auditory correct responses. Cross-language effects are studied to understand processing differences between one’s own and foreign languages. Regarding the McGurk effect, it has sometimes been found to be stronger with foreign speakers. However, other studies have shown the opposite, or no difference between languages. Most studies have compared English with other languages. We investigated cross-language effects with native Finnish and Japanese speakers and listeners. Both groups of listeners had 49 participants. The stimuli (/ka/, /pa/, /ta/) were uttered by two female and male Finnish and Japanese speakers and presented in A, V and AV modality, including a McGurk stimulus A/pa/V/ka/. The McGurk effect was stronger with Japanese stimuli in both groups. Differences in speech perception were prominent between individual speakers but less so between native languages. Unisensory perception correlated with McGurk perception. These findings suggest that stimulus-dependent features contribute to the McGurk effect. This may have a stronger influence on syllable perception than cross-language factors. MDPI 2023-08-13 /pmc/articles/PMC10452414/ /pubmed/37626554 http://dx.doi.org/10.3390/brainsci13081198 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Tiippana, Kaisa Ujiie, Yuta Peromaa, Tarja Takahashi, Kohske Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners |
title | Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners |
title_full | Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners |
title_fullStr | Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners |
title_full_unstemmed | Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners |
title_short | Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners |
title_sort | investigation of cross-language and stimulus-dependent effects on the mcgurk effect with finnish and japanese speakers and listeners |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10452414/ https://www.ncbi.nlm.nih.gov/pubmed/37626554 http://dx.doi.org/10.3390/brainsci13081198 |
work_keys_str_mv | AT tiippanakaisa investigationofcrosslanguageandstimulusdependenteffectsonthemcgurkeffectwithfinnishandjapanesespeakersandlisteners AT ujiieyuta investigationofcrosslanguageandstimulusdependenteffectsonthemcgurkeffectwithfinnishandjapanesespeakersandlisteners AT peromaatarja investigationofcrosslanguageandstimulusdependenteffectsonthemcgurkeffectwithfinnishandjapanesespeakersandlisteners AT takahashikohske investigationofcrosslanguageandstimulusdependenteffectsonthemcgurkeffectwithfinnishandjapanesespeakersandlisteners |