Cargando…

Speech Cues Contribute to Audiovisual Spatial Integration

Speech is the most important form of human communication but ambient sounds and competing talkers often degrade its acoustics. Fortunately the brain can use visual information, especially its highly precise spatial information, to improve speech comprehension in noisy environments. Previous studies...

Descripción completa

Detalles Bibliográficos
Autores principales: Bishop, Christopher W., Miller, Lee M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2011
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3166076/
https://www.ncbi.nlm.nih.gov/pubmed/21909378
http://dx.doi.org/10.1371/journal.pone.0024016
_version_ 1782211118172733440
author Bishop, Christopher W.
Miller, Lee M.
author_facet Bishop, Christopher W.
Miller, Lee M.
author_sort Bishop, Christopher W.
collection PubMed
description Speech is the most important form of human communication but ambient sounds and competing talkers often degrade its acoustics. Fortunately the brain can use visual information, especially its highly precise spatial information, to improve speech comprehension in noisy environments. Previous studies have demonstrated that audiovisual integration depends strongly on spatiotemporal factors. However, some integrative phenomena such as McGurk interference persist even with gross spatial disparities, suggesting that spatial alignment is not necessary for robust integration of audiovisual place-of-articulation cues. It is therefore unclear how speech-cues interact with audiovisual spatial integration mechanisms. Here, we combine two well established psychophysical phenomena, the McGurk effect and the ventriloquist's illusion, to explore this dependency. Our results demonstrate that conflicting spatial cues may not interfere with audiovisual integration of speech, but conflicting speech-cues can impede integration in space. This suggests a direct but asymmetrical influence between ventral ‘what’ and dorsal ‘where’ pathways.
format Online
Article
Text
id pubmed-3166076
institution National Center for Biotechnology Information
language English
publishDate 2011
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-31660762011-09-09 Speech Cues Contribute to Audiovisual Spatial Integration Bishop, Christopher W. Miller, Lee M. PLoS One Research Article Speech is the most important form of human communication but ambient sounds and competing talkers often degrade its acoustics. Fortunately the brain can use visual information, especially its highly precise spatial information, to improve speech comprehension in noisy environments. Previous studies have demonstrated that audiovisual integration depends strongly on spatiotemporal factors. However, some integrative phenomena such as McGurk interference persist even with gross spatial disparities, suggesting that spatial alignment is not necessary for robust integration of audiovisual place-of-articulation cues. It is therefore unclear how speech-cues interact with audiovisual spatial integration mechanisms. Here, we combine two well established psychophysical phenomena, the McGurk effect and the ventriloquist's illusion, to explore this dependency. Our results demonstrate that conflicting spatial cues may not interfere with audiovisual integration of speech, but conflicting speech-cues can impede integration in space. This suggests a direct but asymmetrical influence between ventral ‘what’ and dorsal ‘where’ pathways. Public Library of Science 2011-08-31 /pmc/articles/PMC3166076/ /pubmed/21909378 http://dx.doi.org/10.1371/journal.pone.0024016 Text en Bishop, Miller. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
spellingShingle Research Article
Bishop, Christopher W.
Miller, Lee M.
Speech Cues Contribute to Audiovisual Spatial Integration
title Speech Cues Contribute to Audiovisual Spatial Integration
title_full Speech Cues Contribute to Audiovisual Spatial Integration
title_fullStr Speech Cues Contribute to Audiovisual Spatial Integration
title_full_unstemmed Speech Cues Contribute to Audiovisual Spatial Integration
title_short Speech Cues Contribute to Audiovisual Spatial Integration
title_sort speech cues contribute to audiovisual spatial integration
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3166076/
https://www.ncbi.nlm.nih.gov/pubmed/21909378
http://dx.doi.org/10.1371/journal.pone.0024016
work_keys_str_mv AT bishopchristopherw speechcuescontributetoaudiovisualspatialintegration
AT millerleem speechcuescontributetoaudiovisualspatialintegration