Cargando…

The contribution of visual information to the perception of speech in noise with and without informative temporal fine structure

Understanding what is said in demanding listening situations is assisted greatly by looking at the face of a talker. Previous studies have observed that normal-hearing listeners can benefit from this visual information when a talker's voice is presented in background noise. These benefits have...

Descripción completa

Detalles Bibliográficos
Autores principales: Stacey, Paula C., Kitterick, Pádraig T., Morris, Saffron D., Sumner, Christian J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5706637/
https://www.ncbi.nlm.nih.gov/pubmed/27085797
http://dx.doi.org/10.1016/j.heares.2016.04.002
_version_ 1783282261114748928
author Stacey, Paula C.
Kitterick, Pádraig T.
Morris, Saffron D.
Sumner, Christian J.
author_facet Stacey, Paula C.
Kitterick, Pádraig T.
Morris, Saffron D.
Sumner, Christian J.
author_sort Stacey, Paula C.
collection PubMed
description Understanding what is said in demanding listening situations is assisted greatly by looking at the face of a talker. Previous studies have observed that normal-hearing listeners can benefit from this visual information when a talker's voice is presented in background noise. These benefits have also been observed in quiet listening conditions in cochlear-implant users, whose device does not convey the informative temporal fine structure cues in speech, and when normal-hearing individuals listen to speech processed to remove these informative temporal fine structure cues. The current study (1) characterised the benefits of visual information when listening in background noise; and (2) used sine-wave vocoding to compare the size of the visual benefit when speech is presented with or without informative temporal fine structure. The accuracy with which normal-hearing individuals reported words in spoken sentences was assessed across three experiments. The availability of visual information and informative temporal fine structure cues was varied within and across the experiments. The results showed that visual benefit was observed using open- and closed-set tests of speech perception. The size of the benefit increased when informative temporal fine structure cues were removed. This finding suggests that visual information may play an important role in the ability of cochlear-implant users to understand speech in many everyday situations. Models of audio-visual integration were able to account for the additional benefit of visual information when speech was degraded and suggested that auditory and visual information was being integrated in a similar way in all conditions. The modelling results were consistent with the notion that audio-visual benefit is derived from the optimal combination of auditory and visual sensory cues.
format Online
Article
Text
id pubmed-5706637
institution National Center for Biotechnology Information
language English
publishDate 2016
record_format MEDLINE/PubMed
spelling pubmed-57066372017-11-29 The contribution of visual information to the perception of speech in noise with and without informative temporal fine structure Stacey, Paula C. Kitterick, Pádraig T. Morris, Saffron D. Sumner, Christian J. Hear Res Article Understanding what is said in demanding listening situations is assisted greatly by looking at the face of a talker. Previous studies have observed that normal-hearing listeners can benefit from this visual information when a talker's voice is presented in background noise. These benefits have also been observed in quiet listening conditions in cochlear-implant users, whose device does not convey the informative temporal fine structure cues in speech, and when normal-hearing individuals listen to speech processed to remove these informative temporal fine structure cues. The current study (1) characterised the benefits of visual information when listening in background noise; and (2) used sine-wave vocoding to compare the size of the visual benefit when speech is presented with or without informative temporal fine structure. The accuracy with which normal-hearing individuals reported words in spoken sentences was assessed across three experiments. The availability of visual information and informative temporal fine structure cues was varied within and across the experiments. The results showed that visual benefit was observed using open- and closed-set tests of speech perception. The size of the benefit increased when informative temporal fine structure cues were removed. This finding suggests that visual information may play an important role in the ability of cochlear-implant users to understand speech in many everyday situations. Models of audio-visual integration were able to account for the additional benefit of visual information when speech was degraded and suggested that auditory and visual information was being integrated in a similar way in all conditions. The modelling results were consistent with the notion that audio-visual benefit is derived from the optimal combination of auditory and visual sensory cues. 2016-04-13 2016-06 /pmc/articles/PMC5706637/ /pubmed/27085797 http://dx.doi.org/10.1016/j.heares.2016.04.002 Text en http://creativecommons.org/licenses/by-nc-nd/4.0/ This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
spellingShingle Article
Stacey, Paula C.
Kitterick, Pádraig T.
Morris, Saffron D.
Sumner, Christian J.
The contribution of visual information to the perception of speech in noise with and without informative temporal fine structure
title The contribution of visual information to the perception of speech in noise with and without informative temporal fine structure
title_full The contribution of visual information to the perception of speech in noise with and without informative temporal fine structure
title_fullStr The contribution of visual information to the perception of speech in noise with and without informative temporal fine structure
title_full_unstemmed The contribution of visual information to the perception of speech in noise with and without informative temporal fine structure
title_short The contribution of visual information to the perception of speech in noise with and without informative temporal fine structure
title_sort contribution of visual information to the perception of speech in noise with and without informative temporal fine structure
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5706637/
https://www.ncbi.nlm.nih.gov/pubmed/27085797
http://dx.doi.org/10.1016/j.heares.2016.04.002
work_keys_str_mv AT staceypaulac thecontributionofvisualinformationtotheperceptionofspeechinnoisewithandwithoutinformativetemporalfinestructure
AT kitterickpadraigt thecontributionofvisualinformationtotheperceptionofspeechinnoisewithandwithoutinformativetemporalfinestructure
AT morrissaffrond thecontributionofvisualinformationtotheperceptionofspeechinnoisewithandwithoutinformativetemporalfinestructure
AT sumnerchristianj thecontributionofvisualinformationtotheperceptionofspeechinnoisewithandwithoutinformativetemporalfinestructure
AT staceypaulac contributionofvisualinformationtotheperceptionofspeechinnoisewithandwithoutinformativetemporalfinestructure
AT kitterickpadraigt contributionofvisualinformationtotheperceptionofspeechinnoisewithandwithoutinformativetemporalfinestructure
AT morrissaffrond contributionofvisualinformationtotheperceptionofspeechinnoisewithandwithoutinformativetemporalfinestructure
AT sumnerchristianj contributionofvisualinformationtotheperceptionofspeechinnoisewithandwithoutinformativetemporalfinestructure