Cargando…
Differential Gaze Patterns on Eyes and Mouth During Audiovisual Speech Segmentation
Speech is inextricably multisensory: both auditory and visual components provide critical information for all aspects of speech processing, including speech segmentation, the visual components of which have been the target of a growing number of studies. In particular, a recent study (Mitchel and We...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2016
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4735377/ https://www.ncbi.nlm.nih.gov/pubmed/26869959 http://dx.doi.org/10.3389/fpsyg.2016.00052 |
_version_ | 1782413068755533824 |
---|---|
author | Lusk, Laina G. Mitchel, Aaron D. |
author_facet | Lusk, Laina G. Mitchel, Aaron D. |
author_sort | Lusk, Laina G. |
collection | PubMed |
description | Speech is inextricably multisensory: both auditory and visual components provide critical information for all aspects of speech processing, including speech segmentation, the visual components of which have been the target of a growing number of studies. In particular, a recent study (Mitchel and Weiss, 2014) established that adults can utilize facial cues (i.e., visual prosody) to identify word boundaries in fluent speech. The current study expanded upon these results, using an eye tracker to identify highly attended facial features of the audiovisual display used in Mitchel and Weiss (2014). Subjects spent the most time watching the eyes and mouth. A significant trend in gaze durations was found with the longest gaze duration on the mouth, followed by the eyes and then the nose. In addition, eye-gaze patterns changed across familiarization as subjects learned the word boundaries, showing decreased attention to the mouth in later blocks while attention on other facial features remained consistent. These findings highlight the importance of the visual component of speech processing and suggest that the mouth may play a critical role in visual speech segmentation. |
format | Online Article Text |
id | pubmed-4735377 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2016 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-47353772016-02-11 Differential Gaze Patterns on Eyes and Mouth During Audiovisual Speech Segmentation Lusk, Laina G. Mitchel, Aaron D. Front Psychol Psychology Speech is inextricably multisensory: both auditory and visual components provide critical information for all aspects of speech processing, including speech segmentation, the visual components of which have been the target of a growing number of studies. In particular, a recent study (Mitchel and Weiss, 2014) established that adults can utilize facial cues (i.e., visual prosody) to identify word boundaries in fluent speech. The current study expanded upon these results, using an eye tracker to identify highly attended facial features of the audiovisual display used in Mitchel and Weiss (2014). Subjects spent the most time watching the eyes and mouth. A significant trend in gaze durations was found with the longest gaze duration on the mouth, followed by the eyes and then the nose. In addition, eye-gaze patterns changed across familiarization as subjects learned the word boundaries, showing decreased attention to the mouth in later blocks while attention on other facial features remained consistent. These findings highlight the importance of the visual component of speech processing and suggest that the mouth may play a critical role in visual speech segmentation. Frontiers Media S.A. 2016-02-02 /pmc/articles/PMC4735377/ /pubmed/26869959 http://dx.doi.org/10.3389/fpsyg.2016.00052 Text en Copyright © 2016 Lusk and Mitchel. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychology Lusk, Laina G. Mitchel, Aaron D. Differential Gaze Patterns on Eyes and Mouth During Audiovisual Speech Segmentation |
title | Differential Gaze Patterns on Eyes and Mouth During Audiovisual Speech Segmentation |
title_full | Differential Gaze Patterns on Eyes and Mouth During Audiovisual Speech Segmentation |
title_fullStr | Differential Gaze Patterns on Eyes and Mouth During Audiovisual Speech Segmentation |
title_full_unstemmed | Differential Gaze Patterns on Eyes and Mouth During Audiovisual Speech Segmentation |
title_short | Differential Gaze Patterns on Eyes and Mouth During Audiovisual Speech Segmentation |
title_sort | differential gaze patterns on eyes and mouth during audiovisual speech segmentation |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4735377/ https://www.ncbi.nlm.nih.gov/pubmed/26869959 http://dx.doi.org/10.3389/fpsyg.2016.00052 |
work_keys_str_mv | AT lusklainag differentialgazepatternsoneyesandmouthduringaudiovisualspeechsegmentation AT mitchelaarond differentialgazepatternsoneyesandmouthduringaudiovisualspeechsegmentation |