Cargando…

The effect of prestimulus low-frequency neural oscillations on the temporal perception of audiovisual speech

OBJECTIVE: Perceptual integration and segregation are modulated by the phase of ongoing neural oscillation whose frequency period is broader than the size of the temporal binding window (TBW). Studies have shown that the abstract beep-flash stimuli with about 100 ms TBW were modulated by the alpha b...

Descripción completa

Detalles Bibliográficos
Autores principales: Jiang, Zeliang, An, Xingwei, Liu, Shuang, Wang, Lu, Yin, Erwei, Yan, Ye, Ming, Dong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9935937/
https://www.ncbi.nlm.nih.gov/pubmed/36816126
http://dx.doi.org/10.3389/fnins.2023.1067632
_version_ 1784890124502302720
author Jiang, Zeliang
An, Xingwei
Liu, Shuang
Wang, Lu
Yin, Erwei
Yan, Ye
Ming, Dong
author_facet Jiang, Zeliang
An, Xingwei
Liu, Shuang
Wang, Lu
Yin, Erwei
Yan, Ye
Ming, Dong
author_sort Jiang, Zeliang
collection PubMed
description OBJECTIVE: Perceptual integration and segregation are modulated by the phase of ongoing neural oscillation whose frequency period is broader than the size of the temporal binding window (TBW). Studies have shown that the abstract beep-flash stimuli with about 100 ms TBW were modulated by the alpha band phase. Therefore, we hypothesize that the temporal perception of speech with about hundreds of milliseconds of TBW might be affected by the delta-theta phase. METHODS: Thus, we conducted a speech-stimuli-based audiovisual simultaneity judgment (SJ) experiment. Twenty human participants (12 females) attended this study, recording 62 channels of EEG. RESULTS: Behavioral results showed that the visual leading TBWs are broader than the auditory leading ones [273.37 ± 24.24 ms vs. 198.05 ± 19.28 ms, (mean ± sem)]. We used Phase Opposition Sum (POS) to quantify the differences in mean phase angles and phase concentrations between synchronous and asynchronous responses. The POS results indicated that the delta-theta phase was significantly different between synchronous and asynchronous responses in the A50V condition (50% synchronous responses in auditory leading SOA). However, in the V50A condition (50% synchronous responses in visual leading SOA), we only found the delta band effect. In the two conditions, we did not find a consistency of phases over subjects for both perceptual responses by the post hoc Rayleigh test (all ps > 0.05). The Rayleigh test results suggested that the phase might not reflect the neuronal excitability which assumed that the phases within a perceptual response across subjects concentrated on the same angle but were not uniformly distributed. But V-test showed the phase difference between synchronous and asynchronous responses across subjects had a significant phase opposition (all ps < 0.05) which is compatible with the POS result. CONCLUSION: These results indicate that the speech temporal perception depends on the alignment of stimulus onset with an optimal phase of the neural oscillation whose frequency period might be broader than the size of TBW. The role of the oscillatory phase might be encoding the temporal information which varies across subjects rather than neuronal excitability. Given the enriched temporal structures of spoken language stimuli, the conclusion that phase encodes temporal information is plausible and valuable for future research.
format Online
Article
Text
id pubmed-9935937
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-99359372023-02-18 The effect of prestimulus low-frequency neural oscillations on the temporal perception of audiovisual speech Jiang, Zeliang An, Xingwei Liu, Shuang Wang, Lu Yin, Erwei Yan, Ye Ming, Dong Front Neurosci Neuroscience OBJECTIVE: Perceptual integration and segregation are modulated by the phase of ongoing neural oscillation whose frequency period is broader than the size of the temporal binding window (TBW). Studies have shown that the abstract beep-flash stimuli with about 100 ms TBW were modulated by the alpha band phase. Therefore, we hypothesize that the temporal perception of speech with about hundreds of milliseconds of TBW might be affected by the delta-theta phase. METHODS: Thus, we conducted a speech-stimuli-based audiovisual simultaneity judgment (SJ) experiment. Twenty human participants (12 females) attended this study, recording 62 channels of EEG. RESULTS: Behavioral results showed that the visual leading TBWs are broader than the auditory leading ones [273.37 ± 24.24 ms vs. 198.05 ± 19.28 ms, (mean ± sem)]. We used Phase Opposition Sum (POS) to quantify the differences in mean phase angles and phase concentrations between synchronous and asynchronous responses. The POS results indicated that the delta-theta phase was significantly different between synchronous and asynchronous responses in the A50V condition (50% synchronous responses in auditory leading SOA). However, in the V50A condition (50% synchronous responses in visual leading SOA), we only found the delta band effect. In the two conditions, we did not find a consistency of phases over subjects for both perceptual responses by the post hoc Rayleigh test (all ps > 0.05). The Rayleigh test results suggested that the phase might not reflect the neuronal excitability which assumed that the phases within a perceptual response across subjects concentrated on the same angle but were not uniformly distributed. But V-test showed the phase difference between synchronous and asynchronous responses across subjects had a significant phase opposition (all ps < 0.05) which is compatible with the POS result. CONCLUSION: These results indicate that the speech temporal perception depends on the alignment of stimulus onset with an optimal phase of the neural oscillation whose frequency period might be broader than the size of TBW. The role of the oscillatory phase might be encoding the temporal information which varies across subjects rather than neuronal excitability. Given the enriched temporal structures of spoken language stimuli, the conclusion that phase encodes temporal information is plausible and valuable for future research. Frontiers Media S.A. 2023-02-03 /pmc/articles/PMC9935937/ /pubmed/36816126 http://dx.doi.org/10.3389/fnins.2023.1067632 Text en Copyright © 2023 Jiang, An, Liu, Wang, Yin, Yan and Ming. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Jiang, Zeliang
An, Xingwei
Liu, Shuang
Wang, Lu
Yin, Erwei
Yan, Ye
Ming, Dong
The effect of prestimulus low-frequency neural oscillations on the temporal perception of audiovisual speech
title The effect of prestimulus low-frequency neural oscillations on the temporal perception of audiovisual speech
title_full The effect of prestimulus low-frequency neural oscillations on the temporal perception of audiovisual speech
title_fullStr The effect of prestimulus low-frequency neural oscillations on the temporal perception of audiovisual speech
title_full_unstemmed The effect of prestimulus low-frequency neural oscillations on the temporal perception of audiovisual speech
title_short The effect of prestimulus low-frequency neural oscillations on the temporal perception of audiovisual speech
title_sort effect of prestimulus low-frequency neural oscillations on the temporal perception of audiovisual speech
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9935937/
https://www.ncbi.nlm.nih.gov/pubmed/36816126
http://dx.doi.org/10.3389/fnins.2023.1067632
work_keys_str_mv AT jiangzeliang theeffectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT anxingwei theeffectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT liushuang theeffectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT wanglu theeffectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT yinerwei theeffectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT yanye theeffectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT mingdong theeffectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT jiangzeliang effectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT anxingwei effectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT liushuang effectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT wanglu effectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT yinerwei effectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT yanye effectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech
AT mingdong effectofprestimuluslowfrequencyneuraloscillationsonthetemporalperceptionofaudiovisualspeech