Cargando…

Neural Correlates of Temporal Complexity and Synchrony during Audiovisual Correspondence Detection

We often perceive real-life objects as multisensory cues through space and time. A key challenge for audiovisual integration is to match neural signals that not only originate from different sensory modalities but also that typically reach the observer at slightly different times. In humans, complex...

Descripción completa

Detalles Bibliográficos
Autores principales: Baumann, Oliver, Vromen, Joyce M. G., Cheung, Allen, McFadyen, Jessica, Ren, Yudan, Guo, Christine C.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Society for Neuroscience 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5773885/
https://www.ncbi.nlm.nih.gov/pubmed/29354682
http://dx.doi.org/10.1523/ENEURO.0294-17.2018
_version_ 1783293657268355072
author Baumann, Oliver
Vromen, Joyce M. G.
Cheung, Allen
McFadyen, Jessica
Ren, Yudan
Guo, Christine C.
author_facet Baumann, Oliver
Vromen, Joyce M. G.
Cheung, Allen
McFadyen, Jessica
Ren, Yudan
Guo, Christine C.
author_sort Baumann, Oliver
collection PubMed
description We often perceive real-life objects as multisensory cues through space and time. A key challenge for audiovisual integration is to match neural signals that not only originate from different sensory modalities but also that typically reach the observer at slightly different times. In humans, complex, unpredictable audiovisual streams lead to higher levels of perceptual coherence than predictable, rhythmic streams. In addition, perceptual coherence for complex signals seems less affected by increased asynchrony between visual and auditory modalities than for simple signals. Here, we used functional magnetic resonance imaging to determine the human neural correlates of audiovisual signals with different levels of temporal complexity and synchrony. Our study demonstrated that greater perceptual asynchrony and lower signal complexity impaired performance in an audiovisual coherence-matching task. Differences in asynchrony and complexity were also underpinned by a partially different set of brain regions. In particular, our results suggest that, while regions in the dorsolateral prefrontal cortex (DLPFC) were modulated by differences in memory load due to stimulus asynchrony, areas traditionally thought to be involved in speech production and recognition, such as the inferior frontal and superior temporal cortex, were modulated by the temporal complexity of the audiovisual signals. Our results, therefore, indicate specific processing roles for different subregions of the fronto-temporal cortex during audiovisual coherence detection.
format Online
Article
Text
id pubmed-5773885
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Society for Neuroscience
record_format MEDLINE/PubMed
spelling pubmed-57738852018-01-19 Neural Correlates of Temporal Complexity and Synchrony during Audiovisual Correspondence Detection Baumann, Oliver Vromen, Joyce M. G. Cheung, Allen McFadyen, Jessica Ren, Yudan Guo, Christine C. eNeuro New Research We often perceive real-life objects as multisensory cues through space and time. A key challenge for audiovisual integration is to match neural signals that not only originate from different sensory modalities but also that typically reach the observer at slightly different times. In humans, complex, unpredictable audiovisual streams lead to higher levels of perceptual coherence than predictable, rhythmic streams. In addition, perceptual coherence for complex signals seems less affected by increased asynchrony between visual and auditory modalities than for simple signals. Here, we used functional magnetic resonance imaging to determine the human neural correlates of audiovisual signals with different levels of temporal complexity and synchrony. Our study demonstrated that greater perceptual asynchrony and lower signal complexity impaired performance in an audiovisual coherence-matching task. Differences in asynchrony and complexity were also underpinned by a partially different set of brain regions. In particular, our results suggest that, while regions in the dorsolateral prefrontal cortex (DLPFC) were modulated by differences in memory load due to stimulus asynchrony, areas traditionally thought to be involved in speech production and recognition, such as the inferior frontal and superior temporal cortex, were modulated by the temporal complexity of the audiovisual signals. Our results, therefore, indicate specific processing roles for different subregions of the fronto-temporal cortex during audiovisual coherence detection. Society for Neuroscience 2018-01-19 /pmc/articles/PMC5773885/ /pubmed/29354682 http://dx.doi.org/10.1523/ENEURO.0294-17.2018 Text en Copyright © 2018 Baumann et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International license (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution and reproduction in any medium provided that the original work is properly attributed.
spellingShingle New Research
Baumann, Oliver
Vromen, Joyce M. G.
Cheung, Allen
McFadyen, Jessica
Ren, Yudan
Guo, Christine C.
Neural Correlates of Temporal Complexity and Synchrony during Audiovisual Correspondence Detection
title Neural Correlates of Temporal Complexity and Synchrony during Audiovisual Correspondence Detection
title_full Neural Correlates of Temporal Complexity and Synchrony during Audiovisual Correspondence Detection
title_fullStr Neural Correlates of Temporal Complexity and Synchrony during Audiovisual Correspondence Detection
title_full_unstemmed Neural Correlates of Temporal Complexity and Synchrony during Audiovisual Correspondence Detection
title_short Neural Correlates of Temporal Complexity and Synchrony during Audiovisual Correspondence Detection
title_sort neural correlates of temporal complexity and synchrony during audiovisual correspondence detection
topic New Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5773885/
https://www.ncbi.nlm.nih.gov/pubmed/29354682
http://dx.doi.org/10.1523/ENEURO.0294-17.2018
work_keys_str_mv AT baumannoliver neuralcorrelatesoftemporalcomplexityandsynchronyduringaudiovisualcorrespondencedetection
AT vromenjoycemg neuralcorrelatesoftemporalcomplexityandsynchronyduringaudiovisualcorrespondencedetection
AT cheungallen neuralcorrelatesoftemporalcomplexityandsynchronyduringaudiovisualcorrespondencedetection
AT mcfadyenjessica neuralcorrelatesoftemporalcomplexityandsynchronyduringaudiovisualcorrespondencedetection
AT renyudan neuralcorrelatesoftemporalcomplexityandsynchronyduringaudiovisualcorrespondencedetection
AT guochristinec neuralcorrelatesoftemporalcomplexityandsynchronyduringaudiovisualcorrespondencedetection