Cargando…
Temporal Structure and Complexity Affect Audio-Visual Correspondence Detection
Synchrony between events in different senses has long been considered the critical temporal cue for multisensory integration. Here, using rapid streams of auditory and visual events, we demonstrate how humans can use temporal structure (rather than mere temporal coincidence) to detect multisensory r...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2013
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3550803/ https://www.ncbi.nlm.nih.gov/pubmed/23346067 http://dx.doi.org/10.3389/fpsyg.2012.00619 |
_version_ | 1782256530866831360 |
---|---|
author | Denison, Rachel N. Driver, Jon Ruff, Christian C. |
author_facet | Denison, Rachel N. Driver, Jon Ruff, Christian C. |
author_sort | Denison, Rachel N. |
collection | PubMed |
description | Synchrony between events in different senses has long been considered the critical temporal cue for multisensory integration. Here, using rapid streams of auditory and visual events, we demonstrate how humans can use temporal structure (rather than mere temporal coincidence) to detect multisensory relatedness. We find psychophysically that participants can detect matching auditory and visual streams via shared temporal structure for crossmodal lags of up to 200 ms. Performance on this task reproduced features of past findings based on explicit timing judgments but did not show any special advantage for perfectly synchronous streams. Importantly, the complexity of temporal patterns influences sensitivity to correspondence. Stochastic, irregular streams – with richer temporal pattern information – led to higher audio-visual matching sensitivity than predictable, rhythmic streams. Our results reveal that temporal structure and its complexity are key determinants for human detection of audio-visual correspondence. The distinctive emphasis of our new paradigms on temporal patterning could be useful for studying special populations with suspected abnormalities in audio-visual temporal perception and multisensory integration. |
format | Online Article Text |
id | pubmed-3550803 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2013 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-35508032013-01-23 Temporal Structure and Complexity Affect Audio-Visual Correspondence Detection Denison, Rachel N. Driver, Jon Ruff, Christian C. Front Psychol Psychology Synchrony between events in different senses has long been considered the critical temporal cue for multisensory integration. Here, using rapid streams of auditory and visual events, we demonstrate how humans can use temporal structure (rather than mere temporal coincidence) to detect multisensory relatedness. We find psychophysically that participants can detect matching auditory and visual streams via shared temporal structure for crossmodal lags of up to 200 ms. Performance on this task reproduced features of past findings based on explicit timing judgments but did not show any special advantage for perfectly synchronous streams. Importantly, the complexity of temporal patterns influences sensitivity to correspondence. Stochastic, irregular streams – with richer temporal pattern information – led to higher audio-visual matching sensitivity than predictable, rhythmic streams. Our results reveal that temporal structure and its complexity are key determinants for human detection of audio-visual correspondence. The distinctive emphasis of our new paradigms on temporal patterning could be useful for studying special populations with suspected abnormalities in audio-visual temporal perception and multisensory integration. Frontiers Media S.A. 2013-01-22 /pmc/articles/PMC3550803/ /pubmed/23346067 http://dx.doi.org/10.3389/fpsyg.2012.00619 Text en Copyright © 2013 Denison, Driver and Ruff. http://creativecommons.org/licenses/by/3.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc. |
spellingShingle | Psychology Denison, Rachel N. Driver, Jon Ruff, Christian C. Temporal Structure and Complexity Affect Audio-Visual Correspondence Detection |
title | Temporal Structure and Complexity Affect Audio-Visual Correspondence Detection |
title_full | Temporal Structure and Complexity Affect Audio-Visual Correspondence Detection |
title_fullStr | Temporal Structure and Complexity Affect Audio-Visual Correspondence Detection |
title_full_unstemmed | Temporal Structure and Complexity Affect Audio-Visual Correspondence Detection |
title_short | Temporal Structure and Complexity Affect Audio-Visual Correspondence Detection |
title_sort | temporal structure and complexity affect audio-visual correspondence detection |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3550803/ https://www.ncbi.nlm.nih.gov/pubmed/23346067 http://dx.doi.org/10.3389/fpsyg.2012.00619 |
work_keys_str_mv | AT denisonracheln temporalstructureandcomplexityaffectaudiovisualcorrespondencedetection AT driverjon temporalstructureandcomplexityaffectaudiovisualcorrespondencedetection AT ruffchristianc temporalstructureandcomplexityaffectaudiovisualcorrespondencedetection |