Cargando…

Efficient Visual Search from Synchronized Auditory Signals Requires Transient Audiovisual Events

BACKGROUND: A prevailing view is that audiovisual integration requires temporally coincident signals. However, a recent study failed to find any evidence for audiovisual integration in visual search even when using synchronized audiovisual events. An important question is what information is critica...

Descripción completa

Detalles Bibliográficos
Autores principales: Van der Burg, Erik, Cass, John, Olivers, Christian N. L., Theeuwes, Jan, Alais, David
Formato: Texto
Lenguaje:English
Publicado: Public Library of Science 2010
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2871056/
https://www.ncbi.nlm.nih.gov/pubmed/20498844
http://dx.doi.org/10.1371/journal.pone.0010664
_version_ 1782181141143355392
author Van der Burg, Erik
Cass, John
Olivers, Christian N. L.
Theeuwes, Jan
Alais, David
author_facet Van der Burg, Erik
Cass, John
Olivers, Christian N. L.
Theeuwes, Jan
Alais, David
author_sort Van der Burg, Erik
collection PubMed
description BACKGROUND: A prevailing view is that audiovisual integration requires temporally coincident signals. However, a recent study failed to find any evidence for audiovisual integration in visual search even when using synchronized audiovisual events. An important question is what information is critical to observe audiovisual integration. METHODOLOGY/PRINCIPAL FINDINGS: Here we demonstrate that temporal coincidence (i.e., synchrony) of auditory and visual components can trigger audiovisual interaction in cluttered displays and consequently produce very fast and efficient target identification. In visual search experiments, subjects found a modulating visual target vastly more efficiently when it was paired with a synchronous auditory signal. By manipulating the kind of temporal modulation (sine wave vs. square wave vs. difference wave; harmonic sine-wave synthesis; gradient of onset/offset ramps) we show that abrupt visual events are required for this search efficiency to occur, and that sinusoidal audiovisual modulations do not support efficient search. CONCLUSIONS/SIGNIFICANCE: Thus, audiovisual temporal alignment will only lead to benefits in visual search if the changes in the component signals are both synchronized and transient. We propose that transient signals are necessary in synchrony-driven binding to avoid spurious interactions with unrelated signals when these occur close together in time.
format Text
id pubmed-2871056
institution National Center for Biotechnology Information
language English
publishDate 2010
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-28710562010-05-24 Efficient Visual Search from Synchronized Auditory Signals Requires Transient Audiovisual Events Van der Burg, Erik Cass, John Olivers, Christian N. L. Theeuwes, Jan Alais, David PLoS One Research Article BACKGROUND: A prevailing view is that audiovisual integration requires temporally coincident signals. However, a recent study failed to find any evidence for audiovisual integration in visual search even when using synchronized audiovisual events. An important question is what information is critical to observe audiovisual integration. METHODOLOGY/PRINCIPAL FINDINGS: Here we demonstrate that temporal coincidence (i.e., synchrony) of auditory and visual components can trigger audiovisual interaction in cluttered displays and consequently produce very fast and efficient target identification. In visual search experiments, subjects found a modulating visual target vastly more efficiently when it was paired with a synchronous auditory signal. By manipulating the kind of temporal modulation (sine wave vs. square wave vs. difference wave; harmonic sine-wave synthesis; gradient of onset/offset ramps) we show that abrupt visual events are required for this search efficiency to occur, and that sinusoidal audiovisual modulations do not support efficient search. CONCLUSIONS/SIGNIFICANCE: Thus, audiovisual temporal alignment will only lead to benefits in visual search if the changes in the component signals are both synchronized and transient. We propose that transient signals are necessary in synchrony-driven binding to avoid spurious interactions with unrelated signals when these occur close together in time. Public Library of Science 2010-05-14 /pmc/articles/PMC2871056/ /pubmed/20498844 http://dx.doi.org/10.1371/journal.pone.0010664 Text en Van der Burg et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
spellingShingle Research Article
Van der Burg, Erik
Cass, John
Olivers, Christian N. L.
Theeuwes, Jan
Alais, David
Efficient Visual Search from Synchronized Auditory Signals Requires Transient Audiovisual Events
title Efficient Visual Search from Synchronized Auditory Signals Requires Transient Audiovisual Events
title_full Efficient Visual Search from Synchronized Auditory Signals Requires Transient Audiovisual Events
title_fullStr Efficient Visual Search from Synchronized Auditory Signals Requires Transient Audiovisual Events
title_full_unstemmed Efficient Visual Search from Synchronized Auditory Signals Requires Transient Audiovisual Events
title_short Efficient Visual Search from Synchronized Auditory Signals Requires Transient Audiovisual Events
title_sort efficient visual search from synchronized auditory signals requires transient audiovisual events
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2871056/
https://www.ncbi.nlm.nih.gov/pubmed/20498844
http://dx.doi.org/10.1371/journal.pone.0010664
work_keys_str_mv AT vanderburgerik efficientvisualsearchfromsynchronizedauditorysignalsrequirestransientaudiovisualevents
AT cassjohn efficientvisualsearchfromsynchronizedauditorysignalsrequirestransientaudiovisualevents
AT oliverschristiannl efficientvisualsearchfromsynchronizedauditorysignalsrequirestransientaudiovisualevents
AT theeuwesjan efficientvisualsearchfromsynchronizedauditorysignalsrequirestransientaudiovisualevents
AT alaisdavid efficientvisualsearchfromsynchronizedauditorysignalsrequirestransientaudiovisualevents