Cargando…

Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention

We constantly integrate multiple types of information from different sensory modalities. Generally, such integration is influenced by the modality that we attend to. However, for duration perception, it has been shown that when duration information from visual and auditory modalities is integrated,...

Descripción completa

Detalles Bibliográficos
Autores principales: Yoshimatsu, Hiroshi, Yotsumoto, Yuko
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8529022/
https://www.ncbi.nlm.nih.gov/pubmed/34690719
http://dx.doi.org/10.3389/fnhum.2021.725449
_version_ 1784586376470069248
author Yoshimatsu, Hiroshi
Yotsumoto, Yuko
author_facet Yoshimatsu, Hiroshi
Yotsumoto, Yuko
author_sort Yoshimatsu, Hiroshi
collection PubMed
description We constantly integrate multiple types of information from different sensory modalities. Generally, such integration is influenced by the modality that we attend to. However, for duration perception, it has been shown that when duration information from visual and auditory modalities is integrated, the perceived duration of the visual stimulus leaned toward the duration of the auditory stimulus, irrespective of which modality was attended. In these studies, auditory dominance was assessed using visual and auditory stimuli with different durations whose timing of onset and offset would affect perception. In the present study, we aimed to investigate the effect of attention on duration integration using visual and auditory stimuli of the same duration. Since the duration of a visual flicker and auditory flutter tends to be perceived as longer than and shorter than its physical duration, respectively, we used the 10 Hz visual flicker and auditory flutter with the same onset and offset timings but different perceived durations. The participants were asked to attend either visual, auditory, or both modalities. Contrary to the attention-independent auditory dominance reported in previous studies, we found that the perceived duration of the simultaneous flicker and flutter presentation depended on which modality the participants attended. To further investigate the process of duration integration of the two modalities, we applied Bayesian hierarchical modeling, which enabled us to define a flexible model in which the multisensory duration is represented by the weighted average of each sensory modality. In addition, to examine whether auditory dominance results from the higher reliability of auditory stimuli, we applied another models to consider the stimulus reliability. These behavioral and modeling results suggest the following: (1) the perceived duration of visual and auditory stimuli is influenced by which modality the participants attended to when we control for the confounding effect of onset–offset timing of stimuli, and (2) the increase of the weight by attention affects the duration integration, even when the effect of stimulus reliability is controlled. Our models can be extended to investigate the neural basis and effects of other sensory modalities in duration integration.
format Online
Article
Text
id pubmed-8529022
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-85290222021-10-22 Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention Yoshimatsu, Hiroshi Yotsumoto, Yuko Front Hum Neurosci Neuroscience We constantly integrate multiple types of information from different sensory modalities. Generally, such integration is influenced by the modality that we attend to. However, for duration perception, it has been shown that when duration information from visual and auditory modalities is integrated, the perceived duration of the visual stimulus leaned toward the duration of the auditory stimulus, irrespective of which modality was attended. In these studies, auditory dominance was assessed using visual and auditory stimuli with different durations whose timing of onset and offset would affect perception. In the present study, we aimed to investigate the effect of attention on duration integration using visual and auditory stimuli of the same duration. Since the duration of a visual flicker and auditory flutter tends to be perceived as longer than and shorter than its physical duration, respectively, we used the 10 Hz visual flicker and auditory flutter with the same onset and offset timings but different perceived durations. The participants were asked to attend either visual, auditory, or both modalities. Contrary to the attention-independent auditory dominance reported in previous studies, we found that the perceived duration of the simultaneous flicker and flutter presentation depended on which modality the participants attended. To further investigate the process of duration integration of the two modalities, we applied Bayesian hierarchical modeling, which enabled us to define a flexible model in which the multisensory duration is represented by the weighted average of each sensory modality. In addition, to examine whether auditory dominance results from the higher reliability of auditory stimuli, we applied another models to consider the stimulus reliability. These behavioral and modeling results suggest the following: (1) the perceived duration of visual and auditory stimuli is influenced by which modality the participants attended to when we control for the confounding effect of onset–offset timing of stimuli, and (2) the increase of the weight by attention affects the duration integration, even when the effect of stimulus reliability is controlled. Our models can be extended to investigate the neural basis and effects of other sensory modalities in duration integration. Frontiers Media S.A. 2021-10-07 /pmc/articles/PMC8529022/ /pubmed/34690719 http://dx.doi.org/10.3389/fnhum.2021.725449 Text en Copyright © 2021 Yoshimatsu and Yotsumoto. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Yoshimatsu, Hiroshi
Yotsumoto, Yuko
Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention
title Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention
title_full Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention
title_fullStr Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention
title_full_unstemmed Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention
title_short Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention
title_sort weighted integration of duration information across visual and auditory modality is influenced by modality-specific attention
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8529022/
https://www.ncbi.nlm.nih.gov/pubmed/34690719
http://dx.doi.org/10.3389/fnhum.2021.725449
work_keys_str_mv AT yoshimatsuhiroshi weightedintegrationofdurationinformationacrossvisualandauditorymodalityisinfluencedbymodalityspecificattention
AT yotsumotoyuko weightedintegrationofdurationinformationacrossvisualandauditorymodalityisinfluencedbymodalityspecificattention