Cargando…
Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention
We constantly integrate multiple types of information from different sensory modalities. Generally, such integration is influenced by the modality that we attend to. However, for duration perception, it has been shown that when duration information from visual and auditory modalities is integrated,...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8529022/ https://www.ncbi.nlm.nih.gov/pubmed/34690719 http://dx.doi.org/10.3389/fnhum.2021.725449 |
_version_ | 1784586376470069248 |
---|---|
author | Yoshimatsu, Hiroshi Yotsumoto, Yuko |
author_facet | Yoshimatsu, Hiroshi Yotsumoto, Yuko |
author_sort | Yoshimatsu, Hiroshi |
collection | PubMed |
description | We constantly integrate multiple types of information from different sensory modalities. Generally, such integration is influenced by the modality that we attend to. However, for duration perception, it has been shown that when duration information from visual and auditory modalities is integrated, the perceived duration of the visual stimulus leaned toward the duration of the auditory stimulus, irrespective of which modality was attended. In these studies, auditory dominance was assessed using visual and auditory stimuli with different durations whose timing of onset and offset would affect perception. In the present study, we aimed to investigate the effect of attention on duration integration using visual and auditory stimuli of the same duration. Since the duration of a visual flicker and auditory flutter tends to be perceived as longer than and shorter than its physical duration, respectively, we used the 10 Hz visual flicker and auditory flutter with the same onset and offset timings but different perceived durations. The participants were asked to attend either visual, auditory, or both modalities. Contrary to the attention-independent auditory dominance reported in previous studies, we found that the perceived duration of the simultaneous flicker and flutter presentation depended on which modality the participants attended. To further investigate the process of duration integration of the two modalities, we applied Bayesian hierarchical modeling, which enabled us to define a flexible model in which the multisensory duration is represented by the weighted average of each sensory modality. In addition, to examine whether auditory dominance results from the higher reliability of auditory stimuli, we applied another models to consider the stimulus reliability. These behavioral and modeling results suggest the following: (1) the perceived duration of visual and auditory stimuli is influenced by which modality the participants attended to when we control for the confounding effect of onset–offset timing of stimuli, and (2) the increase of the weight by attention affects the duration integration, even when the effect of stimulus reliability is controlled. Our models can be extended to investigate the neural basis and effects of other sensory modalities in duration integration. |
format | Online Article Text |
id | pubmed-8529022 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-85290222021-10-22 Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention Yoshimatsu, Hiroshi Yotsumoto, Yuko Front Hum Neurosci Neuroscience We constantly integrate multiple types of information from different sensory modalities. Generally, such integration is influenced by the modality that we attend to. However, for duration perception, it has been shown that when duration information from visual and auditory modalities is integrated, the perceived duration of the visual stimulus leaned toward the duration of the auditory stimulus, irrespective of which modality was attended. In these studies, auditory dominance was assessed using visual and auditory stimuli with different durations whose timing of onset and offset would affect perception. In the present study, we aimed to investigate the effect of attention on duration integration using visual and auditory stimuli of the same duration. Since the duration of a visual flicker and auditory flutter tends to be perceived as longer than and shorter than its physical duration, respectively, we used the 10 Hz visual flicker and auditory flutter with the same onset and offset timings but different perceived durations. The participants were asked to attend either visual, auditory, or both modalities. Contrary to the attention-independent auditory dominance reported in previous studies, we found that the perceived duration of the simultaneous flicker and flutter presentation depended on which modality the participants attended. To further investigate the process of duration integration of the two modalities, we applied Bayesian hierarchical modeling, which enabled us to define a flexible model in which the multisensory duration is represented by the weighted average of each sensory modality. In addition, to examine whether auditory dominance results from the higher reliability of auditory stimuli, we applied another models to consider the stimulus reliability. These behavioral and modeling results suggest the following: (1) the perceived duration of visual and auditory stimuli is influenced by which modality the participants attended to when we control for the confounding effect of onset–offset timing of stimuli, and (2) the increase of the weight by attention affects the duration integration, even when the effect of stimulus reliability is controlled. Our models can be extended to investigate the neural basis and effects of other sensory modalities in duration integration. Frontiers Media S.A. 2021-10-07 /pmc/articles/PMC8529022/ /pubmed/34690719 http://dx.doi.org/10.3389/fnhum.2021.725449 Text en Copyright © 2021 Yoshimatsu and Yotsumoto. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Yoshimatsu, Hiroshi Yotsumoto, Yuko Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention |
title | Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention |
title_full | Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention |
title_fullStr | Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention |
title_full_unstemmed | Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention |
title_short | Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention |
title_sort | weighted integration of duration information across visual and auditory modality is influenced by modality-specific attention |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8529022/ https://www.ncbi.nlm.nih.gov/pubmed/34690719 http://dx.doi.org/10.3389/fnhum.2021.725449 |
work_keys_str_mv | AT yoshimatsuhiroshi weightedintegrationofdurationinformationacrossvisualandauditorymodalityisinfluencedbymodalityspecificattention AT yotsumotoyuko weightedintegrationofdurationinformationacrossvisualandauditorymodalityisinfluencedbymodalityspecificattention |