Cargando…

Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds

Attentional processes play a complex and multifaceted role in the integration of input from different sensory modalities. However, whether increased attentional load disrupts the audiovisual (AV) integration of common objects that involve semantic content remains unclear. Furthermore, knowledge rega...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Qingqing, Wu, Qiong, Yu, Yiyang, Wu, Fengxia, Takahashi, Satoshi, Ejima, Yoshimichi, Yang, Jiajia, Wu, Jinglong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: SAGE Publications 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7783684/
https://www.ncbi.nlm.nih.gov/pubmed/33456746
http://dx.doi.org/10.1177/2041669520981096
_version_ 1783632159232229376
author Li, Qingqing
Wu, Qiong
Yu, Yiyang
Wu, Fengxia
Takahashi, Satoshi
Ejima, Yoshimichi
Yang, Jiajia
Wu, Jinglong
author_facet Li, Qingqing
Wu, Qiong
Yu, Yiyang
Wu, Fengxia
Takahashi, Satoshi
Ejima, Yoshimichi
Yang, Jiajia
Wu, Jinglong
author_sort Li, Qingqing
collection PubMed
description Attentional processes play a complex and multifaceted role in the integration of input from different sensory modalities. However, whether increased attentional load disrupts the audiovisual (AV) integration of common objects that involve semantic content remains unclear. Furthermore, knowledge regarding how semantic congruency interacts with attentional load to influence the AV integration of common objects is limited. We investigated these questions by examining AV integration under various attentional-load conditions. AV integration was assessed by adopting an animal identification task using unisensory (animal images and sounds) and AV stimuli (semantically congruent AV objects and semantically incongruent AV objects), while attentional load was manipulated by using a rapid serial visual presentation task. Our results indicate that attentional load did not attenuate the integration of semantically congruent AV objects. However, semantically incongruent animal sounds and images were not integrated (as there was no multisensory facilitation), and the interference effect produced by the semantically incongruent AV objects was reduced by increased attentional-load manipulations. These findings highlight the critical role of semantic congruency in modulating the effect of attentional load on the AV integration of common objects.
format Online
Article
Text
id pubmed-7783684
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher SAGE Publications
record_format MEDLINE/PubMed
spelling pubmed-77836842021-01-14 Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds Li, Qingqing Wu, Qiong Yu, Yiyang Wu, Fengxia Takahashi, Satoshi Ejima, Yoshimichi Yang, Jiajia Wu, Jinglong Iperception Article Attentional processes play a complex and multifaceted role in the integration of input from different sensory modalities. However, whether increased attentional load disrupts the audiovisual (AV) integration of common objects that involve semantic content remains unclear. Furthermore, knowledge regarding how semantic congruency interacts with attentional load to influence the AV integration of common objects is limited. We investigated these questions by examining AV integration under various attentional-load conditions. AV integration was assessed by adopting an animal identification task using unisensory (animal images and sounds) and AV stimuli (semantically congruent AV objects and semantically incongruent AV objects), while attentional load was manipulated by using a rapid serial visual presentation task. Our results indicate that attentional load did not attenuate the integration of semantically congruent AV objects. However, semantically incongruent animal sounds and images were not integrated (as there was no multisensory facilitation), and the interference effect produced by the semantically incongruent AV objects was reduced by increased attentional-load manipulations. These findings highlight the critical role of semantic congruency in modulating the effect of attentional load on the AV integration of common objects. SAGE Publications 2020-12-31 /pmc/articles/PMC7783684/ /pubmed/33456746 http://dx.doi.org/10.1177/2041669520981096 Text en © The Author(s) 2020 https://creativecommons.org/licenses/by/4.0/ Creative Commons CC BY: This article is distributed under the terms of the Creative Commons Attribution 4.0 License (https://creativecommons.org/licenses/by/4.0/) which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage).
spellingShingle Article
Li, Qingqing
Wu, Qiong
Yu, Yiyang
Wu, Fengxia
Takahashi, Satoshi
Ejima, Yoshimichi
Yang, Jiajia
Wu, Jinglong
Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds
title Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds
title_full Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds
title_fullStr Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds
title_full_unstemmed Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds
title_short Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds
title_sort semantic congruency modulates the effect of attentional load on the audiovisual integration of animate images and sounds
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7783684/
https://www.ncbi.nlm.nih.gov/pubmed/33456746
http://dx.doi.org/10.1177/2041669520981096
work_keys_str_mv AT liqingqing semanticcongruencymodulatestheeffectofattentionalloadontheaudiovisualintegrationofanimateimagesandsounds
AT wuqiong semanticcongruencymodulatestheeffectofattentionalloadontheaudiovisualintegrationofanimateimagesandsounds
AT yuyiyang semanticcongruencymodulatestheeffectofattentionalloadontheaudiovisualintegrationofanimateimagesandsounds
AT wufengxia semanticcongruencymodulatestheeffectofattentionalloadontheaudiovisualintegrationofanimateimagesandsounds
AT takahashisatoshi semanticcongruencymodulatestheeffectofattentionalloadontheaudiovisualintegrationofanimateimagesandsounds
AT ejimayoshimichi semanticcongruencymodulatestheeffectofattentionalloadontheaudiovisualintegrationofanimateimagesandsounds
AT yangjiajia semanticcongruencymodulatestheeffectofattentionalloadontheaudiovisualintegrationofanimateimagesandsounds
AT wujinglong semanticcongruencymodulatestheeffectofattentionalloadontheaudiovisualintegrationofanimateimagesandsounds