Cargando…

Auditory aspects of multisensory working memory are retrieved better than visual aspects

Working memory (WM) reflects the transient maintenance of information in the absence of external input, which can be attained via multiple senses separately or simultaneously. Pertaining to WM, the prevailing literature suggests the dominance of vision over other sensory systems. However, this imbal...

Descripción completa

Detalles Bibliográficos
Autores principales: Turpin, Tori, Uluç, Işıl, Lankinen, Kaisu, Mamashli, Fahimeh, Ahveninen, Jyrki
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cold Spring Harbor Laboratory 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10418174/
https://www.ncbi.nlm.nih.gov/pubmed/37577481
http://dx.doi.org/10.1101/2023.08.03.551865
_version_ 1785088209520164864
author Turpin, Tori
Uluç, Işıl
Lankinen, Kaisu
Mamashli, Fahimeh
Ahveninen, Jyrki
author_facet Turpin, Tori
Uluç, Işıl
Lankinen, Kaisu
Mamashli, Fahimeh
Ahveninen, Jyrki
author_sort Turpin, Tori
collection PubMed
description Working memory (WM) reflects the transient maintenance of information in the absence of external input, which can be attained via multiple senses separately or simultaneously. Pertaining to WM, the prevailing literature suggests the dominance of vision over other sensory systems. However, this imbalance may be attributed to challenges of finding stimuli that are represented in comparable ways across modalities. Here, we addressed this methodological problem by using a balanced multisensory “retro-cue” WM design. The to-be-memorized stimuli consisted of combinations of auditory (ripple sounds) and visuospatial (Gabor patches) patterns, which have been shown to undergo similar transformations during WM encoding and retrieval. Using a staircase procedure, the auditory ripple velocities and spatial frequencies of Gabor patches were adjusted relative to each participant’s just noticeable differences (JND) separately in each modality, before the main task. The task was to audiovisually compare the probes to the memorized items. In randomly ordered trials, the probe either fully matched or differed from the memory item auditorily, visually, or audiovisually. The participants correctly rejected a significantly larger number of auditory non-match probes than visual non-match probes. Our findings suggest that, in the case of inter-sensory competition during feature maintenance, auditory attributes of multisensory WM items can be retrieved more precisely than their visual counterparts when complexity of the content and task demands are bimodally equated.
format Online
Article
Text
id pubmed-10418174
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Cold Spring Harbor Laboratory
record_format MEDLINE/PubMed
spelling pubmed-104181742023-08-12 Auditory aspects of multisensory working memory are retrieved better than visual aspects Turpin, Tori Uluç, Işıl Lankinen, Kaisu Mamashli, Fahimeh Ahveninen, Jyrki bioRxiv Article Working memory (WM) reflects the transient maintenance of information in the absence of external input, which can be attained via multiple senses separately or simultaneously. Pertaining to WM, the prevailing literature suggests the dominance of vision over other sensory systems. However, this imbalance may be attributed to challenges of finding stimuli that are represented in comparable ways across modalities. Here, we addressed this methodological problem by using a balanced multisensory “retro-cue” WM design. The to-be-memorized stimuli consisted of combinations of auditory (ripple sounds) and visuospatial (Gabor patches) patterns, which have been shown to undergo similar transformations during WM encoding and retrieval. Using a staircase procedure, the auditory ripple velocities and spatial frequencies of Gabor patches were adjusted relative to each participant’s just noticeable differences (JND) separately in each modality, before the main task. The task was to audiovisually compare the probes to the memorized items. In randomly ordered trials, the probe either fully matched or differed from the memory item auditorily, visually, or audiovisually. The participants correctly rejected a significantly larger number of auditory non-match probes than visual non-match probes. Our findings suggest that, in the case of inter-sensory competition during feature maintenance, auditory attributes of multisensory WM items can be retrieved more precisely than their visual counterparts when complexity of the content and task demands are bimodally equated. Cold Spring Harbor Laboratory 2023-08-04 /pmc/articles/PMC10418174/ /pubmed/37577481 http://dx.doi.org/10.1101/2023.08.03.551865 Text en https://creativecommons.org/licenses/by-nc-nd/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (https://creativecommons.org/licenses/by-nc-nd/4.0/) , which allows reusers to copy and distribute the material in any medium or format in unadapted form only, for noncommercial purposes only, and only so long as attribution is given to the creator.
spellingShingle Article
Turpin, Tori
Uluç, Işıl
Lankinen, Kaisu
Mamashli, Fahimeh
Ahveninen, Jyrki
Auditory aspects of multisensory working memory are retrieved better than visual aspects
title Auditory aspects of multisensory working memory are retrieved better than visual aspects
title_full Auditory aspects of multisensory working memory are retrieved better than visual aspects
title_fullStr Auditory aspects of multisensory working memory are retrieved better than visual aspects
title_full_unstemmed Auditory aspects of multisensory working memory are retrieved better than visual aspects
title_short Auditory aspects of multisensory working memory are retrieved better than visual aspects
title_sort auditory aspects of multisensory working memory are retrieved better than visual aspects
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10418174/
https://www.ncbi.nlm.nih.gov/pubmed/37577481
http://dx.doi.org/10.1101/2023.08.03.551865
work_keys_str_mv AT turpintori auditoryaspectsofmultisensoryworkingmemoryareretrievedbetterthanvisualaspects
AT ulucisıl auditoryaspectsofmultisensoryworkingmemoryareretrievedbetterthanvisualaspects
AT lankinenkaisu auditoryaspectsofmultisensoryworkingmemoryareretrievedbetterthanvisualaspects
AT mamashlifahimeh auditoryaspectsofmultisensoryworkingmemoryareretrievedbetterthanvisualaspects
AT ahveninenjyrki auditoryaspectsofmultisensoryworkingmemoryareretrievedbetterthanvisualaspects