Cargando…

Multimodal Integration of Spatial Information: The Influence of Object-Related Factors and Self-Reported Strategies

Spatial representations are a result of multisensory information integration. More recent findings suggest that the multisensory information processing of a scene can be facilitated when paired with a semantically congruent auditory signal. This congruency effect was taken as evidence that audio-vis...

Descripción completa

Detalles Bibliográficos
Autores principales: Karimpur, Harun, Hamburger, Kai
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5030373/
https://www.ncbi.nlm.nih.gov/pubmed/27708608
http://dx.doi.org/10.3389/fpsyg.2016.01443
_version_ 1782454666888478720
author Karimpur, Harun
Hamburger, Kai
author_facet Karimpur, Harun
Hamburger, Kai
author_sort Karimpur, Harun
collection PubMed
description Spatial representations are a result of multisensory information integration. More recent findings suggest that the multisensory information processing of a scene can be facilitated when paired with a semantically congruent auditory signal. This congruency effect was taken as evidence that audio-visual integration occurs for complex scenes. As navigation in our environment consists of a seamless integration of complex sceneries, a fundamental question arises: how is human landmark-based wayfinding affected by multimodality? In order to address this question, two experiments were conducted in a virtual environment. The first experiment compared wayfinding and landmark recognition performance in unimodal visual and acoustic landmarks. The second experiment focused on the congruency of multimodal landmark combinations and additionally assessed subject’s self-reported strategies (i.e., whether they focused on direction sequences or landmarks). We demonstrate (1) the equality of acoustic and visual landmarks and (2) the congruency effect for the recognition of landmarks. Additionally, the results point out that self-reported strategies play a role and are an under-investigated topic in human landmark-based wayfinding.
format Online
Article
Text
id pubmed-5030373
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-50303732016-10-05 Multimodal Integration of Spatial Information: The Influence of Object-Related Factors and Self-Reported Strategies Karimpur, Harun Hamburger, Kai Front Psychol Psychology Spatial representations are a result of multisensory information integration. More recent findings suggest that the multisensory information processing of a scene can be facilitated when paired with a semantically congruent auditory signal. This congruency effect was taken as evidence that audio-visual integration occurs for complex scenes. As navigation in our environment consists of a seamless integration of complex sceneries, a fundamental question arises: how is human landmark-based wayfinding affected by multimodality? In order to address this question, two experiments were conducted in a virtual environment. The first experiment compared wayfinding and landmark recognition performance in unimodal visual and acoustic landmarks. The second experiment focused on the congruency of multimodal landmark combinations and additionally assessed subject’s self-reported strategies (i.e., whether they focused on direction sequences or landmarks). We demonstrate (1) the equality of acoustic and visual landmarks and (2) the congruency effect for the recognition of landmarks. Additionally, the results point out that self-reported strategies play a role and are an under-investigated topic in human landmark-based wayfinding. Frontiers Media S.A. 2016-09-21 /pmc/articles/PMC5030373/ /pubmed/27708608 http://dx.doi.org/10.3389/fpsyg.2016.01443 Text en Copyright © 2016 Karimpur and Hamburger. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Karimpur, Harun
Hamburger, Kai
Multimodal Integration of Spatial Information: The Influence of Object-Related Factors and Self-Reported Strategies
title Multimodal Integration of Spatial Information: The Influence of Object-Related Factors and Self-Reported Strategies
title_full Multimodal Integration of Spatial Information: The Influence of Object-Related Factors and Self-Reported Strategies
title_fullStr Multimodal Integration of Spatial Information: The Influence of Object-Related Factors and Self-Reported Strategies
title_full_unstemmed Multimodal Integration of Spatial Information: The Influence of Object-Related Factors and Self-Reported Strategies
title_short Multimodal Integration of Spatial Information: The Influence of Object-Related Factors and Self-Reported Strategies
title_sort multimodal integration of spatial information: the influence of object-related factors and self-reported strategies
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5030373/
https://www.ncbi.nlm.nih.gov/pubmed/27708608
http://dx.doi.org/10.3389/fpsyg.2016.01443
work_keys_str_mv AT karimpurharun multimodalintegrationofspatialinformationtheinfluenceofobjectrelatedfactorsandselfreportedstrategies
AT hamburgerkai multimodalintegrationofspatialinformationtheinfluenceofobjectrelatedfactorsandselfreportedstrategies