Cargando…
Sound source localization with varying amount of visual information in virtual reality
To achieve accurate spatial auditory perception, subjects typically require personal head-related transfer functions (HRTFs) and the freedom for head movements. Loudspeaker-based virtual sound environments allow for realism without individualized measurements. To study audio-visual perception in rea...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6440636/ https://www.ncbi.nlm.nih.gov/pubmed/30925174 http://dx.doi.org/10.1371/journal.pone.0214603 |
_version_ | 1783407426112847872 |
---|---|
author | Ahrens, Axel Lund, Kasper Duemose Marschall, Marton Dau, Torsten |
author_facet | Ahrens, Axel Lund, Kasper Duemose Marschall, Marton Dau, Torsten |
author_sort | Ahrens, Axel |
collection | PubMed |
description | To achieve accurate spatial auditory perception, subjects typically require personal head-related transfer functions (HRTFs) and the freedom for head movements. Loudspeaker-based virtual sound environments allow for realism without individualized measurements. To study audio-visual perception in realistic environments, the combination of spatially tracked head mounted displays (HMDs), also known as virtual reality glasses, and virtual sound environments may be valuable. However, HMDs were recently shown to affect the subjects’ HRTFs and thus might influence sound localization performance. Furthermore, due to limitations of the reproduction of visual information on the HMD, audio-visual perception might be influenced. Here, a sound localization experiment was conducted both with and without an HMD and with a varying amount of visual information provided to the subjects. Furthermore, interaural time and level difference errors (ITDs and ILDs) as well as spectral perturbations induced by the HMD were analyzed and compared to the perceptual localization data. The results showed a reduction of the localization accuracy when the subjects were wearing an HMD and when they were blindfolded. The HMD-induced error in azimuth localization was found to be larger in the left than in the right hemisphere. When visual information of the limited set of source locations was provided, the localization error induced by the HMD was found to be negligible. Presenting visual information of hand-location and room dimensions showed better sound localization performance compared to the condition with no visual information. The addition of possible source locations further improved the localization accuracy. Also adding pointing feedback in form of a virtual laser pointer improved the accuracy of elevation perception but not of azimuth perception. |
format | Online Article Text |
id | pubmed-6440636 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-64406362019-04-12 Sound source localization with varying amount of visual information in virtual reality Ahrens, Axel Lund, Kasper Duemose Marschall, Marton Dau, Torsten PLoS One Research Article To achieve accurate spatial auditory perception, subjects typically require personal head-related transfer functions (HRTFs) and the freedom for head movements. Loudspeaker-based virtual sound environments allow for realism without individualized measurements. To study audio-visual perception in realistic environments, the combination of spatially tracked head mounted displays (HMDs), also known as virtual reality glasses, and virtual sound environments may be valuable. However, HMDs were recently shown to affect the subjects’ HRTFs and thus might influence sound localization performance. Furthermore, due to limitations of the reproduction of visual information on the HMD, audio-visual perception might be influenced. Here, a sound localization experiment was conducted both with and without an HMD and with a varying amount of visual information provided to the subjects. Furthermore, interaural time and level difference errors (ITDs and ILDs) as well as spectral perturbations induced by the HMD were analyzed and compared to the perceptual localization data. The results showed a reduction of the localization accuracy when the subjects were wearing an HMD and when they were blindfolded. The HMD-induced error in azimuth localization was found to be larger in the left than in the right hemisphere. When visual information of the limited set of source locations was provided, the localization error induced by the HMD was found to be negligible. Presenting visual information of hand-location and room dimensions showed better sound localization performance compared to the condition with no visual information. The addition of possible source locations further improved the localization accuracy. Also adding pointing feedback in form of a virtual laser pointer improved the accuracy of elevation perception but not of azimuth perception. Public Library of Science 2019-03-29 /pmc/articles/PMC6440636/ /pubmed/30925174 http://dx.doi.org/10.1371/journal.pone.0214603 Text en © 2019 Ahrens et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Ahrens, Axel Lund, Kasper Duemose Marschall, Marton Dau, Torsten Sound source localization with varying amount of visual information in virtual reality |
title | Sound source localization with varying amount of visual information in virtual reality |
title_full | Sound source localization with varying amount of visual information in virtual reality |
title_fullStr | Sound source localization with varying amount of visual information in virtual reality |
title_full_unstemmed | Sound source localization with varying amount of visual information in virtual reality |
title_short | Sound source localization with varying amount of visual information in virtual reality |
title_sort | sound source localization with varying amount of visual information in virtual reality |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6440636/ https://www.ncbi.nlm.nih.gov/pubmed/30925174 http://dx.doi.org/10.1371/journal.pone.0214603 |
work_keys_str_mv | AT ahrensaxel soundsourcelocalizationwithvaryingamountofvisualinformationinvirtualreality AT lundkasperduemose soundsourcelocalizationwithvaryingamountofvisualinformationinvirtualreality AT marschallmarton soundsourcelocalizationwithvaryingamountofvisualinformationinvirtualreality AT dautorsten soundsourcelocalizationwithvaryingamountofvisualinformationinvirtualreality |