Cargando…

A Neural Network Model Can Explain Ventriloquism Aftereffect and Its Generalization across Sound Frequencies

Exposure to synchronous but spatially disparate auditory and visual stimuli produces a perceptual shift of sound location towards the visual stimulus (ventriloquism effect). After adaptation to a ventriloquism situation, enduring sound shift is observed in the absence of the visual stimulus (ventril...

Descripción completa

Detalles Bibliográficos
Autores principales: Magosso, Elisa, Cona, Filippo, Ursino, Mauro
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi Publishing Corporation 2013
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3818813/
https://www.ncbi.nlm.nih.gov/pubmed/24228250
http://dx.doi.org/10.1155/2013/475427
_version_ 1782289904219193344
author Magosso, Elisa
Cona, Filippo
Ursino, Mauro
author_facet Magosso, Elisa
Cona, Filippo
Ursino, Mauro
author_sort Magosso, Elisa
collection PubMed
description Exposure to synchronous but spatially disparate auditory and visual stimuli produces a perceptual shift of sound location towards the visual stimulus (ventriloquism effect). After adaptation to a ventriloquism situation, enduring sound shift is observed in the absence of the visual stimulus (ventriloquism aftereffect). Experimental studies report opposing results as to aftereffect generalization across sound frequencies varying from aftereffect being confined to the frequency used during adaptation to aftereffect generalizing across some octaves. Here, we present an extension of a model of visual-auditory interaction we previously developed. The new model is able to simulate the ventriloquism effect and, via Hebbian learning rules, the ventriloquism aftereffect and can be used to investigate aftereffect generalization across frequencies. The model includes auditory neurons coding both for the spatial and spectral features of the auditory stimuli and mimicking properties of biological auditory neurons. The model suggests that different extent of aftereffect generalization across frequencies can be obtained by changing the intensity of the auditory stimulus that induces different amounts of activation in the auditory layer. The model provides a coherent theoretical framework to explain the apparently contradictory results found in the literature. Model mechanisms and hypotheses are discussed in relation to neurophysiological and psychophysical data.
format Online
Article
Text
id pubmed-3818813
institution National Center for Biotechnology Information
language English
publishDate 2013
publisher Hindawi Publishing Corporation
record_format MEDLINE/PubMed
spelling pubmed-38188132013-11-13 A Neural Network Model Can Explain Ventriloquism Aftereffect and Its Generalization across Sound Frequencies Magosso, Elisa Cona, Filippo Ursino, Mauro Biomed Res Int Research Article Exposure to synchronous but spatially disparate auditory and visual stimuli produces a perceptual shift of sound location towards the visual stimulus (ventriloquism effect). After adaptation to a ventriloquism situation, enduring sound shift is observed in the absence of the visual stimulus (ventriloquism aftereffect). Experimental studies report opposing results as to aftereffect generalization across sound frequencies varying from aftereffect being confined to the frequency used during adaptation to aftereffect generalizing across some octaves. Here, we present an extension of a model of visual-auditory interaction we previously developed. The new model is able to simulate the ventriloquism effect and, via Hebbian learning rules, the ventriloquism aftereffect and can be used to investigate aftereffect generalization across frequencies. The model includes auditory neurons coding both for the spatial and spectral features of the auditory stimuli and mimicking properties of biological auditory neurons. The model suggests that different extent of aftereffect generalization across frequencies can be obtained by changing the intensity of the auditory stimulus that induces different amounts of activation in the auditory layer. The model provides a coherent theoretical framework to explain the apparently contradictory results found in the literature. Model mechanisms and hypotheses are discussed in relation to neurophysiological and psychophysical data. Hindawi Publishing Corporation 2013 2013-10-21 /pmc/articles/PMC3818813/ /pubmed/24228250 http://dx.doi.org/10.1155/2013/475427 Text en Copyright © 2013 Elisa Magosso et al. https://creativecommons.org/licenses/by/3.0/ This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Magosso, Elisa
Cona, Filippo
Ursino, Mauro
A Neural Network Model Can Explain Ventriloquism Aftereffect and Its Generalization across Sound Frequencies
title A Neural Network Model Can Explain Ventriloquism Aftereffect and Its Generalization across Sound Frequencies
title_full A Neural Network Model Can Explain Ventriloquism Aftereffect and Its Generalization across Sound Frequencies
title_fullStr A Neural Network Model Can Explain Ventriloquism Aftereffect and Its Generalization across Sound Frequencies
title_full_unstemmed A Neural Network Model Can Explain Ventriloquism Aftereffect and Its Generalization across Sound Frequencies
title_short A Neural Network Model Can Explain Ventriloquism Aftereffect and Its Generalization across Sound Frequencies
title_sort neural network model can explain ventriloquism aftereffect and its generalization across sound frequencies
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3818813/
https://www.ncbi.nlm.nih.gov/pubmed/24228250
http://dx.doi.org/10.1155/2013/475427
work_keys_str_mv AT magossoelisa aneuralnetworkmodelcanexplainventriloquismaftereffectanditsgeneralizationacrosssoundfrequencies
AT conafilippo aneuralnetworkmodelcanexplainventriloquismaftereffectanditsgeneralizationacrosssoundfrequencies
AT ursinomauro aneuralnetworkmodelcanexplainventriloquismaftereffectanditsgeneralizationacrosssoundfrequencies
AT magossoelisa neuralnetworkmodelcanexplainventriloquismaftereffectanditsgeneralizationacrosssoundfrequencies
AT conafilippo neuralnetworkmodelcanexplainventriloquismaftereffectanditsgeneralizationacrosssoundfrequencies
AT ursinomauro neuralnetworkmodelcanexplainventriloquismaftereffectanditsgeneralizationacrosssoundfrequencies