Cargando…

Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons

In natural auditory environments, acoustic signals originate from the temporal superimposition of different sound sources. The problem of inferring individual sources from ambiguous mixtures of sounds is known as blind source decomposition. Experiments on humans have demonstrated that the auditory s...

Descripción completa

Detalles Bibliográficos
Autores principales: Dellaferrera, Giorgia, Asabuki, Toshitake, Fukai, Tomoki
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9097820/
https://www.ncbi.nlm.nih.gov/pubmed/35573290
http://dx.doi.org/10.3389/fnins.2022.855753
_version_ 1784706249530540032
author Dellaferrera, Giorgia
Asabuki, Toshitake
Fukai, Tomoki
author_facet Dellaferrera, Giorgia
Asabuki, Toshitake
Fukai, Tomoki
author_sort Dellaferrera, Giorgia
collection PubMed
description In natural auditory environments, acoustic signals originate from the temporal superimposition of different sound sources. The problem of inferring individual sources from ambiguous mixtures of sounds is known as blind source decomposition. Experiments on humans have demonstrated that the auditory system can identify sound sources as repeating patterns embedded in the acoustic input. Source repetition produces temporal regularities that can be detected and used for segregation. Specifically, listeners can identify sounds occurring more than once across different mixtures, but not sounds heard only in a single mixture. However, whether such a behavior can be computationally modeled has not yet been explored. Here, we propose a biologically inspired computational model to perform blind source separation on sequences of mixtures of acoustic stimuli. Our method relies on a somatodendritic neuron model trained with a Hebbian-like learning rule which was originally conceived to detect spatio-temporal patterns recurring in synaptic inputs. We show that the segregation capabilities of our model are reminiscent of the features of human performance in a variety of experimental settings involving synthesized sounds with naturalistic properties. Furthermore, we extend the study to investigate the properties of segregation on task settings not yet explored with human subjects, namely natural sounds and images. Overall, our work suggests that somatodendritic neuron models offer a promising neuro-inspired learning strategy to account for the characteristics of the brain segregation capabilities as well as to make predictions on yet untested experimental settings.
format Online
Article
Text
id pubmed-9097820
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-90978202022-05-13 Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons Dellaferrera, Giorgia Asabuki, Toshitake Fukai, Tomoki Front Neurosci Neuroscience In natural auditory environments, acoustic signals originate from the temporal superimposition of different sound sources. The problem of inferring individual sources from ambiguous mixtures of sounds is known as blind source decomposition. Experiments on humans have demonstrated that the auditory system can identify sound sources as repeating patterns embedded in the acoustic input. Source repetition produces temporal regularities that can be detected and used for segregation. Specifically, listeners can identify sounds occurring more than once across different mixtures, but not sounds heard only in a single mixture. However, whether such a behavior can be computationally modeled has not yet been explored. Here, we propose a biologically inspired computational model to perform blind source separation on sequences of mixtures of acoustic stimuli. Our method relies on a somatodendritic neuron model trained with a Hebbian-like learning rule which was originally conceived to detect spatio-temporal patterns recurring in synaptic inputs. We show that the segregation capabilities of our model are reminiscent of the features of human performance in a variety of experimental settings involving synthesized sounds with naturalistic properties. Furthermore, we extend the study to investigate the properties of segregation on task settings not yet explored with human subjects, namely natural sounds and images. Overall, our work suggests that somatodendritic neuron models offer a promising neuro-inspired learning strategy to account for the characteristics of the brain segregation capabilities as well as to make predictions on yet untested experimental settings. Frontiers Media S.A. 2022-04-28 /pmc/articles/PMC9097820/ /pubmed/35573290 http://dx.doi.org/10.3389/fnins.2022.855753 Text en Copyright © 2022 Dellaferrera, Asabuki and Fukai. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Dellaferrera, Giorgia
Asabuki, Toshitake
Fukai, Tomoki
Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons
title Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons
title_full Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons
title_fullStr Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons
title_full_unstemmed Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons
title_short Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons
title_sort modeling the repetition-based recovering of acoustic and visual sources with dendritic neurons
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9097820/
https://www.ncbi.nlm.nih.gov/pubmed/35573290
http://dx.doi.org/10.3389/fnins.2022.855753
work_keys_str_mv AT dellaferreragiorgia modelingtherepetitionbasedrecoveringofacousticandvisualsourceswithdendriticneurons
AT asabukitoshitake modelingtherepetitionbasedrecoveringofacousticandvisualsourceswithdendriticneurons
AT fukaitomoki modelingtherepetitionbasedrecoveringofacousticandvisualsourceswithdendriticneurons