Cargando…
Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons
In natural auditory environments, acoustic signals originate from the temporal superimposition of different sound sources. The problem of inferring individual sources from ambiguous mixtures of sounds is known as blind source decomposition. Experiments on humans have demonstrated that the auditory s...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9097820/ https://www.ncbi.nlm.nih.gov/pubmed/35573290 http://dx.doi.org/10.3389/fnins.2022.855753 |
_version_ | 1784706249530540032 |
---|---|
author | Dellaferrera, Giorgia Asabuki, Toshitake Fukai, Tomoki |
author_facet | Dellaferrera, Giorgia Asabuki, Toshitake Fukai, Tomoki |
author_sort | Dellaferrera, Giorgia |
collection | PubMed |
description | In natural auditory environments, acoustic signals originate from the temporal superimposition of different sound sources. The problem of inferring individual sources from ambiguous mixtures of sounds is known as blind source decomposition. Experiments on humans have demonstrated that the auditory system can identify sound sources as repeating patterns embedded in the acoustic input. Source repetition produces temporal regularities that can be detected and used for segregation. Specifically, listeners can identify sounds occurring more than once across different mixtures, but not sounds heard only in a single mixture. However, whether such a behavior can be computationally modeled has not yet been explored. Here, we propose a biologically inspired computational model to perform blind source separation on sequences of mixtures of acoustic stimuli. Our method relies on a somatodendritic neuron model trained with a Hebbian-like learning rule which was originally conceived to detect spatio-temporal patterns recurring in synaptic inputs. We show that the segregation capabilities of our model are reminiscent of the features of human performance in a variety of experimental settings involving synthesized sounds with naturalistic properties. Furthermore, we extend the study to investigate the properties of segregation on task settings not yet explored with human subjects, namely natural sounds and images. Overall, our work suggests that somatodendritic neuron models offer a promising neuro-inspired learning strategy to account for the characteristics of the brain segregation capabilities as well as to make predictions on yet untested experimental settings. |
format | Online Article Text |
id | pubmed-9097820 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-90978202022-05-13 Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons Dellaferrera, Giorgia Asabuki, Toshitake Fukai, Tomoki Front Neurosci Neuroscience In natural auditory environments, acoustic signals originate from the temporal superimposition of different sound sources. The problem of inferring individual sources from ambiguous mixtures of sounds is known as blind source decomposition. Experiments on humans have demonstrated that the auditory system can identify sound sources as repeating patterns embedded in the acoustic input. Source repetition produces temporal regularities that can be detected and used for segregation. Specifically, listeners can identify sounds occurring more than once across different mixtures, but not sounds heard only in a single mixture. However, whether such a behavior can be computationally modeled has not yet been explored. Here, we propose a biologically inspired computational model to perform blind source separation on sequences of mixtures of acoustic stimuli. Our method relies on a somatodendritic neuron model trained with a Hebbian-like learning rule which was originally conceived to detect spatio-temporal patterns recurring in synaptic inputs. We show that the segregation capabilities of our model are reminiscent of the features of human performance in a variety of experimental settings involving synthesized sounds with naturalistic properties. Furthermore, we extend the study to investigate the properties of segregation on task settings not yet explored with human subjects, namely natural sounds and images. Overall, our work suggests that somatodendritic neuron models offer a promising neuro-inspired learning strategy to account for the characteristics of the brain segregation capabilities as well as to make predictions on yet untested experimental settings. Frontiers Media S.A. 2022-04-28 /pmc/articles/PMC9097820/ /pubmed/35573290 http://dx.doi.org/10.3389/fnins.2022.855753 Text en Copyright © 2022 Dellaferrera, Asabuki and Fukai. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Dellaferrera, Giorgia Asabuki, Toshitake Fukai, Tomoki Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons |
title | Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons |
title_full | Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons |
title_fullStr | Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons |
title_full_unstemmed | Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons |
title_short | Modeling the Repetition-Based Recovering of Acoustic and Visual Sources With Dendritic Neurons |
title_sort | modeling the repetition-based recovering of acoustic and visual sources with dendritic neurons |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9097820/ https://www.ncbi.nlm.nih.gov/pubmed/35573290 http://dx.doi.org/10.3389/fnins.2022.855753 |
work_keys_str_mv | AT dellaferreragiorgia modelingtherepetitionbasedrecoveringofacousticandvisualsourceswithdendriticneurons AT asabukitoshitake modelingtherepetitionbasedrecoveringofacousticandvisualsourceswithdendriticneurons AT fukaitomoki modelingtherepetitionbasedrecoveringofacousticandvisualsourceswithdendriticneurons |