Cargando…
Local dendritic balance enables learning of efficient representations in networks of spiking neurons
How can neural networks learn to efficiently represent complex and high-dimensional inputs via local plasticity mechanisms? Classical models of representation learning assume that feedforward weights are learned via pairwise Hebbian-like plasticity. Here, we show that pairwise Hebbian-like plasticit...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
National Academy of Sciences
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8685685/ https://www.ncbi.nlm.nih.gov/pubmed/34876505 http://dx.doi.org/10.1073/pnas.2021925118 |
_version_ | 1784617880626659328 |
---|---|
author | Mikulasch, Fabian A. Rudelt, Lucas Priesemann, Viola |
author_facet | Mikulasch, Fabian A. Rudelt, Lucas Priesemann, Viola |
author_sort | Mikulasch, Fabian A. |
collection | PubMed |
description | How can neural networks learn to efficiently represent complex and high-dimensional inputs via local plasticity mechanisms? Classical models of representation learning assume that feedforward weights are learned via pairwise Hebbian-like plasticity. Here, we show that pairwise Hebbian-like plasticity works only under unrealistic requirements on neural dynamics and input statistics. To overcome these limitations, we derive from first principles a learning scheme based on voltage-dependent synaptic plasticity rules. Here, recurrent connections learn to locally balance feedforward input in individual dendritic compartments and thereby can modulate synaptic plasticity to learn efficient representations. We demonstrate in simulations that this learning scheme works robustly even for complex high-dimensional inputs and with inhibitory transmission delays, where Hebbian-like plasticity fails. Our results draw a direct connection between dendritic excitatory–inhibitory balance and voltage-dependent synaptic plasticity as observed in vivo and suggest that both are crucial for representation learning. |
format | Online Article Text |
id | pubmed-8685685 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | National Academy of Sciences |
record_format | MEDLINE/PubMed |
spelling | pubmed-86856852022-01-06 Local dendritic balance enables learning of efficient representations in networks of spiking neurons Mikulasch, Fabian A. Rudelt, Lucas Priesemann, Viola Proc Natl Acad Sci U S A Biological Sciences How can neural networks learn to efficiently represent complex and high-dimensional inputs via local plasticity mechanisms? Classical models of representation learning assume that feedforward weights are learned via pairwise Hebbian-like plasticity. Here, we show that pairwise Hebbian-like plasticity works only under unrealistic requirements on neural dynamics and input statistics. To overcome these limitations, we derive from first principles a learning scheme based on voltage-dependent synaptic plasticity rules. Here, recurrent connections learn to locally balance feedforward input in individual dendritic compartments and thereby can modulate synaptic plasticity to learn efficient representations. We demonstrate in simulations that this learning scheme works robustly even for complex high-dimensional inputs and with inhibitory transmission delays, where Hebbian-like plasticity fails. Our results draw a direct connection between dendritic excitatory–inhibitory balance and voltage-dependent synaptic plasticity as observed in vivo and suggest that both are crucial for representation learning. National Academy of Sciences 2021-12-07 2021-12-14 /pmc/articles/PMC8685685/ /pubmed/34876505 http://dx.doi.org/10.1073/pnas.2021925118 Text en Copyright © 2021 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by/4.0/This open access article is distributed under Creative Commons Attribution License 4.0 (CC BY) (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Biological Sciences Mikulasch, Fabian A. Rudelt, Lucas Priesemann, Viola Local dendritic balance enables learning of efficient representations in networks of spiking neurons |
title | Local dendritic balance enables learning of efficient representations in networks of spiking neurons |
title_full | Local dendritic balance enables learning of efficient representations in networks of spiking neurons |
title_fullStr | Local dendritic balance enables learning of efficient representations in networks of spiking neurons |
title_full_unstemmed | Local dendritic balance enables learning of efficient representations in networks of spiking neurons |
title_short | Local dendritic balance enables learning of efficient representations in networks of spiking neurons |
title_sort | local dendritic balance enables learning of efficient representations in networks of spiking neurons |
topic | Biological Sciences |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8685685/ https://www.ncbi.nlm.nih.gov/pubmed/34876505 http://dx.doi.org/10.1073/pnas.2021925118 |
work_keys_str_mv | AT mikulaschfabiana localdendriticbalanceenableslearningofefficientrepresentationsinnetworksofspikingneurons AT rudeltlucas localdendriticbalanceenableslearningofefficientrepresentationsinnetworksofspikingneurons AT priesemannviola localdendriticbalanceenableslearningofefficientrepresentationsinnetworksofspikingneurons |