Cargando…
Event-Based Update of Synapses in Voltage-Based Learning Rules
Due to the point-like nature of neuronal spiking, efficient neural network simulators often employ event-based simulation schemes for synapses. Yet many types of synaptic plasticity rely on the membrane potential of the postsynaptic cell as a third factor in addition to pre- and postsynaptic spike t...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8222618/ https://www.ncbi.nlm.nih.gov/pubmed/34177505 http://dx.doi.org/10.3389/fninf.2021.609147 |
_version_ | 1783711522233516032 |
---|---|
author | Stapmanns, Jonas Hahne, Jan Helias, Moritz Bolten, Matthias Diesmann, Markus Dahmen, David |
author_facet | Stapmanns, Jonas Hahne, Jan Helias, Moritz Bolten, Matthias Diesmann, Markus Dahmen, David |
author_sort | Stapmanns, Jonas |
collection | PubMed |
description | Due to the point-like nature of neuronal spiking, efficient neural network simulators often employ event-based simulation schemes for synapses. Yet many types of synaptic plasticity rely on the membrane potential of the postsynaptic cell as a third factor in addition to pre- and postsynaptic spike times. In some learning rules membrane potentials not only influence synaptic weight changes at the time points of spike events but in a continuous manner. In these cases, synapses therefore require information on the full time course of membrane potentials to update their strength which a priori suggests a continuous update in a time-driven manner. The latter hinders scaling of simulations to realistic cortical network sizes and relevant time scales for learning. Here, we derive two efficient algorithms for archiving postsynaptic membrane potentials, both compatible with modern simulation engines based on event-based synapse updates. We theoretically contrast the two algorithms with a time-driven synapse update scheme to analyze advantages in terms of memory and computations. We further present a reference implementation in the spiking neural network simulator NEST for two prototypical voltage-based plasticity rules: the Clopath rule and the Urbanczik-Senn rule. For both rules, the two event-based algorithms significantly outperform the time-driven scheme. Depending on the amount of data to be stored for plasticity, which heavily differs between the rules, a strong performance increase can be achieved by compressing or sampling of information on membrane potentials. Our results on computational efficiency related to archiving of information provide guidelines for the design of learning rules in order to make them practically usable in large-scale networks. |
format | Online Article Text |
id | pubmed-8222618 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-82226182021-06-25 Event-Based Update of Synapses in Voltage-Based Learning Rules Stapmanns, Jonas Hahne, Jan Helias, Moritz Bolten, Matthias Diesmann, Markus Dahmen, David Front Neuroinform Neuroscience Due to the point-like nature of neuronal spiking, efficient neural network simulators often employ event-based simulation schemes for synapses. Yet many types of synaptic plasticity rely on the membrane potential of the postsynaptic cell as a third factor in addition to pre- and postsynaptic spike times. In some learning rules membrane potentials not only influence synaptic weight changes at the time points of spike events but in a continuous manner. In these cases, synapses therefore require information on the full time course of membrane potentials to update their strength which a priori suggests a continuous update in a time-driven manner. The latter hinders scaling of simulations to realistic cortical network sizes and relevant time scales for learning. Here, we derive two efficient algorithms for archiving postsynaptic membrane potentials, both compatible with modern simulation engines based on event-based synapse updates. We theoretically contrast the two algorithms with a time-driven synapse update scheme to analyze advantages in terms of memory and computations. We further present a reference implementation in the spiking neural network simulator NEST for two prototypical voltage-based plasticity rules: the Clopath rule and the Urbanczik-Senn rule. For both rules, the two event-based algorithms significantly outperform the time-driven scheme. Depending on the amount of data to be stored for plasticity, which heavily differs between the rules, a strong performance increase can be achieved by compressing or sampling of information on membrane potentials. Our results on computational efficiency related to archiving of information provide guidelines for the design of learning rules in order to make them practically usable in large-scale networks. Frontiers Media S.A. 2021-06-10 /pmc/articles/PMC8222618/ /pubmed/34177505 http://dx.doi.org/10.3389/fninf.2021.609147 Text en Copyright © 2021 Stapmanns, Hahne, Helias, Bolten, Diesmann and Dahmen. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Stapmanns, Jonas Hahne, Jan Helias, Moritz Bolten, Matthias Diesmann, Markus Dahmen, David Event-Based Update of Synapses in Voltage-Based Learning Rules |
title | Event-Based Update of Synapses in Voltage-Based Learning Rules |
title_full | Event-Based Update of Synapses in Voltage-Based Learning Rules |
title_fullStr | Event-Based Update of Synapses in Voltage-Based Learning Rules |
title_full_unstemmed | Event-Based Update of Synapses in Voltage-Based Learning Rules |
title_short | Event-Based Update of Synapses in Voltage-Based Learning Rules |
title_sort | event-based update of synapses in voltage-based learning rules |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8222618/ https://www.ncbi.nlm.nih.gov/pubmed/34177505 http://dx.doi.org/10.3389/fninf.2021.609147 |
work_keys_str_mv | AT stapmannsjonas eventbasedupdateofsynapsesinvoltagebasedlearningrules AT hahnejan eventbasedupdateofsynapsesinvoltagebasedlearningrules AT heliasmoritz eventbasedupdateofsynapsesinvoltagebasedlearningrules AT boltenmatthias eventbasedupdateofsynapsesinvoltagebasedlearningrules AT diesmannmarkus eventbasedupdateofsynapsesinvoltagebasedlearningrules AT dahmendavid eventbasedupdateofsynapsesinvoltagebasedlearningrules |