Cargando…

Event-Based Update of Synapses in Voltage-Based Learning Rules

Due to the point-like nature of neuronal spiking, efficient neural network simulators often employ event-based simulation schemes for synapses. Yet many types of synaptic plasticity rely on the membrane potential of the postsynaptic cell as a third factor in addition to pre- and postsynaptic spike t...

Descripción completa

Detalles Bibliográficos
Autores principales: Stapmanns, Jonas, Hahne, Jan, Helias, Moritz, Bolten, Matthias, Diesmann, Markus, Dahmen, David
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8222618/
https://www.ncbi.nlm.nih.gov/pubmed/34177505
http://dx.doi.org/10.3389/fninf.2021.609147
_version_ 1783711522233516032
author Stapmanns, Jonas
Hahne, Jan
Helias, Moritz
Bolten, Matthias
Diesmann, Markus
Dahmen, David
author_facet Stapmanns, Jonas
Hahne, Jan
Helias, Moritz
Bolten, Matthias
Diesmann, Markus
Dahmen, David
author_sort Stapmanns, Jonas
collection PubMed
description Due to the point-like nature of neuronal spiking, efficient neural network simulators often employ event-based simulation schemes for synapses. Yet many types of synaptic plasticity rely on the membrane potential of the postsynaptic cell as a third factor in addition to pre- and postsynaptic spike times. In some learning rules membrane potentials not only influence synaptic weight changes at the time points of spike events but in a continuous manner. In these cases, synapses therefore require information on the full time course of membrane potentials to update their strength which a priori suggests a continuous update in a time-driven manner. The latter hinders scaling of simulations to realistic cortical network sizes and relevant time scales for learning. Here, we derive two efficient algorithms for archiving postsynaptic membrane potentials, both compatible with modern simulation engines based on event-based synapse updates. We theoretically contrast the two algorithms with a time-driven synapse update scheme to analyze advantages in terms of memory and computations. We further present a reference implementation in the spiking neural network simulator NEST for two prototypical voltage-based plasticity rules: the Clopath rule and the Urbanczik-Senn rule. For both rules, the two event-based algorithms significantly outperform the time-driven scheme. Depending on the amount of data to be stored for plasticity, which heavily differs between the rules, a strong performance increase can be achieved by compressing or sampling of information on membrane potentials. Our results on computational efficiency related to archiving of information provide guidelines for the design of learning rules in order to make them practically usable in large-scale networks.
format Online
Article
Text
id pubmed-8222618
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-82226182021-06-25 Event-Based Update of Synapses in Voltage-Based Learning Rules Stapmanns, Jonas Hahne, Jan Helias, Moritz Bolten, Matthias Diesmann, Markus Dahmen, David Front Neuroinform Neuroscience Due to the point-like nature of neuronal spiking, efficient neural network simulators often employ event-based simulation schemes for synapses. Yet many types of synaptic plasticity rely on the membrane potential of the postsynaptic cell as a third factor in addition to pre- and postsynaptic spike times. In some learning rules membrane potentials not only influence synaptic weight changes at the time points of spike events but in a continuous manner. In these cases, synapses therefore require information on the full time course of membrane potentials to update their strength which a priori suggests a continuous update in a time-driven manner. The latter hinders scaling of simulations to realistic cortical network sizes and relevant time scales for learning. Here, we derive two efficient algorithms for archiving postsynaptic membrane potentials, both compatible with modern simulation engines based on event-based synapse updates. We theoretically contrast the two algorithms with a time-driven synapse update scheme to analyze advantages in terms of memory and computations. We further present a reference implementation in the spiking neural network simulator NEST for two prototypical voltage-based plasticity rules: the Clopath rule and the Urbanczik-Senn rule. For both rules, the two event-based algorithms significantly outperform the time-driven scheme. Depending on the amount of data to be stored for plasticity, which heavily differs between the rules, a strong performance increase can be achieved by compressing or sampling of information on membrane potentials. Our results on computational efficiency related to archiving of information provide guidelines for the design of learning rules in order to make them practically usable in large-scale networks. Frontiers Media S.A. 2021-06-10 /pmc/articles/PMC8222618/ /pubmed/34177505 http://dx.doi.org/10.3389/fninf.2021.609147 Text en Copyright © 2021 Stapmanns, Hahne, Helias, Bolten, Diesmann and Dahmen. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Stapmanns, Jonas
Hahne, Jan
Helias, Moritz
Bolten, Matthias
Diesmann, Markus
Dahmen, David
Event-Based Update of Synapses in Voltage-Based Learning Rules
title Event-Based Update of Synapses in Voltage-Based Learning Rules
title_full Event-Based Update of Synapses in Voltage-Based Learning Rules
title_fullStr Event-Based Update of Synapses in Voltage-Based Learning Rules
title_full_unstemmed Event-Based Update of Synapses in Voltage-Based Learning Rules
title_short Event-Based Update of Synapses in Voltage-Based Learning Rules
title_sort event-based update of synapses in voltage-based learning rules
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8222618/
https://www.ncbi.nlm.nih.gov/pubmed/34177505
http://dx.doi.org/10.3389/fninf.2021.609147
work_keys_str_mv AT stapmannsjonas eventbasedupdateofsynapsesinvoltagebasedlearningrules
AT hahnejan eventbasedupdateofsynapsesinvoltagebasedlearningrules
AT heliasmoritz eventbasedupdateofsynapsesinvoltagebasedlearningrules
AT boltenmatthias eventbasedupdateofsynapsesinvoltagebasedlearningrules
AT diesmannmarkus eventbasedupdateofsynapsesinvoltagebasedlearningrules
AT dahmendavid eventbasedupdateofsynapsesinvoltagebasedlearningrules