Cargando…

Target spike patterns enable efficient and biologically plausible learning for complex temporal tasks

Recurrent spiking neural networks (RSNN) in the brain learn to perform a wide range of perceptual, cognitive and motor tasks very efficiently in terms of energy consumption and their training requires very few examples. This motivates the search for biologically inspired learning rules for RSNNs, ai...

Descripción completa

Detalles Bibliográficos
Autores principales: Muratore, Paolo, Capone, Cristiano, Paolucci, Pier Stanislao
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7886200/
https://www.ncbi.nlm.nih.gov/pubmed/33592040
http://dx.doi.org/10.1371/journal.pone.0247014
_version_ 1783651749246009344
author Muratore, Paolo
Capone, Cristiano
Paolucci, Pier Stanislao
author_facet Muratore, Paolo
Capone, Cristiano
Paolucci, Pier Stanislao
author_sort Muratore, Paolo
collection PubMed
description Recurrent spiking neural networks (RSNN) in the brain learn to perform a wide range of perceptual, cognitive and motor tasks very efficiently in terms of energy consumption and their training requires very few examples. This motivates the search for biologically inspired learning rules for RSNNs, aiming to improve our understanding of brain computation and the efficiency of artificial intelligence. Several spiking models and learning rules have been proposed, but it remains a challenge to design RSNNs whose learning relies on biologically plausible mechanisms and are capable of solving complex temporal tasks. In this paper, we derive a learning rule, local to the synapse, from a simple mathematical principle, the maximization of the likelihood for the network to solve a specific task. We propose a novel target-based learning scheme in which the learning rule derived from likelihood maximization is used to mimic a specific spatio-temporal spike pattern that encodes the solution to complex temporal tasks. This method makes the learning extremely rapid and precise, outperforming state of the art algorithms for RSNNs. While error-based approaches, (e.g. e-prop) trial after trial optimize the internal sequence of spikes in order to progressively minimize the MSE we assume that a signal randomly projected from an external origin (e.g. from other brain areas) directly defines the target sequence. This facilitates the learning procedure since the network is trained from the beginning to reproduce the desired internal sequence. We propose two versions of our learning rule: spike-dependent and voltage-dependent. We find that the latter provides remarkable benefits in terms of learning speed and robustness to noise. We demonstrate the capacity of our model to tackle several problems like learning multidimensional trajectories and solving the classical temporal XOR benchmark. Finally, we show that an online approximation of the gradient ascent, in addition to guaranteeing complete locality in time and space, allows learning after very few presentations of the target output. Our model can be applied to different types of biological neurons. The analytically derived plasticity learning rule is specific to each neuron model and can produce a theoretical prediction for experimental validation.
format Online
Article
Text
id pubmed-7886200
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-78862002021-02-23 Target spike patterns enable efficient and biologically plausible learning for complex temporal tasks Muratore, Paolo Capone, Cristiano Paolucci, Pier Stanislao PLoS One Research Article Recurrent spiking neural networks (RSNN) in the brain learn to perform a wide range of perceptual, cognitive and motor tasks very efficiently in terms of energy consumption and their training requires very few examples. This motivates the search for biologically inspired learning rules for RSNNs, aiming to improve our understanding of brain computation and the efficiency of artificial intelligence. Several spiking models and learning rules have been proposed, but it remains a challenge to design RSNNs whose learning relies on biologically plausible mechanisms and are capable of solving complex temporal tasks. In this paper, we derive a learning rule, local to the synapse, from a simple mathematical principle, the maximization of the likelihood for the network to solve a specific task. We propose a novel target-based learning scheme in which the learning rule derived from likelihood maximization is used to mimic a specific spatio-temporal spike pattern that encodes the solution to complex temporal tasks. This method makes the learning extremely rapid and precise, outperforming state of the art algorithms for RSNNs. While error-based approaches, (e.g. e-prop) trial after trial optimize the internal sequence of spikes in order to progressively minimize the MSE we assume that a signal randomly projected from an external origin (e.g. from other brain areas) directly defines the target sequence. This facilitates the learning procedure since the network is trained from the beginning to reproduce the desired internal sequence. We propose two versions of our learning rule: spike-dependent and voltage-dependent. We find that the latter provides remarkable benefits in terms of learning speed and robustness to noise. We demonstrate the capacity of our model to tackle several problems like learning multidimensional trajectories and solving the classical temporal XOR benchmark. Finally, we show that an online approximation of the gradient ascent, in addition to guaranteeing complete locality in time and space, allows learning after very few presentations of the target output. Our model can be applied to different types of biological neurons. The analytically derived plasticity learning rule is specific to each neuron model and can produce a theoretical prediction for experimental validation. Public Library of Science 2021-02-16 /pmc/articles/PMC7886200/ /pubmed/33592040 http://dx.doi.org/10.1371/journal.pone.0247014 Text en © 2021 Muratore et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Muratore, Paolo
Capone, Cristiano
Paolucci, Pier Stanislao
Target spike patterns enable efficient and biologically plausible learning for complex temporal tasks
title Target spike patterns enable efficient and biologically plausible learning for complex temporal tasks
title_full Target spike patterns enable efficient and biologically plausible learning for complex temporal tasks
title_fullStr Target spike patterns enable efficient and biologically plausible learning for complex temporal tasks
title_full_unstemmed Target spike patterns enable efficient and biologically plausible learning for complex temporal tasks
title_short Target spike patterns enable efficient and biologically plausible learning for complex temporal tasks
title_sort target spike patterns enable efficient and biologically plausible learning for complex temporal tasks
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7886200/
https://www.ncbi.nlm.nih.gov/pubmed/33592040
http://dx.doi.org/10.1371/journal.pone.0247014
work_keys_str_mv AT muratorepaolo targetspikepatternsenableefficientandbiologicallyplausiblelearningforcomplextemporaltasks
AT caponecristiano targetspikepatternsenableefficientandbiologicallyplausiblelearningforcomplextemporaltasks
AT paoluccipierstanislao targetspikepatternsenableefficientandbiologicallyplausiblelearningforcomplextemporaltasks