Cargando…

GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity

Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. H...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhao, Dongcheng, Zeng, Yi, Zhang, Tielin, Shi, Mengting, Zhao, Feifei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7689090/
https://www.ncbi.nlm.nih.gov/pubmed/33281591
http://dx.doi.org/10.3389/fncom.2020.576841
_version_ 1783613789286957056
author Zhao, Dongcheng
Zeng, Yi
Zhang, Tielin
Shi, Mengting
Zhao, Feifei
author_facet Zhao, Dongcheng
Zeng, Yi
Zhang, Tielin
Shi, Mengting
Zhao, Feifei
author_sort Zhao, Dongcheng
collection PubMed
description Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. Here we give an alternative method to train SNNs by biologically-plausible structural and functional inspirations from the brain. Firstly, inspired by the significant top-down structural connections, a global random feedback alignment is designed to help the SNN propagate the error target from the output layer directly to the previous few layers. Then inspired by the local plasticity of the biological system in which the synapses are more tuned by the neighborhood neurons, a differential STDP is used to optimize local plasticity. Extensive experimental results on the benchmark MNIST (98.62%) and Fashion MNIST (89.05%) have shown that the proposed algorithm performs favorably against several state-of-the-art SNNs trained with backpropagation.
format Online
Article
Text
id pubmed-7689090
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-76890902020-12-03 GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity Zhao, Dongcheng Zeng, Yi Zhang, Tielin Shi, Mengting Zhao, Feifei Front Comput Neurosci Neuroscience Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. Here we give an alternative method to train SNNs by biologically-plausible structural and functional inspirations from the brain. Firstly, inspired by the significant top-down structural connections, a global random feedback alignment is designed to help the SNN propagate the error target from the output layer directly to the previous few layers. Then inspired by the local plasticity of the biological system in which the synapses are more tuned by the neighborhood neurons, a differential STDP is used to optimize local plasticity. Extensive experimental results on the benchmark MNIST (98.62%) and Fashion MNIST (89.05%) have shown that the proposed algorithm performs favorably against several state-of-the-art SNNs trained with backpropagation. Frontiers Media S.A. 2020-11-12 /pmc/articles/PMC7689090/ /pubmed/33281591 http://dx.doi.org/10.3389/fncom.2020.576841 Text en Copyright © 2020 Zhao, Zeng, Zhang, Shi and Zhao. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Zhao, Dongcheng
Zeng, Yi
Zhang, Tielin
Shi, Mengting
Zhao, Feifei
GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
title GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
title_full GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
title_fullStr GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
title_full_unstemmed GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
title_short GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
title_sort glsnn: a multi-layer spiking neural network based on global feedback alignment and local stdp plasticity
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7689090/
https://www.ncbi.nlm.nih.gov/pubmed/33281591
http://dx.doi.org/10.3389/fncom.2020.576841
work_keys_str_mv AT zhaodongcheng glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT zengyi glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT zhangtielin glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT shimengting glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity
AT zhaofeifei glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity