Cargando…
GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity
Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. H...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7689090/ https://www.ncbi.nlm.nih.gov/pubmed/33281591 http://dx.doi.org/10.3389/fncom.2020.576841 |
_version_ | 1783613789286957056 |
---|---|
author | Zhao, Dongcheng Zeng, Yi Zhang, Tielin Shi, Mengting Zhao, Feifei |
author_facet | Zhao, Dongcheng Zeng, Yi Zhang, Tielin Shi, Mengting Zhao, Feifei |
author_sort | Zhao, Dongcheng |
collection | PubMed |
description | Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. Here we give an alternative method to train SNNs by biologically-plausible structural and functional inspirations from the brain. Firstly, inspired by the significant top-down structural connections, a global random feedback alignment is designed to help the SNN propagate the error target from the output layer directly to the previous few layers. Then inspired by the local plasticity of the biological system in which the synapses are more tuned by the neighborhood neurons, a differential STDP is used to optimize local plasticity. Extensive experimental results on the benchmark MNIST (98.62%) and Fashion MNIST (89.05%) have shown that the proposed algorithm performs favorably against several state-of-the-art SNNs trained with backpropagation. |
format | Online Article Text |
id | pubmed-7689090 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-76890902020-12-03 GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity Zhao, Dongcheng Zeng, Yi Zhang, Tielin Shi, Mengting Zhao, Feifei Front Comput Neurosci Neuroscience Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. Here we give an alternative method to train SNNs by biologically-plausible structural and functional inspirations from the brain. Firstly, inspired by the significant top-down structural connections, a global random feedback alignment is designed to help the SNN propagate the error target from the output layer directly to the previous few layers. Then inspired by the local plasticity of the biological system in which the synapses are more tuned by the neighborhood neurons, a differential STDP is used to optimize local plasticity. Extensive experimental results on the benchmark MNIST (98.62%) and Fashion MNIST (89.05%) have shown that the proposed algorithm performs favorably against several state-of-the-art SNNs trained with backpropagation. Frontiers Media S.A. 2020-11-12 /pmc/articles/PMC7689090/ /pubmed/33281591 http://dx.doi.org/10.3389/fncom.2020.576841 Text en Copyright © 2020 Zhao, Zeng, Zhang, Shi and Zhao. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Zhao, Dongcheng Zeng, Yi Zhang, Tielin Shi, Mengting Zhao, Feifei GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity |
title | GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity |
title_full | GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity |
title_fullStr | GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity |
title_full_unstemmed | GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity |
title_short | GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity |
title_sort | glsnn: a multi-layer spiking neural network based on global feedback alignment and local stdp plasticity |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7689090/ https://www.ncbi.nlm.nih.gov/pubmed/33281591 http://dx.doi.org/10.3389/fncom.2020.576841 |
work_keys_str_mv | AT zhaodongcheng glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT zengyi glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT zhangtielin glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT shimengting glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity AT zhaofeifei glsnnamultilayerspikingneuralnetworkbasedonglobalfeedbackalignmentandlocalstdpplasticity |