Cargando…
First Error-Based Supervised Learning Algorithm for Spiking Neural Networks
Neural circuits respond to multiple sensory stimuli by firing precisely timed spikes. Inspired by this phenomenon, the spike timing-based spiking neural networks (SNNs) are proposed to process and memorize the spatiotemporal spike patterns. However, the response speed and accuracy of the existing le...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6563788/ https://www.ncbi.nlm.nih.gov/pubmed/31244594 http://dx.doi.org/10.3389/fnins.2019.00559 |
_version_ | 1783426612209909760 |
---|---|
author | Luo, Xiaoling Qu, Hong Zhang, Yun Chen, Yi |
author_facet | Luo, Xiaoling Qu, Hong Zhang, Yun Chen, Yi |
author_sort | Luo, Xiaoling |
collection | PubMed |
description | Neural circuits respond to multiple sensory stimuli by firing precisely timed spikes. Inspired by this phenomenon, the spike timing-based spiking neural networks (SNNs) are proposed to process and memorize the spatiotemporal spike patterns. However, the response speed and accuracy of the existing learning algorithms of SNNs are still lacking compared to the human brain. To further improve the performance of learning precisely timed spikes, we propose a new weight updating mechanism which always adjusts the synaptic weights at the first wrong output spike time. The proposed learning algorithm can accurately adjust the synaptic weights that contribute to the membrane potential of desired and non-desired firing time. Experimental results demonstrate that the proposed algorithm shows higher accuracy, better robustness, and less computational resources compared with the remote supervised method (ReSuMe) and the spike pattern association neuron (SPAN), which are classic sequence learning algorithms. In addition, the SNN-based computational model equipped with the proposed learning method achieves better recognition results in speech recognition task compared with other bio-inspired baseline systems. |
format | Online Article Text |
id | pubmed-6563788 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-65637882019-06-26 First Error-Based Supervised Learning Algorithm for Spiking Neural Networks Luo, Xiaoling Qu, Hong Zhang, Yun Chen, Yi Front Neurosci Neuroscience Neural circuits respond to multiple sensory stimuli by firing precisely timed spikes. Inspired by this phenomenon, the spike timing-based spiking neural networks (SNNs) are proposed to process and memorize the spatiotemporal spike patterns. However, the response speed and accuracy of the existing learning algorithms of SNNs are still lacking compared to the human brain. To further improve the performance of learning precisely timed spikes, we propose a new weight updating mechanism which always adjusts the synaptic weights at the first wrong output spike time. The proposed learning algorithm can accurately adjust the synaptic weights that contribute to the membrane potential of desired and non-desired firing time. Experimental results demonstrate that the proposed algorithm shows higher accuracy, better robustness, and less computational resources compared with the remote supervised method (ReSuMe) and the spike pattern association neuron (SPAN), which are classic sequence learning algorithms. In addition, the SNN-based computational model equipped with the proposed learning method achieves better recognition results in speech recognition task compared with other bio-inspired baseline systems. Frontiers Media S.A. 2019-06-06 /pmc/articles/PMC6563788/ /pubmed/31244594 http://dx.doi.org/10.3389/fnins.2019.00559 Text en Copyright © 2019 Luo, Qu, Zhang and Chen. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Luo, Xiaoling Qu, Hong Zhang, Yun Chen, Yi First Error-Based Supervised Learning Algorithm for Spiking Neural Networks |
title | First Error-Based Supervised Learning Algorithm for Spiking Neural Networks |
title_full | First Error-Based Supervised Learning Algorithm for Spiking Neural Networks |
title_fullStr | First Error-Based Supervised Learning Algorithm for Spiking Neural Networks |
title_full_unstemmed | First Error-Based Supervised Learning Algorithm for Spiking Neural Networks |
title_short | First Error-Based Supervised Learning Algorithm for Spiking Neural Networks |
title_sort | first error-based supervised learning algorithm for spiking neural networks |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6563788/ https://www.ncbi.nlm.nih.gov/pubmed/31244594 http://dx.doi.org/10.3389/fnins.2019.00559 |
work_keys_str_mv | AT luoxiaoling firsterrorbasedsupervisedlearningalgorithmforspikingneuralnetworks AT quhong firsterrorbasedsupervisedlearningalgorithmforspikingneuralnetworks AT zhangyun firsterrorbasedsupervisedlearningalgorithmforspikingneuralnetworks AT chenyi firsterrorbasedsupervisedlearningalgorithmforspikingneuralnetworks |