Cargando…

Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks

Spiking Neural Networks (SNNs) offer great potential to promote both the performance and efficiency of real-world computing systems, considering the biological plausibility of SNNs. The emerging analog Resistive Random Access Memory (RRAM) devices have drawn increasing interest as potential neuromor...

Descripción completa

Detalles Bibliográficos
Autores principales: Guo, Yilong, Wu, Huaqiang, Gao, Bin, Qian, He
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6691091/
https://www.ncbi.nlm.nih.gov/pubmed/31447634
http://dx.doi.org/10.3389/fnins.2019.00812
_version_ 1783443291636760576
author Guo, Yilong
Wu, Huaqiang
Gao, Bin
Qian, He
author_facet Guo, Yilong
Wu, Huaqiang
Gao, Bin
Qian, He
author_sort Guo, Yilong
collection PubMed
description Spiking Neural Networks (SNNs) offer great potential to promote both the performance and efficiency of real-world computing systems, considering the biological plausibility of SNNs. The emerging analog Resistive Random Access Memory (RRAM) devices have drawn increasing interest as potential neuromorphic hardware for implementing practical SNNs. In this article, we propose a novel training approach (called greedy training) for SNNs by diluting spike events on the temporal dimension with necessary controls on input encoding phase switching, endowing SNNs with the ability to cooperate with the inevitable conductance variations of RRAM devices. The SNNs could utilize Spike-Timing-Dependent Plasticity (STDP) as the unsupervised learning rule, and this plasticity has been observed on our one-transistor-one-resistor (1T1R) RRAM devices under voltage pulses with designed waveforms. We have also conducted handwritten digit recognition task simulations on MNIST dataset. The results show that the unsupervised SNNs trained by the proposed method could mitigate the requirement for the number of gradual levels of RRAM devices, and also have immunity to both cycle-to-cycle and device-to-device RRAM conductance variations. Unsupervised SNNs trained by the proposed methods could cooperate with real RRAM devices with non-ideal behaviors better, promising high feasibility of RRAM array based neuromorphic systems for online training.
format Online
Article
Text
id pubmed-6691091
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-66910912019-08-23 Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks Guo, Yilong Wu, Huaqiang Gao, Bin Qian, He Front Neurosci Neuroscience Spiking Neural Networks (SNNs) offer great potential to promote both the performance and efficiency of real-world computing systems, considering the biological plausibility of SNNs. The emerging analog Resistive Random Access Memory (RRAM) devices have drawn increasing interest as potential neuromorphic hardware for implementing practical SNNs. In this article, we propose a novel training approach (called greedy training) for SNNs by diluting spike events on the temporal dimension with necessary controls on input encoding phase switching, endowing SNNs with the ability to cooperate with the inevitable conductance variations of RRAM devices. The SNNs could utilize Spike-Timing-Dependent Plasticity (STDP) as the unsupervised learning rule, and this plasticity has been observed on our one-transistor-one-resistor (1T1R) RRAM devices under voltage pulses with designed waveforms. We have also conducted handwritten digit recognition task simulations on MNIST dataset. The results show that the unsupervised SNNs trained by the proposed method could mitigate the requirement for the number of gradual levels of RRAM devices, and also have immunity to both cycle-to-cycle and device-to-device RRAM conductance variations. Unsupervised SNNs trained by the proposed methods could cooperate with real RRAM devices with non-ideal behaviors better, promising high feasibility of RRAM array based neuromorphic systems for online training. Frontiers Media S.A. 2019-08-06 /pmc/articles/PMC6691091/ /pubmed/31447634 http://dx.doi.org/10.3389/fnins.2019.00812 Text en Copyright © 2019 Guo, Wu, Gao and Qian. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Guo, Yilong
Wu, Huaqiang
Gao, Bin
Qian, He
Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks
title Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks
title_full Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks
title_fullStr Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks
title_full_unstemmed Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks
title_short Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks
title_sort unsupervised learning on resistive memory array based spiking neural networks
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6691091/
https://www.ncbi.nlm.nih.gov/pubmed/31447634
http://dx.doi.org/10.3389/fnins.2019.00812
work_keys_str_mv AT guoyilong unsupervisedlearningonresistivememoryarraybasedspikingneuralnetworks
AT wuhuaqiang unsupervisedlearningonresistivememoryarraybasedspikingneuralnetworks
AT gaobin unsupervisedlearningonresistivememoryarraybasedspikingneuralnetworks
AT qianhe unsupervisedlearningonresistivememoryarraybasedspikingneuralnetworks