Cargando…
Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks
Spiking Neural Networks (SNNs) offer great potential to promote both the performance and efficiency of real-world computing systems, considering the biological plausibility of SNNs. The emerging analog Resistive Random Access Memory (RRAM) devices have drawn increasing interest as potential neuromor...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6691091/ https://www.ncbi.nlm.nih.gov/pubmed/31447634 http://dx.doi.org/10.3389/fnins.2019.00812 |
_version_ | 1783443291636760576 |
---|---|
author | Guo, Yilong Wu, Huaqiang Gao, Bin Qian, He |
author_facet | Guo, Yilong Wu, Huaqiang Gao, Bin Qian, He |
author_sort | Guo, Yilong |
collection | PubMed |
description | Spiking Neural Networks (SNNs) offer great potential to promote both the performance and efficiency of real-world computing systems, considering the biological plausibility of SNNs. The emerging analog Resistive Random Access Memory (RRAM) devices have drawn increasing interest as potential neuromorphic hardware for implementing practical SNNs. In this article, we propose a novel training approach (called greedy training) for SNNs by diluting spike events on the temporal dimension with necessary controls on input encoding phase switching, endowing SNNs with the ability to cooperate with the inevitable conductance variations of RRAM devices. The SNNs could utilize Spike-Timing-Dependent Plasticity (STDP) as the unsupervised learning rule, and this plasticity has been observed on our one-transistor-one-resistor (1T1R) RRAM devices under voltage pulses with designed waveforms. We have also conducted handwritten digit recognition task simulations on MNIST dataset. The results show that the unsupervised SNNs trained by the proposed method could mitigate the requirement for the number of gradual levels of RRAM devices, and also have immunity to both cycle-to-cycle and device-to-device RRAM conductance variations. Unsupervised SNNs trained by the proposed methods could cooperate with real RRAM devices with non-ideal behaviors better, promising high feasibility of RRAM array based neuromorphic systems for online training. |
format | Online Article Text |
id | pubmed-6691091 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-66910912019-08-23 Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks Guo, Yilong Wu, Huaqiang Gao, Bin Qian, He Front Neurosci Neuroscience Spiking Neural Networks (SNNs) offer great potential to promote both the performance and efficiency of real-world computing systems, considering the biological plausibility of SNNs. The emerging analog Resistive Random Access Memory (RRAM) devices have drawn increasing interest as potential neuromorphic hardware for implementing practical SNNs. In this article, we propose a novel training approach (called greedy training) for SNNs by diluting spike events on the temporal dimension with necessary controls on input encoding phase switching, endowing SNNs with the ability to cooperate with the inevitable conductance variations of RRAM devices. The SNNs could utilize Spike-Timing-Dependent Plasticity (STDP) as the unsupervised learning rule, and this plasticity has been observed on our one-transistor-one-resistor (1T1R) RRAM devices under voltage pulses with designed waveforms. We have also conducted handwritten digit recognition task simulations on MNIST dataset. The results show that the unsupervised SNNs trained by the proposed method could mitigate the requirement for the number of gradual levels of RRAM devices, and also have immunity to both cycle-to-cycle and device-to-device RRAM conductance variations. Unsupervised SNNs trained by the proposed methods could cooperate with real RRAM devices with non-ideal behaviors better, promising high feasibility of RRAM array based neuromorphic systems for online training. Frontiers Media S.A. 2019-08-06 /pmc/articles/PMC6691091/ /pubmed/31447634 http://dx.doi.org/10.3389/fnins.2019.00812 Text en Copyright © 2019 Guo, Wu, Gao and Qian. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Guo, Yilong Wu, Huaqiang Gao, Bin Qian, He Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks |
title | Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks |
title_full | Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks |
title_fullStr | Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks |
title_full_unstemmed | Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks |
title_short | Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks |
title_sort | unsupervised learning on resistive memory array based spiking neural networks |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6691091/ https://www.ncbi.nlm.nih.gov/pubmed/31447634 http://dx.doi.org/10.3389/fnins.2019.00812 |
work_keys_str_mv | AT guoyilong unsupervisedlearningonresistivememoryarraybasedspikingneuralnetworks AT wuhuaqiang unsupervisedlearningonresistivememoryarraybasedspikingneuralnetworks AT gaobin unsupervisedlearningonresistivememoryarraybasedspikingneuralnetworks AT qianhe unsupervisedlearningonresistivememoryarraybasedspikingneuralnetworks |