Cargando…

Experimental Demonstration of Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses

Spiking neural networks (SNN) are computational models inspired by the brain’s ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more computationally efficient than the conventional artificial neural networks, though their...

Descripción completa

Detalles Bibliográficos
Autores principales: Nandakumar, S. R., Boybat, Irem, Le Gallo, Manuel, Eleftheriou, Evangelos, Sebastian, Abu, Rajendran, Bipin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7228943/
https://www.ncbi.nlm.nih.gov/pubmed/32415108
http://dx.doi.org/10.1038/s41598-020-64878-5
_version_ 1783534664728707072
author Nandakumar, S. R.
Boybat, Irem
Le Gallo, Manuel
Eleftheriou, Evangelos
Sebastian, Abu
Rajendran, Bipin
author_facet Nandakumar, S. R.
Boybat, Irem
Le Gallo, Manuel
Eleftheriou, Evangelos
Sebastian, Abu
Rajendran, Bipin
author_sort Nandakumar, S. R.
collection PubMed
description Spiking neural networks (SNN) are computational models inspired by the brain’s ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more computationally efficient than the conventional artificial neural networks, though their full computational capabilities are yet to be explored. Recently, in-memory computing architectures based on non-volatile memory crossbar arrays have shown great promise to implement parallel computations in artificial and spiking neural networks. In this work, we evaluate the feasibility to realize high-performance event-driven in-situ supervised learning systems using nanoscale and stochastic analog memory synapses. For the first time, the potential of analog memory synapses to generate precisely timed spikes in SNNs is experimentally demonstrated. The experiment targets applications which directly integrates spike encoded signals generated from bio-mimetic sensors with in-memory computing based learning systems to generate precisely timed control signal spikes for neuromorphic actuators. More than 170,000 phase-change memory (PCM) based synapses from our prototype chip were trained based on an event-driven learning rule, to generate spike patterns with more than 85% of the spikes within a 25 ms tolerance interval in a 1250 ms long spike pattern. We observe that the accuracy is mainly limited by the imprecision related to device programming and temporal drift of conductance values. We show that an array level scaling scheme can significantly improve the retention of the trained SNN states in the presence of conductance drift in the PCM. Combining the computational potential of supervised SNNs with the parallel compute power of in-memory computing, this work paves the way for next-generation of efficient brain-inspired systems.
format Online
Article
Text
id pubmed-7228943
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-72289432020-05-20 Experimental Demonstration of Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses Nandakumar, S. R. Boybat, Irem Le Gallo, Manuel Eleftheriou, Evangelos Sebastian, Abu Rajendran, Bipin Sci Rep Article Spiking neural networks (SNN) are computational models inspired by the brain’s ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more computationally efficient than the conventional artificial neural networks, though their full computational capabilities are yet to be explored. Recently, in-memory computing architectures based on non-volatile memory crossbar arrays have shown great promise to implement parallel computations in artificial and spiking neural networks. In this work, we evaluate the feasibility to realize high-performance event-driven in-situ supervised learning systems using nanoscale and stochastic analog memory synapses. For the first time, the potential of analog memory synapses to generate precisely timed spikes in SNNs is experimentally demonstrated. The experiment targets applications which directly integrates spike encoded signals generated from bio-mimetic sensors with in-memory computing based learning systems to generate precisely timed control signal spikes for neuromorphic actuators. More than 170,000 phase-change memory (PCM) based synapses from our prototype chip were trained based on an event-driven learning rule, to generate spike patterns with more than 85% of the spikes within a 25 ms tolerance interval in a 1250 ms long spike pattern. We observe that the accuracy is mainly limited by the imprecision related to device programming and temporal drift of conductance values. We show that an array level scaling scheme can significantly improve the retention of the trained SNN states in the presence of conductance drift in the PCM. Combining the computational potential of supervised SNNs with the parallel compute power of in-memory computing, this work paves the way for next-generation of efficient brain-inspired systems. Nature Publishing Group UK 2020-05-15 /pmc/articles/PMC7228943/ /pubmed/32415108 http://dx.doi.org/10.1038/s41598-020-64878-5 Text en © The Author(s) 2020 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Nandakumar, S. R.
Boybat, Irem
Le Gallo, Manuel
Eleftheriou, Evangelos
Sebastian, Abu
Rajendran, Bipin
Experimental Demonstration of Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses
title Experimental Demonstration of Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses
title_full Experimental Demonstration of Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses
title_fullStr Experimental Demonstration of Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses
title_full_unstemmed Experimental Demonstration of Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses
title_short Experimental Demonstration of Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses
title_sort experimental demonstration of supervised learning in spiking neural networks with phase-change memory synapses
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7228943/
https://www.ncbi.nlm.nih.gov/pubmed/32415108
http://dx.doi.org/10.1038/s41598-020-64878-5
work_keys_str_mv AT nandakumarsr experimentaldemonstrationofsupervisedlearninginspikingneuralnetworkswithphasechangememorysynapses
AT boybatirem experimentaldemonstrationofsupervisedlearninginspikingneuralnetworkswithphasechangememorysynapses
AT legallomanuel experimentaldemonstrationofsupervisedlearninginspikingneuralnetworkswithphasechangememorysynapses
AT eleftheriouevangelos experimentaldemonstrationofsupervisedlearninginspikingneuralnetworkswithphasechangememorysynapses
AT sebastianabu experimentaldemonstrationofsupervisedlearninginspikingneuralnetworkswithphasechangememorysynapses
AT rajendranbipin experimentaldemonstrationofsupervisedlearninginspikingneuralnetworkswithphasechangememorysynapses