Cargando…

Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors

Mixed-signal analog/digital circuits emulate spiking neurons and synapses with extremely high energy efficiency, an approach known as “neuromorphic engineering”. However, analog circuits are sensitive to process-induced variation among transistors in a chip (“device mismatch”). For neuromorphic impl...

Descripción completa

Detalles Bibliográficos
Autores principales: Büchel, Julian, Zendrikov, Dmitrii, Solinas, Sergio, Indiveri, Giacomo, Muir, Dylan R.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8642544/
https://www.ncbi.nlm.nih.gov/pubmed/34862429
http://dx.doi.org/10.1038/s41598-021-02779-x
_version_ 1784609699726884864
author Büchel, Julian
Zendrikov, Dmitrii
Solinas, Sergio
Indiveri, Giacomo
Muir, Dylan R.
author_facet Büchel, Julian
Zendrikov, Dmitrii
Solinas, Sergio
Indiveri, Giacomo
Muir, Dylan R.
author_sort Büchel, Julian
collection PubMed
description Mixed-signal analog/digital circuits emulate spiking neurons and synapses with extremely high energy efficiency, an approach known as “neuromorphic engineering”. However, analog circuits are sensitive to process-induced variation among transistors in a chip (“device mismatch”). For neuromorphic implementation of Spiking Neural Networks (SNNs), mismatch causes parameter variation between identically-configured neurons and synapses. Each chip exhibits a different distribution of neural parameters, causing deployed networks to respond differently between chips. Current solutions to mitigate mismatch based on per-chip calibration or on-chip learning entail increased design complexity, area and cost, making deployment of neuromorphic devices expensive and difficult. Here we present a supervised learning approach that produces SNNs with high robustness to mismatch and other common sources of noise. Our method trains SNNs to perform temporal classification tasks by mimicking a pre-trained dynamical system, using a local learning rule from non-linear control theory. We demonstrate our method on two tasks requiring temporal memory, and measure the robustness of our approach to several forms of noise and mismatch. We show that our approach is more robust than common alternatives for training SNNs. Our method provides robust deployment of pre-trained networks on mixed-signal neuromorphic hardware, without requiring per-device training or calibration.
format Online
Article
Text
id pubmed-8642544
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-86425442021-12-06 Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors Büchel, Julian Zendrikov, Dmitrii Solinas, Sergio Indiveri, Giacomo Muir, Dylan R. Sci Rep Article Mixed-signal analog/digital circuits emulate spiking neurons and synapses with extremely high energy efficiency, an approach known as “neuromorphic engineering”. However, analog circuits are sensitive to process-induced variation among transistors in a chip (“device mismatch”). For neuromorphic implementation of Spiking Neural Networks (SNNs), mismatch causes parameter variation between identically-configured neurons and synapses. Each chip exhibits a different distribution of neural parameters, causing deployed networks to respond differently between chips. Current solutions to mitigate mismatch based on per-chip calibration or on-chip learning entail increased design complexity, area and cost, making deployment of neuromorphic devices expensive and difficult. Here we present a supervised learning approach that produces SNNs with high robustness to mismatch and other common sources of noise. Our method trains SNNs to perform temporal classification tasks by mimicking a pre-trained dynamical system, using a local learning rule from non-linear control theory. We demonstrate our method on two tasks requiring temporal memory, and measure the robustness of our approach to several forms of noise and mismatch. We show that our approach is more robust than common alternatives for training SNNs. Our method provides robust deployment of pre-trained networks on mixed-signal neuromorphic hardware, without requiring per-device training or calibration. Nature Publishing Group UK 2021-12-03 /pmc/articles/PMC8642544/ /pubmed/34862429 http://dx.doi.org/10.1038/s41598-021-02779-x Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Büchel, Julian
Zendrikov, Dmitrii
Solinas, Sergio
Indiveri, Giacomo
Muir, Dylan R.
Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors
title Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors
title_full Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors
title_fullStr Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors
title_full_unstemmed Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors
title_short Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors
title_sort supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8642544/
https://www.ncbi.nlm.nih.gov/pubmed/34862429
http://dx.doi.org/10.1038/s41598-021-02779-x
work_keys_str_mv AT bucheljulian supervisedtrainingofspikingneuralnetworksforrobustdeploymentonmixedsignalneuromorphicprocessors
AT zendrikovdmitrii supervisedtrainingofspikingneuralnetworksforrobustdeploymentonmixedsignalneuromorphicprocessors
AT solinassergio supervisedtrainingofspikingneuralnetworksforrobustdeploymentonmixedsignalneuromorphicprocessors
AT indiverigiacomo supervisedtrainingofspikingneuralnetworksforrobustdeploymentonmixedsignalneuromorphicprocessors
AT muirdylanr supervisedtrainingofspikingneuralnetworksforrobustdeploymentonmixedsignalneuromorphicprocessors