Cargando…

Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications

In the last few years, spiking neural networks (SNNs) have been demonstrated to perform on par with regular convolutional neural networks. Several works have proposed methods to convert a pre-trained CNN to a Spiking CNN without a significant sacrifice of performance. We demonstrate first that quant...

Descripción completa

Detalles Bibliográficos
Autores principales: Sorbaro, Martino, Liu, Qian, Bortone, Massimo, Sheik, Sadique
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7339957/
https://www.ncbi.nlm.nih.gov/pubmed/32694978
http://dx.doi.org/10.3389/fnins.2020.00662
_version_ 1783554965392850944
author Sorbaro, Martino
Liu, Qian
Bortone, Massimo
Sheik, Sadique
author_facet Sorbaro, Martino
Liu, Qian
Bortone, Massimo
Sheik, Sadique
author_sort Sorbaro, Martino
collection PubMed
description In the last few years, spiking neural networks (SNNs) have been demonstrated to perform on par with regular convolutional neural networks. Several works have proposed methods to convert a pre-trained CNN to a Spiking CNN without a significant sacrifice of performance. We demonstrate first that quantization-aware training of CNNs leads to better accuracy in SNNs. One of the benefits of converting CNNs to spiking CNNs is to leverage the sparse computation of SNNs and consequently perform equivalent computation at a lower energy consumption. Here we propose an optimization strategy to train efficient spiking networks with lower energy consumption, while maintaining similar accuracy levels. We demonstrate results on the MNIST-DVS and CIFAR-10 datasets.
format Online
Article
Text
id pubmed-7339957
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-73399572020-07-20 Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications Sorbaro, Martino Liu, Qian Bortone, Massimo Sheik, Sadique Front Neurosci Neuroscience In the last few years, spiking neural networks (SNNs) have been demonstrated to perform on par with regular convolutional neural networks. Several works have proposed methods to convert a pre-trained CNN to a Spiking CNN without a significant sacrifice of performance. We demonstrate first that quantization-aware training of CNNs leads to better accuracy in SNNs. One of the benefits of converting CNNs to spiking CNNs is to leverage the sparse computation of SNNs and consequently perform equivalent computation at a lower energy consumption. Here we propose an optimization strategy to train efficient spiking networks with lower energy consumption, while maintaining similar accuracy levels. We demonstrate results on the MNIST-DVS and CIFAR-10 datasets. Frontiers Media S.A. 2020-06-30 /pmc/articles/PMC7339957/ /pubmed/32694978 http://dx.doi.org/10.3389/fnins.2020.00662 Text en Copyright © 2020 Sorbaro, Liu, Bortone and Sheik. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Sorbaro, Martino
Liu, Qian
Bortone, Massimo
Sheik, Sadique
Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications
title Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications
title_full Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications
title_fullStr Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications
title_full_unstemmed Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications
title_short Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications
title_sort optimizing the energy consumption of spiking neural networks for neuromorphic applications
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7339957/
https://www.ncbi.nlm.nih.gov/pubmed/32694978
http://dx.doi.org/10.3389/fnins.2020.00662
work_keys_str_mv AT sorbaromartino optimizingtheenergyconsumptionofspikingneuralnetworksforneuromorphicapplications
AT liuqian optimizingtheenergyconsumptionofspikingneuralnetworksforneuromorphicapplications
AT bortonemassimo optimizingtheenergyconsumptionofspikingneuralnetworksforneuromorphicapplications
AT sheiksadique optimizingtheenergyconsumptionofspikingneuralnetworksforneuromorphicapplications