Cargando…
Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications
In the last few years, spiking neural networks (SNNs) have been demonstrated to perform on par with regular convolutional neural networks. Several works have proposed methods to convert a pre-trained CNN to a Spiking CNN without a significant sacrifice of performance. We demonstrate first that quant...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7339957/ https://www.ncbi.nlm.nih.gov/pubmed/32694978 http://dx.doi.org/10.3389/fnins.2020.00662 |
_version_ | 1783554965392850944 |
---|---|
author | Sorbaro, Martino Liu, Qian Bortone, Massimo Sheik, Sadique |
author_facet | Sorbaro, Martino Liu, Qian Bortone, Massimo Sheik, Sadique |
author_sort | Sorbaro, Martino |
collection | PubMed |
description | In the last few years, spiking neural networks (SNNs) have been demonstrated to perform on par with regular convolutional neural networks. Several works have proposed methods to convert a pre-trained CNN to a Spiking CNN without a significant sacrifice of performance. We demonstrate first that quantization-aware training of CNNs leads to better accuracy in SNNs. One of the benefits of converting CNNs to spiking CNNs is to leverage the sparse computation of SNNs and consequently perform equivalent computation at a lower energy consumption. Here we propose an optimization strategy to train efficient spiking networks with lower energy consumption, while maintaining similar accuracy levels. We demonstrate results on the MNIST-DVS and CIFAR-10 datasets. |
format | Online Article Text |
id | pubmed-7339957 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-73399572020-07-20 Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications Sorbaro, Martino Liu, Qian Bortone, Massimo Sheik, Sadique Front Neurosci Neuroscience In the last few years, spiking neural networks (SNNs) have been demonstrated to perform on par with regular convolutional neural networks. Several works have proposed methods to convert a pre-trained CNN to a Spiking CNN without a significant sacrifice of performance. We demonstrate first that quantization-aware training of CNNs leads to better accuracy in SNNs. One of the benefits of converting CNNs to spiking CNNs is to leverage the sparse computation of SNNs and consequently perform equivalent computation at a lower energy consumption. Here we propose an optimization strategy to train efficient spiking networks with lower energy consumption, while maintaining similar accuracy levels. We demonstrate results on the MNIST-DVS and CIFAR-10 datasets. Frontiers Media S.A. 2020-06-30 /pmc/articles/PMC7339957/ /pubmed/32694978 http://dx.doi.org/10.3389/fnins.2020.00662 Text en Copyright © 2020 Sorbaro, Liu, Bortone and Sheik. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Sorbaro, Martino Liu, Qian Bortone, Massimo Sheik, Sadique Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications |
title | Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications |
title_full | Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications |
title_fullStr | Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications |
title_full_unstemmed | Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications |
title_short | Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications |
title_sort | optimizing the energy consumption of spiking neural networks for neuromorphic applications |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7339957/ https://www.ncbi.nlm.nih.gov/pubmed/32694978 http://dx.doi.org/10.3389/fnins.2020.00662 |
work_keys_str_mv | AT sorbaromartino optimizingtheenergyconsumptionofspikingneuralnetworksforneuromorphicapplications AT liuqian optimizingtheenergyconsumptionofspikingneuralnetworksforneuromorphicapplications AT bortonemassimo optimizingtheenergyconsumptionofspikingneuralnetworksforneuromorphicapplications AT sheiksadique optimizingtheenergyconsumptionofspikingneuralnetworksforneuromorphicapplications |