Cargando…
Neuroevolution Guided Hybrid Spiking Neural Network Training
Neuromorphic computing algorithms based on Spiking Neural Networks (SNNs) are evolving to be a disruptive technology driving machine learning research. The overarching goal of this work is to develop a structured algorithmic framework for SNN training that optimizes unique SNN-specific properties li...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9082355/ https://www.ncbi.nlm.nih.gov/pubmed/35546880 http://dx.doi.org/10.3389/fnins.2022.838523 |
_version_ | 1784703186225856512 |
---|---|
author | Lu, Sen Sengupta, Abhronil |
author_facet | Lu, Sen Sengupta, Abhronil |
author_sort | Lu, Sen |
collection | PubMed |
description | Neuromorphic computing algorithms based on Spiking Neural Networks (SNNs) are evolving to be a disruptive technology driving machine learning research. The overarching goal of this work is to develop a structured algorithmic framework for SNN training that optimizes unique SNN-specific properties like neuron spiking threshold using neuroevolution as a feedback strategy. We provide extensive results for this hybrid bio-inspired training strategy and show that such a feedback-based learning approach leads to explainable neuromorphic systems that adapt to the specific underlying application. Our analysis reveals 53.8, 28.8, and 28.2% latency improvement for the neuroevolution-based SNN training strategy on CIFAR-10, CIFAR-100, and ImageNet datasets, respectively in contrast to state-of-the-art conversion based approaches. The proposed algorithm can be easily extended to other application domains like image classification in presence of adversarial attacks where 43.2 and 27.9% latency improvements were observed on CIFAR-10 and CIFAR-100 datasets, respectively. |
format | Online Article Text |
id | pubmed-9082355 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-90823552022-05-10 Neuroevolution Guided Hybrid Spiking Neural Network Training Lu, Sen Sengupta, Abhronil Front Neurosci Neuroscience Neuromorphic computing algorithms based on Spiking Neural Networks (SNNs) are evolving to be a disruptive technology driving machine learning research. The overarching goal of this work is to develop a structured algorithmic framework for SNN training that optimizes unique SNN-specific properties like neuron spiking threshold using neuroevolution as a feedback strategy. We provide extensive results for this hybrid bio-inspired training strategy and show that such a feedback-based learning approach leads to explainable neuromorphic systems that adapt to the specific underlying application. Our analysis reveals 53.8, 28.8, and 28.2% latency improvement for the neuroevolution-based SNN training strategy on CIFAR-10, CIFAR-100, and ImageNet datasets, respectively in contrast to state-of-the-art conversion based approaches. The proposed algorithm can be easily extended to other application domains like image classification in presence of adversarial attacks where 43.2 and 27.9% latency improvements were observed on CIFAR-10 and CIFAR-100 datasets, respectively. Frontiers Media S.A. 2022-04-25 /pmc/articles/PMC9082355/ /pubmed/35546880 http://dx.doi.org/10.3389/fnins.2022.838523 Text en Copyright © 2022 Lu and Sengupta. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Lu, Sen Sengupta, Abhronil Neuroevolution Guided Hybrid Spiking Neural Network Training |
title | Neuroevolution Guided Hybrid Spiking Neural Network Training |
title_full | Neuroevolution Guided Hybrid Spiking Neural Network Training |
title_fullStr | Neuroevolution Guided Hybrid Spiking Neural Network Training |
title_full_unstemmed | Neuroevolution Guided Hybrid Spiking Neural Network Training |
title_short | Neuroevolution Guided Hybrid Spiking Neural Network Training |
title_sort | neuroevolution guided hybrid spiking neural network training |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9082355/ https://www.ncbi.nlm.nih.gov/pubmed/35546880 http://dx.doi.org/10.3389/fnins.2022.838523 |
work_keys_str_mv | AT lusen neuroevolutionguidedhybridspikingneuralnetworktraining AT senguptaabhronil neuroevolutionguidedhybridspikingneuralnetworktraining |