Cargando…

Neuroevolution Guided Hybrid Spiking Neural Network Training

Neuromorphic computing algorithms based on Spiking Neural Networks (SNNs) are evolving to be a disruptive technology driving machine learning research. The overarching goal of this work is to develop a structured algorithmic framework for SNN training that optimizes unique SNN-specific properties li...

Descripción completa

Detalles Bibliográficos
Autores principales: Lu, Sen, Sengupta, Abhronil
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9082355/
https://www.ncbi.nlm.nih.gov/pubmed/35546880
http://dx.doi.org/10.3389/fnins.2022.838523
_version_ 1784703186225856512
author Lu, Sen
Sengupta, Abhronil
author_facet Lu, Sen
Sengupta, Abhronil
author_sort Lu, Sen
collection PubMed
description Neuromorphic computing algorithms based on Spiking Neural Networks (SNNs) are evolving to be a disruptive technology driving machine learning research. The overarching goal of this work is to develop a structured algorithmic framework for SNN training that optimizes unique SNN-specific properties like neuron spiking threshold using neuroevolution as a feedback strategy. We provide extensive results for this hybrid bio-inspired training strategy and show that such a feedback-based learning approach leads to explainable neuromorphic systems that adapt to the specific underlying application. Our analysis reveals 53.8, 28.8, and 28.2% latency improvement for the neuroevolution-based SNN training strategy on CIFAR-10, CIFAR-100, and ImageNet datasets, respectively in contrast to state-of-the-art conversion based approaches. The proposed algorithm can be easily extended to other application domains like image classification in presence of adversarial attacks where 43.2 and 27.9% latency improvements were observed on CIFAR-10 and CIFAR-100 datasets, respectively.
format Online
Article
Text
id pubmed-9082355
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-90823552022-05-10 Neuroevolution Guided Hybrid Spiking Neural Network Training Lu, Sen Sengupta, Abhronil Front Neurosci Neuroscience Neuromorphic computing algorithms based on Spiking Neural Networks (SNNs) are evolving to be a disruptive technology driving machine learning research. The overarching goal of this work is to develop a structured algorithmic framework for SNN training that optimizes unique SNN-specific properties like neuron spiking threshold using neuroevolution as a feedback strategy. We provide extensive results for this hybrid bio-inspired training strategy and show that such a feedback-based learning approach leads to explainable neuromorphic systems that adapt to the specific underlying application. Our analysis reveals 53.8, 28.8, and 28.2% latency improvement for the neuroevolution-based SNN training strategy on CIFAR-10, CIFAR-100, and ImageNet datasets, respectively in contrast to state-of-the-art conversion based approaches. The proposed algorithm can be easily extended to other application domains like image classification in presence of adversarial attacks where 43.2 and 27.9% latency improvements were observed on CIFAR-10 and CIFAR-100 datasets, respectively. Frontiers Media S.A. 2022-04-25 /pmc/articles/PMC9082355/ /pubmed/35546880 http://dx.doi.org/10.3389/fnins.2022.838523 Text en Copyright © 2022 Lu and Sengupta. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Lu, Sen
Sengupta, Abhronil
Neuroevolution Guided Hybrid Spiking Neural Network Training
title Neuroevolution Guided Hybrid Spiking Neural Network Training
title_full Neuroevolution Guided Hybrid Spiking Neural Network Training
title_fullStr Neuroevolution Guided Hybrid Spiking Neural Network Training
title_full_unstemmed Neuroevolution Guided Hybrid Spiking Neural Network Training
title_short Neuroevolution Guided Hybrid Spiking Neural Network Training
title_sort neuroevolution guided hybrid spiking neural network training
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9082355/
https://www.ncbi.nlm.nih.gov/pubmed/35546880
http://dx.doi.org/10.3389/fnins.2022.838523
work_keys_str_mv AT lusen neuroevolutionguidedhybridspikingneuralnetworktraining
AT senguptaabhronil neuroevolutionguidedhybridspikingneuralnetworktraining