Cargando…
BSNN: Towards faster and better conversion of artificial neural networks to spiking neural networks with bistable neurons
The spiking neural network (SNN) computes and communicates information through discrete binary events. Recent work has achieved essential progress on an excellent performance by converting ANN to SNN. Due to the difference in information processing, the converted deep SNN usually suffers serious per...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9597447/ https://www.ncbi.nlm.nih.gov/pubmed/36312025 http://dx.doi.org/10.3389/fnins.2022.991851 |
_version_ | 1784816093109420032 |
---|---|
author | Li, Yang Zhao, Dongcheng Zeng, Yi |
author_facet | Li, Yang Zhao, Dongcheng Zeng, Yi |
author_sort | Li, Yang |
collection | PubMed |
description | The spiking neural network (SNN) computes and communicates information through discrete binary events. Recent work has achieved essential progress on an excellent performance by converting ANN to SNN. Due to the difference in information processing, the converted deep SNN usually suffers serious performance loss and large time delay. In this paper, we analyze the reasons for the performance loss and propose a novel bistable spiking neural network (BSNN) that addresses the problem of the phase lead and phase lag. Also, we design synchronous neurons (SN) to help efficiently improve performance when ResNet structure-based ANNs are converted. BSNN significantly improves the performance of the converted SNN by enabling more accurate delivery of information to the next layer after one cycle. Experimental results show that the proposed method only needs 1/4–1/10 of the time steps compared to previous work to achieve nearly lossless conversion. We demonstrate better ANN-SNN conversion for VGG16, ResNet20, and ResNet34 on challenging datasets including CIFAR-10 (95.16% top-1), CIFAR-100 (78.12% top-1), and ImageNet (72.64% top-1). |
format | Online Article Text |
id | pubmed-9597447 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-95974472022-10-27 BSNN: Towards faster and better conversion of artificial neural networks to spiking neural networks with bistable neurons Li, Yang Zhao, Dongcheng Zeng, Yi Front Neurosci Neuroscience The spiking neural network (SNN) computes and communicates information through discrete binary events. Recent work has achieved essential progress on an excellent performance by converting ANN to SNN. Due to the difference in information processing, the converted deep SNN usually suffers serious performance loss and large time delay. In this paper, we analyze the reasons for the performance loss and propose a novel bistable spiking neural network (BSNN) that addresses the problem of the phase lead and phase lag. Also, we design synchronous neurons (SN) to help efficiently improve performance when ResNet structure-based ANNs are converted. BSNN significantly improves the performance of the converted SNN by enabling more accurate delivery of information to the next layer after one cycle. Experimental results show that the proposed method only needs 1/4–1/10 of the time steps compared to previous work to achieve nearly lossless conversion. We demonstrate better ANN-SNN conversion for VGG16, ResNet20, and ResNet34 on challenging datasets including CIFAR-10 (95.16% top-1), CIFAR-100 (78.12% top-1), and ImageNet (72.64% top-1). Frontiers Media S.A. 2022-10-12 /pmc/articles/PMC9597447/ /pubmed/36312025 http://dx.doi.org/10.3389/fnins.2022.991851 Text en Copyright © 2022 Li, Zhao and Zeng. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Li, Yang Zhao, Dongcheng Zeng, Yi BSNN: Towards faster and better conversion of artificial neural networks to spiking neural networks with bistable neurons |
title | BSNN: Towards faster and better conversion of artificial neural networks to spiking neural networks with bistable neurons |
title_full | BSNN: Towards faster and better conversion of artificial neural networks to spiking neural networks with bistable neurons |
title_fullStr | BSNN: Towards faster and better conversion of artificial neural networks to spiking neural networks with bistable neurons |
title_full_unstemmed | BSNN: Towards faster and better conversion of artificial neural networks to spiking neural networks with bistable neurons |
title_short | BSNN: Towards faster and better conversion of artificial neural networks to spiking neural networks with bistable neurons |
title_sort | bsnn: towards faster and better conversion of artificial neural networks to spiking neural networks with bistable neurons |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9597447/ https://www.ncbi.nlm.nih.gov/pubmed/36312025 http://dx.doi.org/10.3389/fnins.2022.991851 |
work_keys_str_mv | AT liyang bsnntowardsfasterandbetterconversionofartificialneuralnetworkstospikingneuralnetworkswithbistableneurons AT zhaodongcheng bsnntowardsfasterandbetterconversionofartificialneuralnetworkstospikingneuralnetworkswithbistableneurons AT zengyi bsnntowardsfasterandbetterconversionofartificialneuralnetworkstospikingneuralnetworkswithbistableneurons |