Cargando…

Rethinking the Role of Normalization and Residual Blocks for Spiking Neural Networks

Biologically inspired spiking neural networks (SNNs) are widely used to realize ultralow-power energy consumption. However, deep SNNs are not easy to train due to the excessive firing of spiking neurons in the hidden layers. To tackle this problem, we propose a novel but simple normalization techniq...

Descripción completa

Detalles Bibliográficos
Autores principales:	Ikegawa, Shin-ichi, Saiin, Ryuji, Sawada, Yoshihide, Natori, Naotake
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	MDPI 2022
Materias:	Article
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9028401/ https://www.ncbi.nlm.nih.gov/pubmed/35458860 http://dx.doi.org/10.3390/s22082876

Ejemplares similares

Rethinking arithmetic for deep neural networks
por: Constantinides, G. A.
Publicado: (2020)

Going Deeper in Spiking Neural Networks: VGG and Residual Architectures
por: Sengupta, Abhronil, et al.
Publicado: (2019)

Rethinking Weight Decay for Efficient Neural Network Pruning
por: Tessier, Hugo, et al.
Publicado: (2022)

Rethinking schizophrenia in the context of normal neurodevelopment
por: Catts, Vibeke S., et al.
Publicado: (2013)

Effects of Spike Anticipation on the Spiking Dynamics of Neural Networks
por: de Santos-Sierra, Daniel, et al.
Publicado: (2015)

Integrating Non-spiking Interneurons in Spiking Neural Networks
por: Strohmer, Beck, et al.
Publicado: (2021)

SpikePropamine: Differentiable Plasticity in Spiking Neural Networks
por: Schmidgall, Samuel, et al.
Publicado: (2021)

Rethinking the financial network
por: Haldane, Andrew G
Publicado: (2013)

Prediction of Acoustic Residual Inhibition of Tinnitus Using a Brain-Inspired Spiking Neural Network Model
por: Sanders, Philip J., et al.
Publicado: (2021)

Revisiting Batch Normalization for Training Low-Latency Deep Spiking Neural Networks From Scratch
por: Kim, Youngeun, et al.
Publicado: (2021)

SuperSpike: Supervised Learning in Multilayer Spiking Neural Networks
por: Zenke, Friedemann, et al.
Publicado: (2018)

Convolution neural network with batch normalization and inception-residual modules for Android malware classification
por: Liu, TianYue, et al.
Publicado: (2022)

Rethinking the Manager's Role
por: Gratton, Lynda
Publicado: (2016)

Anomaly Detection with Spiking Neural Networks
por: Borzyszkowski, Bartłomiej
Publicado: (2020)

Phase diagram of spiking neural networks
por: Seyed-allaei, Hamed
Publicado: (2015)

Spiking neural networks for computer vision
por: Hopkins, Michael, et al.
Publicado: (2018)

Symmetry perception with spiking neural networks
por: George, Jonathan K., et al.
Publicado: (2021)

The geometry of robustness in spiking neural networks
por: Calaim, Nuno, et al.
Publicado: (2022)

ReStoCNet: Residual Stochastic Binary Convolutional Spiking Neural Network for Memory-Efficient Neuromorphic Computing
por: Srinivasan, Gopalakrishnan, et al.
Publicado: (2019)

Toward Scalable, Efficient, and Accurate Deep Spiking Neural Networks With Backward Residual Connections, Stochastic Softmax, and Hybridization
por: Panda, Priyadarshini, et al.
Publicado: (2020)

Neural Networks for Modeling Neural Spiking in S1 Cortex
por: Lucas, Alice, et al.
Publicado: (2019)

A biomimetic neural encoder for spiking neural network
por: Subbulakshmi Radhakrishnan, Shiva, et al.
Publicado: (2021)

Neural encoding with unsupervised spiking convolutional neural network
por: Wang, Chong, et al.
Publicado: (2023)

SpikingLab: modelling agents controlled by Spiking Neural Networks in Netlogo
por: Jimenez-Romero, Cristian, et al.
Publicado: (2016)

Probabilistic Spike Propagation for Efficient Hardware Implementation of Spiking Neural Networks
por: Nallathambi, Abinand, et al.
Publicado: (2021)

Supervised Learning With First-to-Spike Decoding in Multilayer Spiking Neural Networks
por: Gardner, Brian, et al.
Publicado: (2021)

Network Neuroscience and the Adapted Mind: Rethinking the Role of Network Theories in Evolutionary Psychology
por: Elimari, Nassim, et al.
Publicado: (2020)

Brain-inspired neural circuit evolution for spiking neural networks
por: Shen, Guobin, et al.
Publicado: (2023)

Plasticity in memristive devices for spiking neural networks
por: Saïghi, Sylvain, et al.
Publicado: (2015)

Implementing Signature Neural Networks with Spiking Neurons
por: Carrillo-Medina, José Luis, et al.
Publicado: (2016)

Sparse Computation in Adaptive Spiking Neural Networks
por: Zambrano, Davide, et al.
Publicado: (2019)

Quantum superposition inspired spiking neural network
por: Sun, Yinqian, et al.
Publicado: (2021)

Quantization Framework for Fast Spiking Neural Networks
por: Li, Chen, et al.
Publicado: (2022)

Spiking Neural Networks and Their Applications: A Review
por: Yamazaki, Kashu, et al.
Publicado: (2022)

Implementation of Kalman Filtering with Spiking Neural Networks
por: Juárez-Lora, Alejandro, et al.
Publicado: (2022)

Trainable quantization for Speedy Spiking Neural Networks
por: Castagnetti, Andrea, et al.
Publicado: (2023)

Spiking Neural Networks for Structural Health Monitoring
por: Joseph, George Vathakkattil, et al.
Publicado: (2022)

Rethinking the role of sham TMS
por: Duecker, Felix, et al.
Publicado: (2015)

Rethinking the role of clinical imaging
por: O'Connor, James PB
Publicado: (2017)

The role of cortical oscillations in a spiking neural network model of the basal ganglia
por: Fountas, Zafeirios, et al.
Publicado: (2017)

Cannot write session to /tmp/vufind_sessions/sess_pm9km8fi9nc2r31oaarru8obmr