Cargando…

Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing Its Gradient Estimator Bias

Equilibrium Propagation is a biologically-inspired algorithm that trains convergent recurrent neural networks with a local learning rule. This approach constitutes a major lead to allow learning-capable neuromophic systems and comes with strong theoretical guarantees. Equilibrium propagation operate...

Descripción completa

Detalles Bibliográficos
Autores principales:	Laborieux, Axel, Ernoult, Maxence, Scellier, Benjamin, Bengio, Yoshua, Grollier, Julie, Querlioz, Damien
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	Frontiers Media S.A. 2021
Materias:	Neuroscience
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7930909/ https://www.ncbi.nlm.nih.gov/pubmed/33679315 http://dx.doi.org/10.3389/fnins.2021.633674

Ejemplares similares

Equilibrium Propagation: Bridging the Gap between Energy-Based Models and Backpropagation
por: Scellier, Benjamin, et al.
Publicado: (2017)

EqSpike: spike-driven equilibrium propagation for neuromorphic implementations
por: Martin, Erwann, et al.
Publicado: (2021)

Incep-EEGNet: A ConvNet for Motor Imagery Decoding
por: Riyad, Mouad, et al.
Publicado: (2020)

PCA driven mixed filter pruning for efficient convNets
por: Ahmed, Waqas, et al.
Publicado: (2022)

Synaptic metaplasticity in binarized neural networks
por: Laborieux, Axel, et al.
Publicado: (2021)

Using Memristors for Robust Local Learning of Hardware Restricted Boltzmann Machines
por: Ernoult, Maxence, et al.
Publicado: (2019)

ConvNet and LSH-Based Visual Localization Using Localized Sequence Matching †
por: Qiao, Yongliang, et al.
Publicado: (2019)

Enhancement of Patient Facial Recognition through Deep Learning Algorithm: ConvNet
por: Onyema, Edeh Michael, et al.
Publicado: (2021)

RAPA-ConvNets: Modified Convolutional Networks for Accelerated Training on Architectures With Analog Arrays
por: Rasch, Malte J., et al.
Publicado: (2019)

Deep ConvNet: Non-Random Weight Initialization for Repeatable Determinism, Examined with FSGM †
por: Rudd-Orthner, Richard N. M., et al.
Publicado: (2021)

Evolutionary neural architecture search combining multi-branch ConvNet and improved transformer
por: Xu, Yang, et al.
Publicado: (2023)

Video action recognition collaborative learning with dynamics via PSO-ConvNet Transformer
por: Nguyen, Huu Phong, et al.
Publicado: (2023)

Four-layer ConvNet to facial emotion recognition with minimal epochs and the significance of data diversity
por: Debnath, Tanoy, et al.
Publicado: (2022)

COVID-ConvNet: A Convolutional Neural Network Classifier for Diagnosing COVID-19 Infection
por: Alablani, Ibtihal A. L., et al.
Publicado: (2023)

Visual Localizer: Outdoor Localization Based on ConvNet Descriptor and Global Optimization for Visually Impaired Pedestrians
por: Lin, Shufei, et al.
Publicado: (2018)

Catheter localization in 3D ultrasound using voxel-of-interest-based ConvNets for cardiac intervention
por: Yang, Hongxu, et al.
Publicado: (2019)

HCTNet: A Hybrid ConvNet-Transformer Network for Retinal Optical Coherence Tomography Image Classification
por: Ma, Zongqing, et al.
Publicado: (2022)

MAE-TransRNet: An improved transformer-ConvNet architecture with masked autoencoder for cardiac MRI registration
por: Xiao, Xin, et al.
Publicado: (2023)

Spiking CMOS-NVM mixed-signal neuromorphic ConvNet with circuit- and training-optimized temporal subsampling
por: Dorzhigulov, Anuar, et al.
Publicado: (2023)

A Configurable Event-Driven Convolutional Node with Rate Saturation Mechanism for Modular ConvNet Systems Implementation
por: Camuñas-Mesa, Luis A., et al.
Publicado: (2018)

GR-ConvNet v2: A Real-Time Multi-Grasp Detection Network for Robotic Grasping †
por: Kumra, Sulabh, et al.
Publicado: (2022)

Cervical cancer detection in pap smear whole slide images using convNet with transfer learning and progressive resizing
por: Bhatt, Anant R., et al.
Publicado: (2021)

Efficient facial representations for age, gender and identity recognition in organizing photo albums using multi-output ConvNet
por: Savchenko, Andrey V.
Publicado: (2019)

Comparison between Frame-Constrained Fix-Pixel-Value and Frame-Free Spiking-Dynamic-Pixel ConvNets for Visual Processing
por: Farabet, Clément, et al.
Publicado: (2012)

Supplemental Boosting and Cascaded ConvNet Based Transfer Learning Structure for Fast Traffic Sign Detection in Unknown Application Scenes
por: Liu, Chunsheng, et al.
Publicado: (2018)

Res-SE-ConvNet: A Deep Neural Network for Hypoxemia Severity Prediction for Hospital In-Patients Using Photoplethysmograph Signal
Publicado: (2022)

MirLocPredictor: A ConvNet-Based Multi-Label MicroRNA Subcellular Localization Predictor by Incorporating k-Mer Positional Information
por: Asim, Muhammad Nabeel, et al.
Publicado: (2020)

Fusing compressed deep ConvNets with a self-normalizing residual block and alpha dropout for a cost-efficient classification and diagnosis of gastrointestinal tract diseases
por: Montalbo, Francis Jesmar P.
Publicado: (2022)

Binding events through the mutual synchronization of spintronic nano-neurons
por: Romera, Miguel, et al.
Publicado: (2022)

A Nanotechnology-Ready Computing Scheme based on a Weakly Coupled Oscillator Network
por: Vodenicarevic, Damir, et al.
Publicado: (2017)

PyConvU-Net: a lightweight and multiscale network for biomedical image segmentation
por: Li, Changyong, et al.
Publicado: (2021)

Prediction of Pollutant Concentration Based on Spatial–Temporal Attention, ResNet and ConvLSTM
por: Chen, Cai, et al.
Publicado: (2023)

An imConvNet-based deep learning model for Chinese medical named entity recognition
por: Zheng, Yuchen, et al.
Publicado: (2022)

Deep learning
por: Goodfellow, Ian, et al.
Publicado: (2016)

A Dual Neural Architecture Combined SqueezeNet with OctConv for LiDAR Data Classification
por: Wang, Aili, et al.
Publicado: (2019)

BCR-UNet: Bi-directional ConvLSTM residual U-Net for retinal blood vessel segmentation
por: Yi, Yugen, et al.
Publicado: (2022)

Conv-CapsNet: capsule based network for COVID-19 detection through X-Ray scans
por: Sharma, Pulkit, et al.
Publicado: (2023)

Neural-like computing with populations of superparamagnetic basis functions
por: Mizrahi, Alice, et al.
Publicado: (2018)

A novel residual block: replace Conv1× 1 with Conv3×3 and stack more convolutions
por: Hu, XiuJian, et al.
Publicado: (2023)

Signal Propagation in Proteins and Relation to Equilibrium Fluctuations
por: Chennubhotla, Chakra, et al.
Publicado: (2007)

Cannot write session to /tmp/vufind_sessions/sess_camf80laef0gqmlrc66pfu37dk