Cargando…

Biologically Plausible Training Mechanisms for Self-Supervised Learning in Deep Networks

We develop biologically plausible training mechanisms for self-supervised learning (SSL) in deep networks. Specifically, by biologically plausible training we mean (i) all updates of weights are based on current activities of pre-synaptic units and current, or activity retrieved from short term memo...

Descripción completa

Detalles Bibliográficos
Autores principales:	Tang, Mufeng, Yang, Yibo, Amit, Yali
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	Frontiers Media S.A. 2022
Materias:	Neuroscience
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8977509/ https://www.ncbi.nlm.nih.gov/pubmed/35386856 http://dx.doi.org/10.3389/fncom.2022.789253

Ejemplares similares

Biologically plausible local synaptic learning rules robustly implement deep supervised learning
por: Konishi, Masataka, et al.
Publicado: (2023)

A biologically plausible learning rule for the Infomax on recurrent neural networks
por: Hayakawa, Takashi, et al.
Publicado: (2014)

MAP-SNN: Mapping spike activities with multiplicity, adaptability, and plasticity into bio-plausible spiking neural networks
por: Yu, Chengting, et al.
Publicado: (2022)

Biologically Plausible Class Discrimination Based Recurrent Neural Network Training for Motor Pattern Generation
por: Wijesinghe, Parami, et al.
Publicado: (2020)

Backpropagation with biologically plausible spatiotemporal adjustment for training deep spiking neural networks
por: Shen, Guobin, et al.
Publicado: (2022)

Generative Adversarial Training for Supervised and Semi-supervised Learning
por: Wang, Xianmin, et al.
Publicado: (2022)

Unsupervised Few-Shot Feature Learning via Self-Supervised Training
por: Ji, Zilong, et al.
Publicado: (2020)

A Biologically Plausible Architecture of the Striatum to Solve Context-Dependent Reinforcement Learning Tasks
por: Shivkumar, Sabyasachi, et al.
Publicado: (2017)

A biologically plausible embodied model of action discovery
por: Bolado-Gomez, Rufino, et al.
Publicado: (2013)

Deep Supervised Learning Using Local Errors
por: Mostafa, Hesham, et al.
Publicado: (2018)

Training Deep Spiking Convolutional Neural Networks With STDP-Based Unsupervised Pre-training Followed by Supervised Fine-Tuning
por: Lee, Chankyu, et al.
Publicado: (2018)

Distinctive properties of biological neural networks and recent advances in bottom-up approaches toward a better biologically plausible neural network
por: Jeon, Ikhwan, et al.
Publicado: (2023)

Deep Learning With Asymmetric Connections and Hebbian Updates
por: Amit, Yali
Publicado: (2019)

Design of a Neurally Plausible Model of Fear Learning
por: Krasne, Franklin B., et al.
Publicado: (2011)

Graph-Based Self-Training for Semi-Supervised Deep Similarity Learning
por: Wang, Yifan, et al.
Publicado: (2023)

Digital Biologically Plausible Implementation of Binarized Neural Networks With Differential Hafnium Oxide Resistive Memory Arrays
por: Hirtzlin, Tifenn, et al.
Publicado: (2020)

Editorial: Weakly supervised deep learning-based methods for brain image analysis
por: Zhu, Hancan, et al.
Publicado: (2022)

Biological plausibility of kernel-based learning
por: Fortney, Kristen, et al.
Publicado: (2007)

Deep Feature Extraction for Resting-State Functional MRI by Self-Supervised Learning and Application to Schizophrenia Diagnosis
por: Hashimoto, Yuki, et al.
Publicado: (2021)

Plausible neural networks for biological modelling
por: Mastebroek, Henk, et al.
Publicado: (2001)

Editorial: Emerging Technologies and Systems for Biologically Plausible Implementations of Neural Functions
por: Covi, Erika, et al.
Publicado: (2022)

Self-supervised learning for modal transfer of brain imaging
por: Cheng, Dapeng, et al.
Publicado: (2022)

A Validation of Supervised Deep Learning for Gait Analysis in the Cat
por: Lecomte, Charly G., et al.
Publicado: (2021)

A biologically plausible mechanism for neuronal coding organized by the phase of alpha oscillations
por: Gips, Bart, et al.
Publicado: (2016)

A self-supervised deep learning method for data-efficient training in genomics
por: Gündüz, Hüseyin Anil, et al.
Publicado: (2023)

A Biologically Plausible Transform for Visual Recognition that is Invariant to Translation, Scale, and Rotation
por: Sountsov, Pavel, et al.
Publicado: (2011)

Sub-Optimality of the Early Visual System Explained Through Biologically Plausible Plasticity
por: Chauhan, Tushar, et al.
Publicado: (2021)

Biologically plausible reinforcement learning of continuous actions
por: Rombouts, Jaldert O, et al.
Publicado: (2013)

PSNSleep: a self-supervised learning method for sleep staging based on Siamese networks with only positive sample pairs
por: You, Yuyang, et al.
Publicado: (2023)

Training biologically plausible recurrent neural networks on cognitive tasks with long-term dependencies
por: Soo, Wayne W.M., et al.
Publicado: (2023)

Temporal sequence learning via adaptation in biologically plausible spiking neural networks
por: Duarte, Renato, et al.
Publicado: (2014)

SSTDP: Supervised Spike Timing Dependent Plasticity for Efficient Spiking Neural Network Training
por: Liu, Fangxin, et al.
Publicado: (2021)

Comparison Between Human and Rodent Neurons for Persistent Activity Performance: A Biologically Plausible Computational Investigation
por: Zhang, Qian, et al.
Publicado: (2021)

Levels of biological plausibility
por: Love, Bradley C.
Publicado: (2021)

Self-supervised graph neural network with pre-training generative learning for recommendation systems
por: Min, Xin, et al.
Publicado: (2022)

Toward a Biologically Plausible Model of LGN-V1 Pathways Based on Efficient Coding
por: Lian, Yanbo, et al.
Publicado: (2019)

Complex Learning in Bio-plausible Memristive Networks
por: Deng, Lei, et al.
Publicado: (2015)

Degeneracy measures in biologically plausible random Boolean networks
por: Kocaoglu, Basak, et al.
Publicado: (2022)

A Metric for Evaluating Neural Input Representation in Supervised Learning Networks
por: Carrillo, Richard R., et al.
Publicado: (2018)

First Error-Based Supervised Learning Algorithm for Spiking Neural Networks
por: Luo, Xiaoling, et al.
Publicado: (2019)

Cannot write session to /tmp/vufind_sessions/sess_mac0774gik82ekalc75ovkr5gi