Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers †

Inspired by the adaptation phenomenon of neuronal firing, we propose the regularity normalization (RN) as an unsupervised attention mechanism (UAM) which computes the statistical regularity in the implicit space of neural networks under the Minimum Description Length (MDL) principle. Treating the ne...

Descripción completa

Detalles Bibliográficos
Autor principal: Lin, Baihan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Article
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8774926/
https://www.ncbi.nlm.nih.gov/pubmed/35052085
http://dx.doi.org/10.3390/e24010059

Internet

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8774926/
https://www.ncbi.nlm.nih.gov/pubmed/35052085
http://dx.doi.org/10.3390/e24010059

Ejemplares similares