Cargando…
Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers †
Inspired by the adaptation phenomenon of neuronal firing, we propose the regularity normalization (RN) as an unsupervised attention mechanism (UAM) which computes the statistical regularity in the implicit space of neural networks under the Minimum Description Length (MDL) principle. Treating the ne...
| Autor principal: | |
|---|---|
| Formato: | Online Artículo Texto |
| Lenguaje: | English |
| Publicado: |
MDPI
2021
|
| Materias: | |
| Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8774926/ https://www.ncbi.nlm.nih.gov/pubmed/35052085 http://dx.doi.org/10.3390/e24010059 |