Cargando…
A novel approach to attention mechanism using kernel functions: Kerformer
Artificial Intelligence (AI) is driving advancements across various fields by simulating and enhancing human intelligence. In Natural Language Processing (NLP), transformer models like the Kerformer, a linear transformer based on a kernel approach, have garnered success. However, traditional attenti...
| Autores principales: | , , , |
|---|---|
| Formato: | Online Artículo Texto |
| Lenguaje: | English |
| Publicado: |
Frontiers Media S.A.
2023
|
| Materias: | |
| Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10483395/ https://www.ncbi.nlm.nih.gov/pubmed/37692884 http://dx.doi.org/10.3389/fnbot.2023.1214203 |