Shallow Univariate ReLU Networks as Splines: Initialization, Loss Surface, Hessian, and Gradient Flow Dynamics

Understanding the learning dynamics and inductive bias of neural networks (NNs) is hindered by the opacity of the relationship between NN parameters and the function represented. Partially, this is due to symmetries inherent within the NN parameterization, allowing multiple different parameter setti...

Descripción completa

Detalles Bibliográficos
Autores principales: Sahs, Justin, Pyle, Ryan, Damaraju, Aneel, Caro, Josue Ortega, Tavaslioglu, Onur, Lu, Andy, Anselmi, Fabio, Patel, Ankit B.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Artificial Intelligence
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9131019/
https://www.ncbi.nlm.nih.gov/pubmed/35647529
http://dx.doi.org/10.3389/frai.2022.889981

Internet

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9131019/
https://www.ncbi.nlm.nih.gov/pubmed/35647529
http://dx.doi.org/10.3389/frai.2022.889981

Ejemplares similares