Cargando…

Shaping the learning landscape in neural networks around wide flat minima

Learning in deep neural networks takes place by minimizing a nonconvex high-dimensional loss function, typically by a stochastic gradient descent (SGD) strategy. The learning process is observed to be able to find good minimizers without getting stuck in local critical points and such minimizers are...

Descripción completa

Detalles Bibliográficos
Autores principales: Baldassi, Carlo, Pittorino, Fabrizio, Zecchina, Riccardo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: National Academy of Sciences 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6955380/
https://www.ncbi.nlm.nih.gov/pubmed/31871189
http://dx.doi.org/10.1073/pnas.1908636117