Cargando…

Population Risk Improvement with Model Compression: An Information-Theoretic Approach †

It has been reported in many recent works on deep model compression that the population risk of a compressed model can be even better than that of the original model. In this paper, an information-theoretic explanation for this population risk improvement phenomenon is provided by jointly studying t...

Descripción completa

Detalles Bibliográficos
Autores principales: Bu, Yuheng, Gao, Weihao, Zou, Shaofeng, Veeravalli, Venugopal V.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8534708/
https://www.ncbi.nlm.nih.gov/pubmed/34681979
http://dx.doi.org/10.3390/e23101255