Cargando…
A Comparison of Variational Bounds for the Information Bottleneck Functional
In this short note, we relate the variational bounds proposed in Alemi et al. (2017) and Fischer (2020) for the information bottleneck (IB) and the conditional entropy bottleneck (CEB) functional, respectively. Although the two functionals were shown to be equivalent, it was empirically observed tha...
Autores principales: | Geiger, Bernhard C., Fischer, Ian S. |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7712881/ https://www.ncbi.nlm.nih.gov/pubmed/33286997 http://dx.doi.org/10.3390/e22111229 |
Ejemplares similares
-
Information Bottleneck: Theory and Applications in Deep Learning
por: Geiger, Bernhard C., et al.
Publicado: (2020) -
Information Bottleneck Analysis by a Conditional Mutual Information Bound
por: Tezuka, Taro, et al.
Publicado: (2021) -
Learnability for the Information Bottleneck
por: Wu, Tailin, et al.
Publicado: (2019) -
Variational Information Bottleneck for Semi-Supervised Classification
por: Voloshynovskiy, Slava, et al.
Publicado: (2020) -
On the Difference between the Information Bottleneck and the Deep Information Bottleneck
por: Wieczorek, Aleksander, et al.
Publicado: (2020)