On the Information Bottleneck for Stable Variables
En palabras de los autores
We consider a generalization of the Gaussian information bottleneck problem to jointly stable variables and . Specifically, for , where is stable and independent of , we find optimal stochastic linear encoders of the form , being stable and independent of . We characterize the linear stable information bottleneck in closed-form and its critical value. Furthermore, we show that, except for the Gaussian case, such stochastic linear encoders are strictly suboptimal, however asymptotically optimal at large compression rate. Our linear solution recovers the Gaussian information bottleneck for jointly Gaussian variables.
Apareció: miércoles, 7 de octubre. arXiv. Preprint, todavía sin revisión por pares.
Comentario de los autores: 13 pages, 3 figures