Overview and Investigation of Algorithms for the Information Bottleneck Method

Authors: S. Hassanpour, D. W├╝bben, A. Dekorsy

Lossy data compression has been studied under the celebrated Rate-Distortion theory which provides the compression rate in order to quantize a signal without exceeding a given distortion measure. Recently, with information bottleneck an alternative approach has been emerged in the field of machine learning. The fundamental idea is to include the original source into the problem setup when quantizing an observation variable and to use strictly information theoretic measures to design the quantizer. This paper yields an insight to this framework, discusses corresponding algorithms and their performance, and provides a new algorithmic approach of low complexity.

Document type: Conference Paper
Publication: Hamburg, Germany, 6. - 9. February 2017
Conference: 11th Int. ITG Conference on Systems, Communications and Coding (SCC 2017)
SCC_2017_Hassanpour.pdf179 KB
Last change on 20.11.2020 by S. Hassanpour
AIT ieee GOC tzi ith Fachbereich 1
© Department of Communications Engineering - University of BremenImprint / Contact