Allerton 2015 Paper Abstract


Paper ThD6.1

Makur, Anuran (Massachusetts Institute of Technology), Zheng, Lizhong (Massachusetts Institute of Technology)

Bounds between Contraction Coefficients

Scheduled for presentation during the Regular Session "Information Theory IV" (ThD6), Thursday, October 1, 2015, 15:30−15:50, Vistior Center

53rd Annual Allerton Conference on Communication, Control, and Computing, Sept 29-Oct 2, 2015, Allerton Park and Retreat Center, Monticello, IL, USA

This information is tentative and subject to change. Compiled on December 5, 2021

Keywords Information Theory, Statistical Signal Processing


In this paper, we delineate how the contraction coefficient of the strong data processing inequality for KL divergence can be used to learn likelihood models. We then present an alternative formulation that forces the input KL divergence to vanish, and achieves a contraction coefficient equivalent to the squared maximal correlation using a linear algebraic solution. To analyze the performance loss in using this simple but suboptimal procedure, we bound these coefficients in the discrete and finite regime, and prove their equivalence in the Gaussian regime.



All Content © PaperCept, Inc..

This site is protected by copyright and trademark laws under US and International law.
All rights reserved. © 2002-2021 PaperCept, Inc.
Page generated 2021-12-05  08:21:30 PST  Terms of use