Allerton 2015 Paper Abstract

Close

Paper ThB2.6

Chan, Chung (The Chinese University of Hong Kong), Liu, Tie (Texas A&M University)

Clustering by Multivariate Mutual Information under Chow–Liu Tree Approximation

Scheduled for presentation during the Invited Session "Information Theory and Applications" (ThB2), Thursday, October 1, 2015, 12:10−12:30, Solarium

53rd Annual Allerton Conference on Communication, Control, and Computing, Sept 29-Oct 2, 2015, Allerton Park and Retreat Center, Monticello, IL, USA

This information is tentative and subject to change. Compiled on November 19, 2019

Keywords Information Theory, Machine Learning and Approximate Dynamic Programming

Abstract

This paper considers two mutual-information based approaches for clustering random variables proposed in the literature: clustering by mutual information relevance networks (MIRNs) and clustering by multivariate mutual information (MMI). Despite being two seemingly very different approaches, the derived clustering solutions share very strong structural similarity. Motivated by this curious fact, in this paper we show that there is a precise connection between these two clustering solutions via the celebrated Chow-Liu tree algorithm in machine learning: Under a Chow-Liu tree approximation to the underlying joint distribution, the clustering solutions provided by MIRNs and by MMI are, in fact, identical. This solidifies the heuristic view of clustering by MMI as a natural generalization of clustering by MIRNs from dependency-tree distributions to general joint distributions.

 

 

All Content © PaperCept, Inc..


This site is protected by copyright and trademark laws under US and International law.
All rights reserved. © 2002-2019 PaperCept, Inc.
Page generated 2019-11-19  13:14:47 PST  Terms of use