Information Theory

Ying Nian Wu

This talk reviews the basic concepts in information theory and information-theoretical principles for statistical modeling. I will first explain the concepts of entropy and Kullback-Leibler divergence. Then I will describe an information-geometrical point of view for model updating in learning.

Presentation (PowerPoint File)

Back to Graduate Summer School: Probabilistic Models of Cognition: The Mathematics of Mind