This talk reviews the basic concepts in information theory and information-theoretical principles for statistical modeling. I will first explain the concepts of entropy and Kullback-Leibler divergence. Then I will describe an information-geometrical point of view for model updating in learning.
Presentation (PowerPoint File)
Copyright. All Rights Reserved.