Information Theory

This short course on information theory will introduce fundamental concepts such as entropy, information, sufficiency, typicality, concentration and will present a range of topics from data coding, statistics, inference, decision-making and learning that relate in interesting ways to information theory.