What is Shannon’s information theory (IT)? Despite its continued impact on our
digital society, Claude Shannon’s life and work is still unknown to numerous people.
In this tutorial, we review many aspects of the concept of entropy and information from
a historical and mathematical point of view. The presentation is structured into small,
mostly independent sections, each covering a particular topic. If time permits, we culminate
with a simple exposition of a recent proof (2017) of the entropy power inequality (EPI), one
of the most fascinating inequality in the theory.
Oliver Rioul (PhD, HDR) is full professor at Telecom ParisTech and Ecole Polytechnique, France. （法国巴黎电信综合理工学院）His research interests are in applied mathematics and include various, sometimes unconven tional, applications of information theory such as inequalities in statistics, hard ware security, and experimental psychology. He has been teaching information theory atvarious French universities for almost twenty years and has publicshed a textbook which has become a classical French reference in the field.