Information Theory

What it is about

You will learn the fundamental concepts of information theory (e.g., entropy, mutual information, divergence) and how to apply them to the analysis of data compression and channel transmission. In the end you can explain the central quantities and their properties as well as use information measures to evaluate coding and transmission systems.

What you will be able to do

Explain entropy, mutual information, information divergence
Explain essential properties such as the chain rule, bounds and convexity
Apply information theory to evaluate data compression and channel coding
Understand scientific texts on information theory

What the module consists of

VorlesungConveying the fundamental concepts of information theory, e.g., entropy, mutual information, source and channel coding
Übungen/TutorialsDiscussion and exemplary implementation of the codes from the lecture; application to systems such as wireless mobile communication

Teaching method

Exploratives Lehrformatenables the joint development of concepts with the instructor
Tutorial-Diskussionen mit Beispielen/Implementierungenillustrate the practical application and motivation of certain coding schemes

Dates

Lecture with exerciseInformation Theory2 groups to choose from

AFri11:30–14:15
N 1189, Hans-Piloty-Hörsaal (0101.02.189)
12× · 16.10.–05.02.
- 16.10.
- 23.10.
- 30.10.
- 06.11.
- 13.11.
- 20.11.
- 11.12.
- 18.12.
- 08.01.
- 22.01.
- 29.01.
- 05.02.
AFri11:30–13:45
N 1189, Hans-Piloty-Hörsaal (0101.02.189)
3× · 27.11.–15.01.
- 27.11.
- 04.12.
- 15.01.
BMon13:15–14:45
1180, Hörsaal ohne exp. Bühne (0501.01.180)
15× · 12.10.–01.02.
- 12.10.
- 19.10.
- 26.10.
- 02.11.
- 09.11.
- 16.11.
- 23.11.
- 30.11.
- 07.12.
- 14.12.
- 21.12.
- 11.01.
- 18.01.
- 25.01.
- 01.02.

From the current semester, not binding. You attend one of several groups; the timetable automatically suggests the one with the fewest clashes.

Filters