News
Topic selection reminder & Session on 5th of June cancelled.Written on 28.04.26 by Kamila Szewczyk Dear students, We would like to remind you to sign up for the topics in the spreadsheet before this Friday (1 May). Failure to do so will result in no topic being assigned to you, and thus you will not be able to participate in the seminar. We expect your presentations to be delivered in English… Read more Dear students, We would like to remind you to sign up for the topics in the spreadsheet before this Friday (1 May). Failure to do so will result in no topic being assigned to you, and thus you will not be able to participate in the seminar. We expect your presentations to be delivered in English and take at most 40-45 minutes each, with a bit over 5 minutes reserved for questions. Individual amendments and topic counselling may be done on request. For this purpose e-mail the course instructor (k [at] iczelia.net). A .zip file with your slides, problem solutions and a report should be attached on CMS by 10th of July. In light of the 4th of June (Thursday) being a holiday, we have decided to move the sessions from 5th of June forward and cancel the seminar on that day. Enjoy your long weekend :)! |
Kickoff Meeting: Friday, 17 AprilWritten on 14.04.26 by Kamila Szewczyk Dear Students, We have scheduled the kick-off meeting for Friday, 17th of April. The meeting will take place in E2.1 SR106. No preparation is necessary. We will go over the seminar modalities and a brief introduction to the topic. Please be there on time, at 12:00 (sharp!). |
Proseminar Introduction to Information Theory
In this proseminar, we will cover topics from two books on information theory and compression:
- Thomas M. Cover & Joy A. Thomas, "Elements of Information Theory".
- David J. C. MacKay, "Information Theory, Inference, and Learning Algorithms".
Registration Rules
You cannot register directly here.
If you were assigned to this proseminar via the seminar assignment system, you should have received an email with a token to register in the CMS.
List of Topics
- "AEP & typical sets" - Mohamed Khalil, Abbes, 22 May.
- "Entropy rates; Markov chains; HMMs" - Ivan Pozdin, 22 May.
- "Symbol codes: Kraft, Huffman" - Qian Liu, 29 May.
- "Arithmetic coding" - Daniel Krivcov, 29 May.
- "Universal coding; Lempel Ziv" - Ibrahim Al-helali, 12 June.
- "Statistical modelling: PPM, CTW, BWT" - Frederik Seeg, 12 June.
- "Gambling, Kelly, side information" - Denys Kudria, 19 June.
- "Information theory & the stock market" - Egor Chursinov, 19 June.
- "Shannon secrecy & the wiretap channel" - Onur Aray, 26 June.
- "Channel capacity; noisy-channel theorem" - Koorosh Sanaei, 26 June.
- "Basic noisy coding: Hamming, RM, cyclic" - Mahmoud El-Nezely, 3 July.
- "BCH, Reed/Solomon & list decoding" - Vinh Gessat, 19 July.
Workload and Grading
The workload for the proseminar [5 CP] is 150 hours over the semester, including preparation, reading, meetings, preparing a talk; providing feedback.
Further organizational information will be discussed at the kickoff meeting.