Relations between information theory and other fields

Information and coding theory


Louis Wehenkel
Université de Liège, Institut Montefiore

ELEN060-2


Lectures and Q&A sessions on Thursday PM:

1h30PM, Room R7, B28

Documents and instructions for 2024-2025

Course description - follow this link

Information about projects and practicals: link to the web-page of A. Cioppa

General infomation:

- Video lectures of David MacKay (University of Cambridge) (Video lectures web page)

- Web page of David MacKay's book on "Information Theory, Inference, and Learning Algorithms" + (Introduction and Chapter 1 of the BOOK)

- Introductory lecture (Historical perspective about Shannon's work on Information theory)

- PDF about the organization of the course in 2024-25 (Lecture-schedule-2025.pdf)


Guidelines to prepare upcoming Lectures:

- Chat with ChatGPT: Chat-about-IT.pdf

- Lecture on 06.02.2025: Read slides ICT_1_introduction.pdf, View video Lecture 1 of D MacKay

- Lecture on 13.02.2025: Read slides ICT_2_algebra.pdf, View video Lecture 2 of D MacKay

- Lecture on 20.02.2025: Read slides ICT_3_source_coding.pdf, View video Lecture 3 of D MacKay

- Written test on 27.02.2025 (no Lecture): Revise Part 1 (ICT1, ICT2) slides and exercises

- Lecture on 06.03.2025: Read (again) slides ICT_3_source_coding.pdf, View video Lecture 4 of D MacKay

- Lecture on 13.03.2025: Read slides ICT_4_data_compression.pdf, View video Lecture 5 of D MacKay

- Lecture on 20.03.2025: Read (again) slides ICT_4_data_compression.pdf, View video Lecture 5 of D MacKay

- Lecture on 27.03.2025: Read slides ICT_5_Channel_coding_1.pdf, View video Lecture 6 of D MacKay

- Lecture on 03.04.2025: Read (again) slides ICT_5_Channel_coding_1.pdf, View video Lecture 7 of D MacKay

- Lecture on 10.04.2025: Read slides ICT_5_Channel_coding_2.pdf, View video Lecture 8 of D MacKay

- ...

Frome previous year (2020-21) Video recordings of Lectures, Q&A sessions, etc.:

- Introductory session on 04.02.2021: Part 1 Lifesize part 1, Part 2 Lifesize part 2

- Q&A session on 11.02.2021: Lifesize Q&A

- Q&A session on 18.02.2021: Lifesize Q&A

- Q&A session on 25.02.2021: Lifesize Q&A

- Q&A session on 04.03.2021: Lifesize Q&A

- Q&A session on 11.03.2021: Lifesize Q&A

- Q&A session on 18.03.2021: Lifesize Q&A

- Q&A session on 25.03.2021: Lifesize Q&A

- Q&A session on 01.04.2021: Lifesize Q&A

- Q&A session on 22.04.2021: Lifesize Q&A

- Q&A session on 29.04.2021: Lifesize Q&A

- ...


Complementary information from previous years:
You can find below the original course notes in French.

.pdf with hyperlinks (10 Mbytes)

printable .ps.gz (3.6 Mbytes)
Slides from previous years:
0. Motivation/Organization 125699 bytes.

1. Measures of information and uncertainty 125699 bytes.

2. Algebra of information and entropy 114757 bytes.

3. Inference and learning 82754 bytes.

4. Probabilistic and graphical independence models 310490 bytes.

5. Source coding (theory) 92784 bytes.

6. Data compression 96561 bytes.

7. Image compression 1248655 bytes.

8. Channel coding I 86238 bytes.

9. Channel coding II 252622 bytes.
Last update: 22/02/2025