Relations between information theory and other fields

Information and coding theory


Louis Wehenkel
Université de Liège, Institut Montefiore

ELEN060-2


Lectures and Q&A sessions every Thursday:

1h30PM, Room R3, B28

Documents and instructions for 2022-2023

Course description - follow this link

Information about projects and practicals: link to the web-page of A. Cioppa

General infomation:

- Video lectures of David MacKay (University of Cambridge) (Video lectures web page)

- Web page of David MacKay's book on "Information Theory, Inference, and Learning Algorithms" + (Introduction and Chapter 1 of the BOOK)

- Introductory lecture (Historical perspective about Shannon's work on Information theory)

- Slides about the motivation and the organization of the course (ICT_0_organization.pdf)

NB: Further information will be made available via the eCampus platform

Guidelines to prepare upcoming Lectures:

- Chat with ChatGPT: Chat-about-IT.pdf

- Lecture on 09.02.2023: Read slides ICT_1_introduction.pdf, View video Lecture 1 of D MacKay

- Lecture on 16.02.2023: Read slides ICT_2_algebra.pdf, View video Lecture 2 of D MacKay

- Lecture on 23.02.2023: Read slides ICT_3_source_coding.pdf, View video Lecture 3 of D MacKay

- Lecture on 02.03.2023: Read (again) slides ICT_3_source_coding.pdf, View video Lecture 4 of D MacKay

- Lecture on 09.03.2023: Read slides ICT_4_data_compression.pdf, View video Lecture 5 of D MacKay

- Lecture on 16.03.2023: Read (again) slides ICT_4_data_compression.pdf, View video Lecture 5 of D MacKay

- Lecture on 23.03.2023: Read slides ICT_5_Channel_coding_1.pdf, View video Lecture 6 of D MacKay

- Lecture on 30.03.2023: Read (again) slides ICT_5_Channel_coding_1.pdf, View video Lecture 7 of D MacKay

- Lecture on 27.04.2023: Read slides ICT_5_Channel_coding_2.pdf, View video Lecture 8 of D MacKay

- ...

Frome previous year (2020-21) Video recordings of Lectures, Q&A sessions, etc.:

- Introductory session on 04.02.2021: Part 1 Lifesize part 1, Part 2 Lifesize part 2

- Q&A session on 11.02.2021: Lifesize Q&A

- Q&A session on 18.02.2021: Lifesize Q&A

- Q&A session on 25.02.2021: Lifesize Q&A

- Q&A session on 04.03.2021: Lifesize Q&A

- Q&A session on 11.03.2021: Lifesize Q&A

- Q&A session on 18.03.2021: Lifesize Q&A

- Q&A session on 25.03.2021: Lifesize Q&A

- Q&A session on 01.04.2021: Lifesize Q&A

- Q&A session on 22.04.2021: Lifesize Q&A

- Q&A session on 29.04.2021: Lifesize Q&A

- ...


Complementary information from previous years:
You can find below the original course notes in French.

.pdf with hyperlinks (10 Mbytes)

printable .ps.gz (3.6 Mbytes)
Slides from previous years:
0. Motivation/Organization 125699 bytes.

1. Measures of information and uncertainty 125699 bytes.

2. Algebra of information and entropy 114757 bytes.

3. Inference and learning 82754 bytes.

4. Probabilistic and graphical independence models 310490 bytes.

5. Source coding (theory) 92784 bytes.

6. Data compression 96561 bytes.

7. Image compression 1248655 bytes.

8. Channel coding I 86238 bytes.

9. Channel coding II 252622 bytes.
Last update: 09/02/2023