Relations between information theory and other fields

Information and coding theory


Louis Wehenkel
Université de Liège, Institut Montefiore

ELEN060-2


Lectures and Q&A sessions every Thursday:

1h30PM via Lifesize: Click here; Passcode: 0001011#

Documents and instructions for 2020-2021

Course description - follow this link

Information about projects and practicals: link to the web-page of A. Sutera

General infomation:

- Video lectures of David MacKay (University of Cambridge) (Video lectures web page)

- Web page of David MacKay's book on "Information Theory, Inference, and Learning Algorithms" + (Introduction and Chapter 1 of the BOOK)

- Introductory lecture (Historical perspective about Shannon's work on Information theory)

- Slides about the motivation and the organization of the course (ICT_0_organization.pdf)

NB: Further information will be made available via the eCampus platform

Guidelines to prepare upcoming Q&A sessions and Lectures:

- Q&A session on 11.02.2021: Read slides ICT_1_introduction.pdf, View video Lecture 1 of D MacKay

- Q&A session on 18.02.2021: Read slides ICT_2_algebra.pdf, View video Lecture 2 of D MacKay

- Q&A session on 25.02.2021: Read slides ICT_3_source_coding.pdf, View video Lecture 3 of D MacKay

- Q&A session on 04.03.2021: Read (again) slides ICT_3_source_coding.pdf, View video Lecture 4 of D MacKay

- Q&A session on 11.03.2021: Read slides ICT_4_data_compression.pdf, View video Lecture 5 of D MacKay

- Q&A session on 18.03.2021: Read (again) slides ICT_4_data_compression.pdf, View video Lecture 5 of D MacKay

- Q&A session on 25.03.2021: Read slides ICT_5_Channel_coding_1.pdf, View video Lecture 6 of D MacKay

- Q&A session on 01.04.2021: Read (again) slides ICT_5_Channel_coding_1.pdf, View video Lecture 7 of D MacKay

- Q&A session on 22.04.2021: Read slides ICT_5_Channel_coding_2.pdf, View video Lecture 8 of D MacKay

- ...

Video recordings of Lectures, Q&A sessions, etc.:

- Introductory session on 04.02.2021: Part 1 Lifesize part 1, Part 2 Lifesize part 2

- Q&A session on 11.02.2021: Lifesize Q&A

- Q&A session on 18.02.2021: Lifesize Q&A

- Q&A session on 25.02.2021: Lifesize Q&A

- Q&A session on 04.03.2021: Lifesize Q&A

- Q&A session on 11.03.2021: Lifesize Q&A

- Q&A session on 18.03.2021: Lifesize Q&A

- Q&A session on 25.03.2021: Lifesize Q&A

- Q&A session on 01.04.2021: Lifesize Q&A

- Q&A session on 22.04.2021: Lifesize Q&A

- Q&A session on 29.04.2021: Lifesize Q&A

- ...




Complementary information from previous years:
You can find below the original course notes in French.

.pdf with hyperlinks (10 Mbytes)

printable .ps.gz (3.6 Mbytes)
Slides from previous years:
0. Motivation/Organization 125699 bytes.

1. Measures of information and uncertainty 125699 bytes.

2. Algebra of information and entropy 114757 bytes.

3. Inference and learning 82754 bytes.

4. Probabilistic and graphical independence models 310490 bytes.

5. Source coding (theory) 92784 bytes.

6. Data compression 96561 bytes.

7. Image compression 1248655 bytes.

8. Channel coding I 86238 bytes.

9. Channel coding II 252622 bytes.

Last update: 19/05/2021