Information and coding theory
Louis Wehenkel
Université de Liège, Institut Montefiore
ELEN060-2
Lectures and Q&A sessions on Thursday PM:
1h30PM, Room R7, B28
Documents and instructions for 2023-2024
Course description -
follow this link
Information about projects and practicals:
link to the web-page of A. Cioppa
General infomation:
- Video lectures of David MacKay (University of Cambridge)
(Video lectures web page)
- Web page of
David MacKay's book on "Information Theory, Inference, and Learning Algorithms"
+
(Introduction and Chapter 1 of the BOOK)
- Introductory lecture
(Historical perspective about Shannon's work on Information theory)
- PDF about the organization of the course in 2023-24
(Lecture-schedule-2024.pdf)
Guidelines to prepare upcoming Lectures:
- Chat with ChatGPT:
Chat-about-IT.pdf
- Lecture on 08.02.2024: Read slides
ICT_1_introduction.pdf
, View video
Lecture 1 of D MacKay
- Lecture on 15.02.2024: Read slides
ICT_2_algebra.pdf
, View video
Lecture 2 of D MacKay
- Lecture on 22.02.2024: Read slides
ICT_3_source_coding.pdf
, View video
Lecture 3 of D MacKay
-
Written test on 29.02.2024 (no Lecture): Revise Part 1 (ICT1, ICT2) slides and exercises
- Lecture on 07.03.2024: Read (again) slides
ICT_3_source_coding.pdf
, View video
Lecture 4 of D MacKay
- Lecture on 14.03.2024: Read slides
ICT_4_data_compression.pdf
, View video
Lecture 5 of D MacKay
- Lecture on 21.03.2024: Read (again) slides
ICT_4_data_compression.pdf
, View video
Lecture 5 of D MacKay
- Lecture on 28.03.2024: Read slides
ICT_5_Channel_coding_1.pdf
, View video
Lecture 6 of D MacKay
- Lecture on 04.04.2024: Read (again) slides
ICT_5_Channel_coding_1.pdf
, View video
Lecture 7 of D MacKay
- Lecture on 11.04.2024: Read slides
ICT_5_Channel_coding_2.pdf
, View video
Lecture 8 of D MacKay
- ...
Frome previous year (2020-21) Video recordings of Lectures, Q&A sessions, etc.:
- Introductory session on 04.02.2021: Part 1
Lifesize part 1
, Part 2
Lifesize part 2
- Q&A session on 11.02.2021:
Lifesize Q&A
- Q&A session on 18.02.2021:
Lifesize Q&A
- Q&A session on 25.02.2021:
Lifesize Q&A
- Q&A session on 04.03.2021:
Lifesize Q&A
- Q&A session on 11.03.2021:
Lifesize Q&A
- Q&A session on 18.03.2021:
Lifesize Q&A
- Q&A session on 25.03.2021:
Lifesize Q&A
- Q&A session on 01.04.2021:
Lifesize Q&A
- Q&A session on 22.04.2021:
Lifesize Q&A
- Q&A session on 29.04.2021:
Lifesize Q&A
- ...
Complementary information from previous years:
You can find below the original course notes in French.
.pdf with hyperlinks
(10 Mbytes)
printable .ps.gz
(3.6 Mbytes)
Slides from previous years:
0. Motivation/Organization
125699 bytes.
1. Measures of information and uncertainty
125699 bytes.
2. Algebra of information and entropy
114757 bytes.
3. Inference and learning
82754 bytes.
4. Probabilistic and graphical independence models
310490 bytes.
5. Source coding (theory)
92784 bytes.
6. Data compression
96561 bytes.
7. Image compression
1248655 bytes.
8. Channel coding I
86238 bytes.
9. Channel coding II
252622 bytes.
Last update: 24/02/2024