EE4-40 Information Theory
Lecturer(s): Dr Cong LingAims:
This course is designed to introduce students to the main concepts of information theory and to demonstrate its implications to communications.
Learning Outcomes:
At the end of the course, students are expected to have understood the concept and properties of entropy and mutual information, the source coding theorem, the notions of channels and channel capacity, the fundamental coding theorem for noisy channels and its implications, the theory of rate-distortion, and basics of network information theory.
Syllabus:
Elements of information theory of discrete systems; information measures, memoryless and memory sources, the noiseless coding theorem. Methods of source coding. Information theory of continuous systems. Shannon's capapcity theorem and its interpretation. Lossy source coding and rate-distortion theory. Network information theory.
Assessment:
One 3-hour exam in April/May
Coursework contribution: 0%
Term: Spring
Closed or Open Book (end of year exam): Closed
Coursework Requirement
nil
Oral Exam Required (as final assessment): no
Prerequisite: None required
Course Homepage: http://www.commsp.ee.ic.ac.uk/~cling/IT/InformationTheory.htm
|
|