Lecture: Teer 203 MW 10:05 - 11:20 AM
TAs: Avijit Mandal, Minxue Tang
Dr. Pfister Office Hour: M 3:00 - 4:00 PM
Duke Course Rules and Information (updated 08/13/20)
Syllabus (updated 08/25/24)
Textbooks
Elements of Information Theory, 2nd Ed. by Cover and Thomas
Information Theory (Lecture Notes) V6.16 by Stefan Moser
Advanced Topics in Information Theory (Lecture Notes) V5.7 by Stefan Moser
Information Theory by Yury Polyanskiy and Yihong Wu
Information Theory and Reliable Communication by Robert Gallager
Lecture Notes
Lecture 1 - Introduction
Lecture 2 - Measures of Information
Homework 0
Homework 1
Historical References
Guglielmo Marconi
Claude Shannon
Shannon's 1948 Paper: A Mathematical Theory of Communication
Applications
Mathematical References
A Quick Introduction to Convex Optimization
Toeplitz and circulant matrices: A review by Robert Gray
Channel Coding References
Coding for two noisy channels by Peter Elias
On exponential error bounds for random codes on the BSC by David Forney
A simple derivation of the coding theorem and some applications by Robert Gallager
Capacity of a burst-noise channel by E. N. Gilbert
The capacity of the band-limited Gaussian channel by A. Wyner
Computation of Channel Capacity and Rate-Distortion Functions by R. E. Blahut
Hypothesis Testing and Information Theory by R. E. Blahut
Capacity and coding for Gilbert-Elliott channels by M. Mushkin and I. Bar-David
Capacity of multi-antenna Gaussian channels by Emre Telatar