ECEN 647: Information Theory

Textbooks and Notes

• Required: Elements of Information Theory by T. Cover and J. Thomas (ebook)
• Other References: Information Theory and Reliable Communication by R. Gallager
• Probability Reference: Probability and Random Processes by S. Miller and D. Childers (ebook)

Handouts

• Syllabus (updated 1/16/11)
• Capacity Notes (updated 4/1/11)
• Decorrelating Wide-Sense Stationary Processes (updated 4/22/11)

Related Reading

• Guglielmo Marconi
• Claude Shannon
• Shannon's 1948 Paper: A Mathematical Theory of Communication
• Coding for two noisy channels by Peter Elias
• On exponential error bounds for random codes on the BSC by David Forney
• A simple derivation of the coding theorem and some applications by Robert Gallager
• Capacity of a burst-noise channel by E. N. Gilbert
• The capacity of the band-limited Gaussian channel by A. Wyner
• Computation of Channel Capacity and Rate-Distortion Functions by R. E. Blahut
• Hypothesis Testing and Information Theory by R. E. Blahut
• Capacity and coding for Gilbert-Elliott channels by M. Mushkin and I. Bar-David
• Capacity of multi-antenna Gaussian channels by Emre Telatar
• Capacity and mutual information of wideband multipath fading channels by E. Telatar and D. Tse
• Toeplitz and circulant matrices: A review by Robert Gray
• A Quick Introduction to Convex Optimization