EECE 7337 — Information Theory

4 semester hoursGraduateLecturetypical days: M/ThBostonOnlineTraditionalVideo Streaming

Discusses basic properties of entropy and mutual information, Shannon’s fundamental theorems on data compression and data transmission in the single-user case, binning, and covering lemmas. Topics include rate distortion theory, feedback in one-way channels, Slepian-Wolf coding of correlated information sources, source coding with side information at the receiver, multiple access channel and its capacity region, and the capacity region of the Gaussian multiple access channel. Also covers broadcast channels, superposition coding, and the capacity region of the degraded broadcast channel; performance and comparison of TDMA, FDMA, and CDMA systems from a theoretical point of view; capacity issues for time-varying channels and channels with memory; relation between information theory and statistics; Stein’s lemma; and large deviation theory.

Prerequisites

Offering history

TermSectionsEnrolledCapacityFullOpen seats/section
Fall 20242101179%53.5

Snapshots from scheduled scrapes — not live seat availability. "Full" can exceed 100% when sections over-enroll.

Meeting times

Share of recent sections by weekday: M 90% · T 0% · W 0% · Th 90% · F 0%

Common patterns: MR (90% of sections), async (10% of sections) — in patterns, R means Thursday

Professors

Fall

Percentages are each professor's average share of the season's enrolled students in recent terms.

Links

Official catalog (EECE course descriptions) · All EECE courses · Plan it at numap.app