12 units
The first half of the course comprises of the concepts of entropy, mutual information, the Asymptotic Equipartition property, applications to source coding (data compression), applications to channel capacity (channel coding), differential entropy and its application to waveform channel capacities, and a subset of advanced topics such as network information theory, or rate-distortion theory, as time permits. The second half of the course comprises finite-field algebra, Hamming codes, cyclic codes (CRC and BCH codes), a brief introduction to Reed-Solomon codes, and perhaps universal codes (Lempel-Ziv coding).
Prerequisites: 36-217 and senior or graduate standing.
Last updated on March 21, 2007
Signal Processing and Communications
Signals and Systems
S08, S06, S05, S04, F02, F01
Please note that the course history information is incomplete and/or may reflect different courses offered under the same course number.