View reviews for professors for this course View On Testudo


Information Theory

Information measures and their properties; entropy, relative entropy an mutual information. Information source models. Lossless data compression: the Kraft inequality, Shannon-Fano and Huffman codes. Typical sequences, asymptotic equipartition property, lossy source coding. Discrete memoryless channels: capacity, channel coding theorem. The additive Gaussian channel. Source coding under a fidelity constraint: rate distortion function and rate distortion theorem.

3 reviews
Average rating: 4.33

3 reviews
Average rating: 3.67

7 reviews
Average rating: 2.14

Average GPA: 3.10 between 201 students

"W"s are considered to be 0.0 quality points. "Other" grades are not factored into the average GPA calculation.