ENEE627

Information Theory

Reviews for this course Testudo

Prerequisite: ENEE620. Credit only granted for: ENEE627 or ENEE721. Formerly: ENEE721. Information measures and their properties; entropy, relative entropy and mutual information. Information source models. Lossless data compression: the Kraft inequality, Shannon-Fano and Huffman codes. Typical sequences, asymptotic equipartition property, lossy source coding. Discrete memoryless channels: capacity, channel coding theorem. The additive Gaussian channel. Source coding under a fidelity constraint: rate distortion function and rate distortion theorem.

Spring 2025

Sennur Ulukus

5 reviews
Average rating: 3.80

Past Semesters

Alexander Barg

11 reviews
Average rating: 2.55

Prakash Narayan

7 reviews
Average rating: 3.71

Sennur Ulukus

5 reviews
Average rating: 3.80

Prakash Narayan

7 reviews
Average rating: 3.71

Prakash Narayan

7 reviews
Average rating: 3.71

* "W"s are considered to be 0.0 quality points. "Other" grades are not factored into GPA calculation. Grade data not guaranteed to be correct.