Skip to main content
EC EN
770

Information Theory

Hours

3.0 Credit, 3 Lecture, 0 Lab
Mathematical development of information theory applied to data communications and coding. Topics include entropy, mutual information, channel capacity, data compression, rate distortion theory, etc.

1.

The ability to compute entropy and mutual information involving simple alphabets.

2.

The ability to write a computer program to perform source coding.

3.

The ability to compute channel capacity for simple channels.