information theory

This Precisely state the limits for compression and transmission of information.

output sequence of source is statistically independent of all part and future outputs.

output of discrete source is statistically dependent

example of stationary

a function which depends solely on the probability P{E}

A measure of uncertainty or randomness.

It is the process wherein the quantized intervals assigned to the individual PAM samples are converted into binary signals.

A numerical indication of how efficiently PCM code is utilized

The Ratio of the minimum number of bits required to achieve a certain dynamic range to the actual PCM bits used.

It is the random, thermal noise that is present only into the input of the PAM sampler when there is no analog input signal