Shannon stated that the amount of knowledge in a signal is not determined by the message's size.

• TRUE

• FALSE

In information theory, the amount of information in a message is often referred to as its "information content" or ____.

Which of the following are examples of error correction codes?

• Reed-Solomon

  codes.

• Morse Code

• EBCDIC code

• Hamming codes

He is an American mathematician and electrical engineer, computer scientist and cryptographer. He is known as the "father of information theory''.

The more surprising or unexpected a message is, the more information it contains.

Conversely, if a message is highly predictable, it contains less information. Give an example.

It is a way to measure the uncertainty or unpredictability in a message or data source. It quantifies the average amount of information per symbol or character in a message.

It is the basic unit used to measure information.

Its goal is to represent data in a way that minimizes the number of bits required to transmit or store it, while retaining its essential information content.

• machine learning

• cryptography

• data compression

• communication

In lossy compression, some information is intentionally discarded to achieve higher compression ratios. This is commonly used in multimedia applications. Give an example.

Which of the following is not one of the factors affecting channel capacity?

• Bandwidth

• Entropy

• Signal-to-Noise Ratio

• Error Probability