ICT Quiz

Which of the following best defines entropy in information theory?

• The measure of energy in a system

• The measure of uncertainty in a random variable

• The measure of processing speed in a computer

• The measure of redundancy in a system

The entropy of a fair coin toss (head or tail) is:

• 0

• 0.5

• 1

• 2

What is the relation between probability and information content?

• Higher probability means higher information

• Higher probability means lower information

• Probability and information are unrelated

• Probability always equals information

Mutual information between two random variables measures:

• The total information in both variables

• The information shared between the two variables

• The entropy of a single variable

• The probability of occurrence of a variable

Which of the following is a property of entropy?

• Entropy is always negative

• Entropy is independent of probability

• Entropy is maximized for a uniform distribution

• Entropy is always zero for random variables

Which coding technique provides optimal prefix codes?

• Arithmetic coding

• Huffman coding

• Shannon coding

• Run-length coding

Which theorem states that no compression scheme can transmit more than the channel capacity?

• Nyquist theorem

• Shannon's theorem

• Huffman's theorem

• Fanon's theorem

What is the main advantage of Shannon-Fano coding?

• It always produces the shortest code

• It ensures lossless data transmission

• It works better than Huffman coding

• It provides a unique decoding for all codewords

Huffman coding is based on:

• Frequency of symbols

• Length of input data

• Number of unique characters

• Probabilities of ASCII codes

What is arithmetic coding mainly used for?

• Lossy image compression

• Lossless data compression

• Video processing

• Error detection