NEW
Font size
WorksheetsTItest
Total questions: 77
Worksheet time: 39mins
... is a measure of uncertainty
Encoding
Entropy
Information
Redundancy
{1,2,3,4,5,6} is the sample space of ...
removing a card from the standard deck
sum of two dice
one dice roll
one coin toss
A card is drawn from a pack of 52 cards. The probability of getting a king of heart is
1/26
1/52
1/13
2/13
A card is drawn from a pack of 52 cards. The probability of getting a queen or a king of heart is
1/52
1/26
1/13
2/13
A code has two allowable combinations 101 and 010. What is the allowable combination for the error combination 001?
101
010
001
none
A code has two allowable combinations 101 and 010. What is the allowable combination for the error combination 100?
101
010
100
none
A code has two allowable combinations 101 and 010. What is the allowable combination for the error combination 000?
010
101
000
none
A code has two allowable combinations 101 and 010. What is the allowable combination for the error combination 111?
010
101
111
none
A code has two allowable combinations 101 and 010. What is the allowable combination for the error combination 011?
010
101
011
none
A code has two allowable combinations 101 and 010. What is the allowable combination for the error combination 110?
010
101
110
none
A fair coin is tossed four times, the probability of getting four heads is
1/4
1/16
1
1/2
A Huffman code is a = 1, b = 000, c = 001, d = 01. Probabilities are p(a) = 0.4, p(b) = 0.1, p(c) = 0.2, p(d) = 0.3. The average length of codewords q is
2.1 bit
1.9 bit
2.0 bit
8.0 bit
A redundancy of a code S = ...
1 - Iavr/Imax
Iavr/Imax
1 + Iavr/Imax
Imax/Iavr
An alphabet consist of the letters a, b, c and d. The probability of occurrence is \n p(a) = 0.4, p(b) = 0.1, p(c) = 0.2 and p(d) = 0.3. The Huffman code is
a=0,b=111,c=11,d=101
a=0,b=110,c=111,d=10
a=0,b=11,c=10,d=111
a=01,b=111,c=110,d=10
An average length of codewords qavr = ...
∑ (pi * qi)
∑ (pi / qi)
∑ pi
∑ qi
An efficiency of a code E = ...
Iavr/Imax
Imax/Iavr
Iavr/100
Imax - Iavr
ASCII code is a
Variable length code
Fixed length code
Error-correction code
None of the given
Bag contain 10 black and 20 white balls, One ball is drawn at random. What is the probability that ball is white
1
2/3
1/3
4/3
By the Bayes' rule for conditional entropy H(Y|X) \= ...
[P(B|A)][P(A)] /P(B)
H(X|Y) - H(X)
H(X|Y)+ H(Y)
H(X|Y) - H(X) + H(Y)
By the Bayes' theorem ...
P(B|A) = P(A and B)/P(A)
P(B|A) = P(A and B)*P(A)
P(A|B) = [P(B|A)][P(A)] /P(B)
P(A|B) = [P(B|A)][P(A)] * P(B)
By the Chain rule H(X,Y) \= H(Y|X) + ...
H(Y)
H(X)
H(Y|X)
H(X|Y)
By the Hartley's formula the amount of information I = ...
I = n*log m
I = m*n
I = log (m/n)
I = log (m*n)
By the Hartley's formula the entropy H = ...
H \= - ∑(pi * log pi)
H \= - ∑ (log pi)
H \= log m
H \= - ∑ (pi / log pi)
By the property of joint entropy H(X,Y) <= ...
H(X)
H(Y)
H(X) + H(Y)
None of the given
By the property of joint entropy H(X,Y) ...
H(X,Y) >= H(X) and H(X,Y) <= H(Y)
H(X,Y) <= H(X) and H(X,Y) >= H(Y)
H(X,Y) >= H(X) and H(X,Y) >= H(Y)
H(X,Y) >= H(X) + H(Y)
By the Shannon's formula the amount of information I = ...
H \= - n ∑( pi log pi)
H \= - n * ∑ (log pi)
H \= - n * ∑ pi
H \= - n * ∑ (pi / log pi)
By the Shannon's formula the entropy H = ...
H \= - ∑( pi * log pi)
H \= - ∑ (log pi)
H \= - ∑ pi
H \= - ∑ (pi / log pi)
Calculate the code rate for Hamming (15,11) code
1
0,733
0,571
0,839
Calculate the code rate for Hamming (31,26) code
1
0,733
0,839
0,571
Calculate the code rate for Hamming (7,4) code
1
0,571
0,733
0,839
Calculate the efficiency of the language if it has 32 letters and its I average is 1 bit.
0,8
0,2
5
1
Calculate the redundancy of the language if it has 32 letters and its I average is 1 bit.
0,8
0,2
5
1
Choose the formula to determine the number N of possible messages with length n if the message source alphabet consists of m characters, each of which can be an element of the message.
N = mn
N = nm
N = m*n
N = log m
Code has dmin = 1. How many errors can be corrected by this code
2
3
0
1
Code has dmin = 1. How many errors can be detected by this code?
0
2
3
1
Code has dmin = 10. How many errors can be detected by this code?
4
8
9
10
Code has dmin = 11. How many errors can be corrected by this code?
11
7
5
10
Code has dmin = 11. How many errors can be detected by this code?
5
9
10
11
Code has dmin = 12. How many errors can be detected by this code?
5
10
11
12
Code has dmin = 2. How many errors can be corrected by this code?
2
3
0
1
Code has dmin = 2. How many errors can be detected by this code?
2
3
1
0
Code has dmin = 3. How many errors can be corrected by this code?
2
3
1
4
Code has dmin = 3. How many errors can be detected by this code?
1
3
2
4
Code has dmin = 4. How many errors can be detected by this code?
5
1
3
4
Code has dmin = 5. How many errors can be corrected by this code?
5
3
2
4
Code has dmin = 5. How many errors can be detected by this code?
6
2
4
5
Code has dmin = 6. How many errors can be detected by this code?
6
2
5
4
Code has dmin = 7. How many errors can be corrected by this code?
5
6
3
4
Code has dmin = 7. How many errors can be detected by this code?
7
3
6
5
Code has dmin = 8. How many errors can be detected by this code?
8
6
7
3
Code has dmin = 9. How many errors can be corrected by this code?
5
7
4
8
Code has dmin = 9. How many errors can be detected by this code?
7
9
8
4
Code is optimal when ...
qavr = H
qavr ≠H
qavr<H
qavr >H
Code rate R (k information bits and n total bits) is defined as
k = n/R
R = k * n
R = k/n
n = R * k
Conditional entropy H(Y|X) lies between
- H(Y) and 0
0 and H(Y)
- H(Y) and H(Y)
0 and 1
Conditional probability P(B|A) = ...
P(A and B)/P(A)
[P(B|A)][P(A)] /P(B)
P(A and B)*P(A)
[P(B|A)][P(A)] * P(B)
Determine the Hamming distance for code that can detect 3 errors and correct 2 errors
6
5
7
9
Determine the Hamming distance for code that can detect 3 errors and correct 1 errors.
5
4
6
8
Determine the Hamming distance for code that can detect 5 errors and correct 3 errors.
9
8
10
14
Encode a string "0000" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
0000001
0000111
0000000
0000101
Encode a string "0001" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
0001010
0001001
0001011
0001111
Encode a string "0010" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
0010010
0010111
0010110
0010100
Encode a string "0011" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
0011100
0011001
0011111
0011101
Encode a string "0100" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
0100011
0100111
0100110
0100101
Encode a string "0101" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
0101101
0101000
0101100
0101110
Encode a string "0110" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
0110101
0110001
0110000
0110011
Encode a string "0111" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
0111110
0111000
0111010
0111011
Encode a string "1000" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
1000111
1000100
1000101
1000001
Encode a string "1001" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
1001111
1001010
1001110
1001100
Encode a string "1010" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
1010010
1010011
1010001
1010111
Encode a string "1011" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3
1011000
1011100
1011010
1011001
Encode a string "1100" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
1100110
1100000
1100010
1100011
Encode a string "1101" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
1101101
1101011
1101001
1101000
Encode a string "1110" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
1110000
1110101
1110100
1110110
Encode a string "1111" with Hamming (7,4) code using the following structure (i1, i2, i3, i4, r1, r2, r3)
1111110
1111111
1111101
1111011
Find the information amount of a symbol from the language with total number of symbols n = 18
I = log218
I = log182
I = 18 * log218
I = 18 * log182
For a Hamming (15, 11) code, 15 is the total number of bits and 11 is the number of ...
redundant bits
data bits
parity bits
none of the given
