wayground logo

Free Printable Worksheets

Font size

S
M
L
XL
Worksheets

ATI quiz

Total questions: 100

Worksheet time: 50mins

Name
Class
Date
1.

Which of the following activation functions can lead to vanishing gradients?

a)

ReLU

b)

Tanh

c)
  1.  Leaky ReLU

d)
  1.  None of the above

2.

Which of the following is true about Batchnorm?

a)

Batchnorm is another way of performing dropout

b)

Batchnorm makes training faster

c)

In Batchnorm, the mean is computed over the features

d)

Batchnorm is a non-linear transformation to center the dataset around the origin

3.

When should multi-task learning be used?

a)

When your problem involves more than one class label

b)

When two tasks have the same dataset

c)

When you have a small amount of data for a particular task that would benefit from the large dataset of another task

d)

When the tasks have datasets of different formats (text and images).

4.

What is Error Analysis?

a)

The process of analyzing the performance of a model through metrics such as precision, recall or F1-score.

b)

The process of scanning mis-classified examples to identify weaknesses of a model

c)

The process of tuning hyperparameters to reduce the loss function during training

d)

 The process of identifying which parts of your model contributed to the error

5.

Which of the following is a non-iterative method to generate adversarial examples?

a)
  1.  Non-Saturating Cost Method

b)

Input Optimization Method

c)

Adversarial Training

d)

Logit Pairing

e)
  1.  Fast Gradient Sign Method

6.

Which, if any, of the following propositions is true about fully-connected neural networks (FCNN)?

a)

A FCNN with only linear activations is a linear network.

b)

In a FCNN, there are connections between neurons of a same layer.

c)

In a FCNN, the most common weight initialization scheme is the Zero initialization, because it leads to faster and more robust training

d)

None of the above

7.

How many layers Deep learning algorithms are constructed?

a)

2

b)

3

c)

4

d)

5

8.

In CNN, having max pooling always decrease the parameters?

a)

True

b)

False

c)

Can be true and false

d)

Can not say

9.

Which of the following is NOT the CNN layers?

a)

Convolutional Layer

b)

Pooling Layer

c)

Code Layer

d)

Fully connected Layer

10.

Which of the following is/are Common uses of RNNs?

a)

BusinessesHelp securities traders to generate analytic reports

b)

Detect fraudulent credit-card transaction

c)

Provide a caption for images

d)

All of the above

11.

Which of the following is well suited for perceptual tasks?

a)

Feed-forward neural networks

b)

Recurrent neural networks

c)

Convolutional neural networks

d)

Reinforcement Learning

12.

CNN is mostly used when there is an?

a)

structured data

b)

unstructured data

c)

Both A and B

d)

None of the above

13.

Which neural network has only one hidden layer between the input and output?

a)

Shallow neural network

b)

Deep neural network

c)

Feed-forward neural networks

d)

Recurrent neural networks

14.

The number of nodes in the input layer is 10 and the hidden layer is 5. The maximum number of connections from the input layer to the hidden layer are

a)

50

b)

Less than 50

c)

More than 50

d)

It is an arbitrary value

15.

Deep learning algorithms are _______ more accurate than machine learning algorithm in image classification

a)

33%

b)

37%

c)

40%

d)

41%

16.

In which of the following applications can we use deep learning to solve the problem?

a)

Protein structure prediction

b)

Prediction of chemical reactions

c)

Detection of exotic particles

d)

All of the above

17.

Which of the following statements is true when you use 1×1 convolutions in a CNN?

a)

It can help in dimensionality reduction

b)

It can be used for feature pooling

c)

It suffers less overfitting due to small kernel size

d)

All of the above

18.

Which of the following methods DOES NOT prevent a model from overfitting to the training set?

a)

Dropout

b)

Pooling

c)

Early stopping

d)

Data augmentation

19.

The input image has been converted into a matrix of size 28 X 28 and a kernel/filter of size 7 X 7 with a stride of 1. What will be the size of the convoluted matrix?

a)

20x20

b)

21x21

c)

22x22

d)

25x25

20.

In a simple MLP model with 8 neurons in the input layer, 5 neurons in the hidden layer and 1 neuron in the output layer. What is the size of the weight matrices between hidden output layer and input hidden layer?

a)

[1 X 5] , [5 X 8]

b)

[5 x 1] , [8 X 5]

c)

[8 X 5] , [5 X 1]

d)

[8 X 5] , [ 1 X 5]

21.

Which of the following functions can be used as an activation function in the output layer if we wish to predict the probabilities of n classes (p1, p2..pk) such that sum of p over all n equals to 1?

a)

Softmax

b)

ReLu

c)

Sigmoid

d)

Tanh

22.

Assume a simple MLP model with 3 neurons and inputs= 1,2,3. The weights to the input neurons are 4,5 and 6 respectively. Assume the activation function is a linear constant value of 3. What will be the output ?

a)

32

b)

64

c)

96

d)

128

23.

Which of the following would have a constant input in each epoch of training a Deep Learning model?

a)

Weight between input and hidden layer

b)

Weight between hidden and output layer

c)

Biases of all hidden layer neurons

d)

Activation function of output layer

24.

Sentiment analysis using Deep Learning is a many-to one prediction task

a)

True

b)

False

c)

Can be true or false

d)

Can not say

25.

RNNs stands for?

a)

Recurrent Neural Networks

b)

Report Neural Networks

c)

Receives Neural Networks

d)

Recording Neural Networks

26.

Output of sigmoid function has the range from:

a)

0 to 1

b)

-1 to 1

c)

-1 to 0

d)

0 to 9

27.

Output of tanh function has the range from:

a)

0 to 1

b)

-1 to 1

c)

-1 to 0

d)

0 to 9

28.

The Deep Learning first layer is called the?

a)

hidden layer

b)

output layer

c)

input layer

d)

None of the above

29.

LSTM stands for?

a)

Linear short-term memory

b)

Long short-term memory

c)

Linear Static-technology memory

d)

Linear Sematic-Technology Memory

30.

Assume that your machine has a large enough RAM dedicated to training neural networks. Compared to using stochastic gradient descent for your optimization, choosing a batch size that fits your RAM will lead to:

a)

a more precise but slower update

b)

a less precise but faster update

c)

a less precise and slower update

d)

a more precise and faster update

31.

Which of the following methods DOES NOT prevent a model from overfitting to the training set?

a)

Dropout

b)

Pooling

c)

Early stopping

d)

Data augmentation

32.

What is back propagation?

a)

It is another name given to the curvy function in the perceptron

b)

It is the transmission of error back through the network to adjust the inputs

c)

It is the transmission of error back through the network to allow weights to be adjusted so that the network can learn

d)

None of the mentioned

33.

Supervised learning and unsupervised clustering both require at least one

a)

hidden attribute

b)

output attribute

c)

input attribute

d)

categorical attribute

34.

Supervised learning differs from unsupervised clustering in that supervised learning requires

a)

at least one input attribute

b)

input attributes to be categorical

c)

at least one output attribute

d)

output attributes to be categorical

35.

Another name for an output attribute

a)

predictive variable

b)

independent variable

c)

estimated variable

d)

dependent variable

36.

Assume that we have a dataset containing information about 200 individuals. One hundred of these individuals have purchased life insurance. A supervised data mining session has discovered the following rule:

IF age < 30 & credit card insurance = yes THEN life insurance = yes

Rule Accuracy: 70%

Rule Coverage: 63%

How many individuals in the class life insurance= no have credit card insurance and

are less than 30 years old?

a)

63

b)

70

c)

30

d)

18

37.

Which statement is true about neural network and linear regression models?

a)

Both models require input attributes to be numeric

b)

Both models require numeric attributes to range between 0 and 1

c)

The output of both models is a categorical attribute value

d)

Both techniques build models whose output is determined by a linear sum of weighted input attribute values.

e)

More than one of a,b,c or d is true.

38.

Unlike traditional production rules, association rules

a)

allow the same variable to be an input attribute in one rule and an output attribute in another rule

b)

allow more than one input attribute in a single rule

c)

require input attributes to take on numeric values

d)

require each rule to have exactly one categorical output attribute

39.

. Which of the following is a common use of unsupervised clustering?

a)

detect outliers

b)

determine a best set of input attributes for supervised learning

c)

evaluate the likely performance of a supervised learning model

d)

determine if meaningful relationships can be found in a dataset

e)

All of a,b,c, and d are common uses of unsupervised clustering

40.

The average positive difference between computed and desired outcome values

a)

root mean squared error

b)

mean squared error

c)

mean absolute error

d)

mean positive error

41.

Given desired class Cand population P, lift is defined as

a)

the probability of class C given population P divided by the probability of C given a sample taken from the population

b)

the probability of population P given a sample taken from P

c)

the probability of class C given a sample taken from population P

d)

the probability of class C given a sample taken from population P divided by the probability of C within the entire population P

42.

Deep learning works well despite of problem(s).

a)

High capacity (Susceptible to overfitting)

b)

Numerical instability (vanishing/exploding gradient)

c)

Sharp minima

d)

All of the above

43.

An average human brain has around neurons(aprox)

a)

102

b)

1011

c)

1010

d)

None of the above

44.

Which of the following statements is true for the Perceptron Learning Algorithm?

Statement I: Threshold needs to be hand coded

Statement II: Threshold can be learnt

a)

I & II

b)

I

c)

II

d)

None of these

45.

Which kind of optimisation is required in 2-class linear SVM training procedure?

a)

Linear

b)

Qudratic

c)

Cubic

d)

Depends on dimension of the data

46.

The distance of a feature vector [2, 3, -2] from separating plane x1+2x2+2x3+5=0 is given

by

a)

5

b)

3/13

c)

3

d)

13

47.

For the separable data with D-dimensional feature vectors, K classes and a total of N examples, how many unknown variables are to be estimated in SVM training to get a separating plane 'which maximizes margin? How many constraints?

a)

D variables, N constraints

b)

(D+1) variables, N constraints

c)

D variables, K constraints

d)

(D+1) Variables, K constraints

48.

The values of Lagrange multipliers corresponding to the support vectors can be:

a)

Less than zero

b)

Greater than zero

c)

Any real number

d)

Any real non-zero number

49.

A data point with 5 dimensions [27,40, -15,30,38] obtain a score [18, 20, -5, -15,19].

Find the Hinge loss incurred by second class (class 2) with a margin of 5 is given by:

a)

37

b)

7

c)

3

d)

120

50.

One form of sigmoid function logistic function

a)

True

b)

False

51.

In sigmoid (logistic) function when WTX=0, then sigmoid value is equal to

a)

0

b)

1

c)

d)

0.5

52.

In logistic function, when we increase the value of „w‟, the function becomes

a)

Step function

b)

Sigmoid function

c)

Quadratic function

d)

None of these

53.

Which parameter(s) need to be learnt in minimizing objective function in supervised learning?

a)

Only Weight

b)

Only Bias

c)

Both Weight and Bias

d)

Learning rate

e)

None of these

54.

Why convolution neural network is taking off quickly in recent times

a)

Access to large amount of digitized data

b)

Integration of feature extraction within the training process

c)

Availability of more computational power

d)

All of the above

55.

Momentum based gradient descent algorithm and Nesterov accelerated gradient descent are faster

than Stochastic gradient descent algorithm

a)

True

b)

False

56.

Consider the following statement, “It takes less time to navigate the regions having a gentle slope”

The above statement is true in case of

I. Gradient descent algorithm

II. Momentum based gradient descent algorithm

a)

I

b)

II

c)

II & I

57.

Identify the technique that is used to achieve relatively better learning rate by updating w using

bunch of different values of η.

a)

Bias Correction

b)

Line Search

c)

Stochastic

d)

All the above

58.

There is no guarantee that the loss decreases at each step in a stochastic Gradient Descent”

a)

True

b)

False

59.

Identify the advantages of Nesterov accelerated gradient descent.

I. Corrects its course quicker than Momentum-based gradient descent

II. Oscillations are smaller

III. Chances of escaping minima valley are also smaller

a)

I

b)

Only II

c)

II and III

d)

I, II and III

60.

Pick out the methods for annealing learning rate that has only number of epochs as the hyperparameter

a)

Step decay

b)

Exponential Decay

c)

1/t Decay

61.

Adagrad got stuck when it was close to convergence. How does RMSProp overcome this problem?

a)

More Aggressive on decay

b)

Less Aggressive on decay

c)

No decay

62.

Which of the following gradient descent algorithm suffers from more oscillations?

a)

Momentum based gradient descent

b)

Nesterov accelerated gradient descent

c)

Vanilla gradient descent

d)

None of the above

63.

In a neural network, knowing the weight and bias of each neuron is the most important step. If you

can somehow get the correct value of weight and bias for each neuron, you can approximate any

function. What would be the best way to approach this?

a)

Assign random values and pray to God they are correct

b)

Search every possible combination of weights and biases till you get the best value

c)

Iteratively check that after assigning a value how far you are from the best values, and slightly change the assigned values values to make them better

d)

None of these

64.

What are the steps for using a gradient descent algorithm?

1. Calculate error between the actual value and the predicted value

2. Reiterate until you find the best weights of network

3. Pass an input through the network and get values from output layer

4. Initialize random weight and bias

5. Go to each neurons which contributes to the error and change its respective

values to reduce the error

a)

1, 2, 3, 4, 5

b)

5, 4, 3, 2, 1

c)

3, 2, 1, 5, 4

d)

4, 3, 1, 5, 2

65.

..“Convolutional Neural Networks can perform various types of transformation (rotations or

scaling) in an input”. Is the statement correct True or False?

a)

True

b)

False

66.

Which of the following techniques perform similar operations as dropout in a neural network?

a)

Bagging

b)

Boosting

c)

Stacking

d)

Noe of these

67.

Which of the following gives non-linearity to a neural network?

a)

Stochastic Gradient Descent

b)

Rectified Linear Unit

c)

Convolution function

d)

None of the above

68.

If you increase the number of hidden layers in a Multi Layer Perceptron, the classification error of

test data always decreases. True or False?

a)

True

b)

False

69.

Which of the following is true about model capacity (where model capacity means the ability of

neural network to approximate complex functions) ?

a)

As number of hidden layers increase, model capacity increases

b)

As dropout ratio increases, model capacity increases

c)

As learning rate increases, model capacity increases

d)

None of these

70.

If you increase the number of hidden layers in a Multi Layer Perceptron, the classification error of

test data always decreases. True or False?

a)

True

b)

False

71.

Can a neural network model the function (y=1/x)?

a)

Yes

b)

No

72.

In which neural net architecture, does weight sharing occur?

a)

Convolutional neural Network

b)

Recurrent Neural Network

c)

Fully Connected Neural Network

d)

Both A and B

73.

Batch Normalization is helpful because

a)

It normalizes (changes) all the input before sending it to the next layer

b)

It returns back the normalized mean and standard deviation of weights

c)

It is a very efficient backpropagation technique

d)

None of these

74.

Instead of trying to achieve absolute zero error, we set a metric called bayes error which is the

error we hope to achieve. What could be the reason for using bayes error?

a)

Input variables may not contain complete information about the output variable

b)

System (that creates input-output mapping) may be stochastic

c)

Limited training data

d)

All the above

75.

The number of neurons in the output layer should match the number of classes (Where the number

of classes is greater than 2) in a supervised learning task. True or False?

a)

True

b)

False

76.

What is the purpose of Gradient Descent algorithm?

a)

To normalize the input

b)

To minimize the weight and bias

c)

To minimize the loss function

d)

To prevent overfitting

77.

Which is true for neural networks?

a)

It has set of nodes and connections

b)

Each node computes it's weighted input

c)

Node could be in excited state or non-excited state

d)

All of the mentioned

78.

What is a dead unit in a neural network?

a)

A unit which doesn’t update during training by any of its neighbour

b)

A unit which does not respond completely to any of the training patterns

c)

The unit which produces the biggest sum-squared error

d)

None of these

79.

Which of the following statement is the best description of early stopping?

a)

Train the network until a local minimum in the error function is reached

b)

Simulate the network on a test dataset after every epoch of training. Stop training when the generalization error starts to increase

c)

Add a momentum term to the weight update in the Generalized Delta Rule, so that raining converges more quickly

d)

A faster version of backpropagation, such as the `Quickprop‟ algorithm

80.

What if we use a learning rate that’s too large?

a)

Network will converge

b)

Network will not converge

c)

Can‟t Say

81.

Which gradient technique is more advantageous when the data is too big to handle in RAM simultaneously?

a)

Full Batch Gradient Descent

b)

Stochastic Gradient Descent

82.

What are the factors to select the depth of neural network?

1. Type of neural network (eg. MLP, CNN etc)

2. Input data

3. Computation power, i.e. Hardware capabilities and software capabilities

4. Learning Rate

5. The output function to map

a)

1, 2, 4, 5

b)

2, 3, 4, 5

c)

1, 3, 4, 5

d)

All of these

83.

Consider the scenario. The problem you are trying to solve has a small amount of data. Fortunately, you have a pre-trained neural network that was trained on a similar problem. Which of the following methodologies would you choose to make use of this pre-trained network?

a)

Re-train the model for the new dataset

b)

Assess on every layer how the model performs and only select a few of them

c)

Fine tune the last couple of layers only

d)

Freeze all the layers except the last, re-train the last layer

84.

Increase in size of a convolutional kernel would necessarily increase the performance of a

convolutional network

a)

True

b)

False

85.

Which kind of activation function is typical for a convolution layer in an RNN

a)

Gaussian

b)

Sigmoid

c)

Hyperbolic Tangent

d)

ReLU

86.

Which of the following method use arithmetic operation in evaluation of word representation?

a)

Semantic relatedness

b)

Synonym detection

c)

Semantic analogy

d)

None of the above

87.

Which of the following model directly learn word representations?

a)

Prediction based model

b)

Count based model

c)

Both prediction and count based model

d)

None of these

88.

Which of the following is correct in word representation model?

I. In continuous bag of word model, the softmax function is computationally

expensive.

II. In continuous bag of word model, the softmax function is computationally

inexpensive.

III. In Skip-gram model, the softmax function is computationally inexpensive.

IV. In Skip-gram model, the softmax function is computationally expensive

a)

I only

b)

II & III

c)

III only

d)

I & IV

89.

Which of the following solution constructs a binary tree in learning word representation using prediction- based models?

a)

Use negative sampling

b)

Use contrastive estimation

c)

Use hierarchical softmax

d)

None of these

90.

Which of the following method(s) use dot product in the evaluation of word representation?

I. Semantic relatedness

II. Synonym detection

III. Semantic analogy

a)

I & II

b)

III

c)

I, II & III

d)

None of above

91.

If you need to design a model for textual entailment from the text, then which of the following steps will you choose?

I. CNN is used to encode the text

II. CNN is used to decode the text

III. RNN is used to decode the text from the encoding

IV. RNN is used to encode the text.

V. RNN is used to encode the text and decode the text.

a)

IV, II

b)

I, III

c)

V

d)

Noe of these

92.

The problem of generating the sentence given an image can be possibly solved with the encoder decoder architecture

a)

Yes

b)

No

93.

For document classification and summarization, it is important to look at the important sentences

and important words. What kind of “attention” mechanism is required for encoding?

a)

Hierarchical

b)

Ungraded

c)

Sequential

d)

Unordered

94.

48 filters of size 21 x 21 is applied to an image of size 327 x 327, with zero padding and stride of 3. The image is an RGB image. The depth of the filter is same as the depth of image. What will be the volume of the final image?

a)

103 x 103 x 3

b)

103 x 103 x 48

c)

327 x 327 x 3

d)

327 x 327 x 48

95.

While reconstructing images from embeddings, if we consider deeper layers of the network, how is the image affected?

a)

The reconstructed image is blur

b)

A more realistic copy of the original image is reconstructed

c)

The reconstructed image is sharpened

d)

The reconstructed image becomes abstract

96.

Which of the following is true for content and style of image w.r.t. Deep Art?

a)

Content should match and Style shouldn‟t match

b)

Content shouldn‟t match and Style should match

c)

Both Content and Style should match

d)

Both Content and Style shouldn‟t match

97.

It is very easy to fool a CNN. Which of the following statements doesn‟t support the above argument?

a)

The CNN draws very stringent/strict boundaries for classification

b)

The decision boundaries are loosely drawn

c)

The input dimension for a certain class is very very large

d)

None

98.

Which of the following includes major tasks of NLP?

a)

Discourse Analysis

b)

Automatic Summarization

c)

Machine Translation

d)

All of above

99.

Which of the following is used to mapping sentence plan into sentence structure?

a)

Text planning

b)

Sentence planning

c)

Text Realization

d)

None of the Above

100.

Given a sound clip of a person or people speaking, determine the textual representation of the speech

a)

Text-to-speech

b)

Speech-to-text

c)

All of the mentioned

d)

None of the mentioned