Font size
WorksheetsATI quiz
Total questions: 100
Worksheet time: 50mins
Which of the following activation functions can lead to vanishing gradients?
ReLU
Tanh
Leaky ReLU
None of the above
Which of the following is true about Batchnorm?
Batchnorm is another way of performing dropout
Batchnorm makes training faster
In Batchnorm, the mean is computed over the features
Batchnorm is a non-linear transformation to center the dataset around the origin
When should multi-task learning be used?
When your problem involves more than one class label
When two tasks have the same dataset
When you have a small amount of data for a particular task that would benefit from the large dataset of another task
When the tasks have datasets of different formats (text and images).
What is Error Analysis?
The process of analyzing the performance of a model through metrics such as precision, recall or F1-score.
The process of scanning mis-classified examples to identify weaknesses of a model
The process of tuning hyperparameters to reduce the loss function during training
The process of identifying which parts of your model contributed to the error
Which of the following is a non-iterative method to generate adversarial examples?
Non-Saturating Cost Method
Input Optimization Method
Adversarial Training
Logit Pairing
Fast Gradient Sign Method
Which, if any, of the following propositions is true about fully-connected neural networks (FCNN)?
A FCNN with only linear activations is a linear network.
In a FCNN, there are connections between neurons of a same layer.
In a FCNN, the most common weight initialization scheme is the Zero initialization, because it leads to faster and more robust training
None of the above
How many layers Deep learning algorithms are constructed?
2
3
4
5
In CNN, having max pooling always decrease the parameters?
True
False
Can be true and false
Can not say
Which of the following is NOT the CNN layers?
Convolutional Layer
Pooling Layer
Code Layer
Fully connected Layer
Which of the following is/are Common uses of RNNs?
BusinessesHelp securities traders to generate analytic reports
Detect fraudulent credit-card transaction
Provide a caption for images
All of the above
Which of the following is well suited for perceptual tasks?
Feed-forward neural networks
Recurrent neural networks
Convolutional neural networks
Reinforcement Learning
CNN is mostly used when there is an?
structured data
unstructured data
Both A and B
None of the above
Which neural network has only one hidden layer between the input and output?
Shallow neural network
Deep neural network
Feed-forward neural networks
Recurrent neural networks
The number of nodes in the input layer is 10 and the hidden layer is 5. The maximum number of connections from the input layer to the hidden layer are
50
Less than 50
More than 50
It is an arbitrary value
Deep learning algorithms are _______ more accurate than machine learning algorithm in image classification
33%
37%
40%
41%
In which of the following applications can we use deep learning to solve the problem?
Protein structure prediction
Prediction of chemical reactions
Detection of exotic particles
All of the above
Which of the following statements is true when you use 1×1 convolutions in a CNN?
It can help in dimensionality reduction
It can be used for feature pooling
It suffers less overfitting due to small kernel size
All of the above
Which of the following methods DOES NOT prevent a model from overfitting to the training set?
Dropout
Pooling
Early stopping
Data augmentation
The input image has been converted into a matrix of size 28 X 28 and a kernel/filter of size 7 X 7 with a stride of 1. What will be the size of the convoluted matrix?
20x20
21x21
22x22
25x25
In a simple MLP model with 8 neurons in the input layer, 5 neurons in the hidden layer and 1 neuron in the output layer. What is the size of the weight matrices between hidden output layer and input hidden layer?
[1 X 5] , [5 X 8]
[5 x 1] , [8 X 5]
[8 X 5] , [5 X 1]
[8 X 5] , [ 1 X 5]
Which of the following functions can be used as an activation function in the output layer if we wish to predict the probabilities of n classes (p1, p2..pk) such that sum of p over all n equals to 1?
Softmax
ReLu
Sigmoid
Tanh
Assume a simple MLP model with 3 neurons and inputs= 1,2,3. The weights to the input neurons are 4,5 and 6 respectively. Assume the activation function is a linear constant value of 3. What will be the output ?
32
64
96
128
Which of the following would have a constant input in each epoch of training a Deep Learning model?
Weight between input and hidden layer
Weight between hidden and output layer
Biases of all hidden layer neurons
Activation function of output layer
Sentiment analysis using Deep Learning is a many-to one prediction task
True
False
Can be true or false
Can not say
RNNs stands for?
Recurrent Neural Networks
Report Neural Networks
Receives Neural Networks
Recording Neural Networks
Output of sigmoid function has the range from:
0 to 1
-1 to 1
-1 to 0
0 to 9
Output of tanh function has the range from:
0 to 1
-1 to 1
-1 to 0
0 to 9
The Deep Learning first layer is called the?
hidden layer
output layer
input layer
None of the above
LSTM stands for?
Linear short-term memory
Long short-term memory
Linear Static-technology memory
Linear Sematic-Technology Memory
Assume that your machine has a large enough RAM dedicated to training neural networks. Compared to using stochastic gradient descent for your optimization, choosing a batch size that fits your RAM will lead to:
a more precise but slower update
a less precise but faster update
a less precise and slower update
a more precise and faster update
Which of the following methods DOES NOT prevent a model from overfitting to the training set?
Dropout
Pooling
Early stopping
Data augmentation
What is back propagation?
It is another name given to the curvy function in the perceptron
It is the transmission of error back through the network to adjust the inputs
It is the transmission of error back through the network to allow weights to be adjusted so that the network can learn
None of the mentioned
Supervised learning and unsupervised clustering both require at least one
hidden attribute
output attribute
input attribute
categorical attribute
Supervised learning differs from unsupervised clustering in that supervised learning requires
at least one input attribute
input attributes to be categorical
at least one output attribute
output attributes to be categorical
Another name for an output attribute
predictive variable
independent variable
estimated variable
dependent variable
Assume that we have a dataset containing information about 200 individuals. One hundred of these individuals have purchased life insurance. A supervised data mining session has discovered the following rule:
IF age < 30 & credit card insurance = yes THEN life insurance = yes
Rule Accuracy: 70%
Rule Coverage: 63%
How many individuals in the class life insurance= no have credit card insurance and
are less than 30 years old?
63
70
30
18
Which statement is true about neural network and linear regression models?
Both models require input attributes to be numeric
Both models require numeric attributes to range between 0 and 1
The output of both models is a categorical attribute value
Both techniques build models whose output is determined by a linear sum of weighted input attribute values.
More than one of a,b,c or d is true.
Unlike traditional production rules, association rules
allow the same variable to be an input attribute in one rule and an output attribute in another rule
allow more than one input attribute in a single rule
require input attributes to take on numeric values
require each rule to have exactly one categorical output attribute
. Which of the following is a common use of unsupervised clustering?
detect outliers
determine a best set of input attributes for supervised learning
evaluate the likely performance of a supervised learning model
determine if meaningful relationships can be found in a dataset
All of a,b,c, and d are common uses of unsupervised clustering
The average positive difference between computed and desired outcome values
root mean squared error
mean squared error
mean absolute error
mean positive error
Given desired class Cand population P, lift is defined as
the probability of class C given population P divided by the probability of C given a sample taken from the population
the probability of population P given a sample taken from P
the probability of class C given a sample taken from population P
the probability of class C given a sample taken from population P divided by the probability of C within the entire population P
Deep learning works well despite of problem(s).
High capacity (Susceptible to overfitting)
Numerical instability (vanishing/exploding gradient)
Sharp minima
All of the above
An average human brain has around neurons(aprox)
102
1011
1010
None of the above
Which of the following statements is true for the Perceptron Learning Algorithm?
Statement I: Threshold needs to be hand coded
Statement II: Threshold can be learnt
I & II
I
II
None of these
Which kind of optimisation is required in 2-class linear SVM training procedure?
Linear
Qudratic
Cubic
Depends on dimension of the data
The distance of a feature vector [2, 3, -2] from separating plane x1+2x2+2x3+5=0 is given
by
5
3/13
3
13
For the separable data with D-dimensional feature vectors, K classes and a total of N examples, how many unknown variables are to be estimated in SVM training to get a separating plane 'which maximizes margin? How many constraints?
D variables, N constraints
(D+1) variables, N constraints
D variables, K constraints
(D+1) Variables, K constraints
The values of Lagrange multipliers corresponding to the support vectors can be:
Less than zero
Greater than zero
Any real number
Any real non-zero number
A data point with 5 dimensions [27,40, -15,30,38] obtain a score [18, 20, -5, -15,19].
Find the Hinge loss incurred by second class (class 2) with a margin of 5 is given by:
37
7
3
120
One form of sigmoid function logistic function
True
False
In sigmoid (logistic) function when WTX=0, then sigmoid value is equal to
0
1
∞
0.5
In logistic function, when we increase the value of „w‟, the function becomes
Step function
Sigmoid function
Quadratic function
None of these
Which parameter(s) need to be learnt in minimizing objective function in supervised learning?
Only Weight
Only Bias
Both Weight and Bias
Learning rate
None of these
Why convolution neural network is taking off quickly in recent times
Access to large amount of digitized data
Integration of feature extraction within the training process
Availability of more computational power
All of the above
Momentum based gradient descent algorithm and Nesterov accelerated gradient descent are faster
than Stochastic gradient descent algorithm
True
False
Consider the following statement, “It takes less time to navigate the regions having a gentle slope”
The above statement is true in case of
I. Gradient descent algorithm
II. Momentum based gradient descent algorithm
I
II
II & I
Identify the technique that is used to achieve relatively better learning rate by updating w using
bunch of different values of η.
Bias Correction
Line Search
Stochastic
All the above
There is no guarantee that the loss decreases at each step in a stochastic Gradient Descent”
True
False
Identify the advantages of Nesterov accelerated gradient descent.
I. Corrects its course quicker than Momentum-based gradient descent
II. Oscillations are smaller
III. Chances of escaping minima valley are also smaller
I
Only II
II and III
I, II and III
Pick out the methods for annealing learning rate that has only number of epochs as the hyperparameter
Step decay
Exponential Decay
1/t Decay
Adagrad got stuck when it was close to convergence. How does RMSProp overcome this problem?
More Aggressive on decay
Less Aggressive on decay
No decay
Which of the following gradient descent algorithm suffers from more oscillations?
Momentum based gradient descent
Nesterov accelerated gradient descent
Vanilla gradient descent
None of the above
In a neural network, knowing the weight and bias of each neuron is the most important step. If you
can somehow get the correct value of weight and bias for each neuron, you can approximate any
function. What would be the best way to approach this?
Assign random values and pray to God they are correct
Search every possible combination of weights and biases till you get the best value
Iteratively check that after assigning a value how far you are from the best values, and slightly change the assigned values values to make them better
None of these
What are the steps for using a gradient descent algorithm?
1. Calculate error between the actual value and the predicted value
2. Reiterate until you find the best weights of network
3. Pass an input through the network and get values from output layer
4. Initialize random weight and bias
5. Go to each neurons which contributes to the error and change its respective
values to reduce the error
1, 2, 3, 4, 5
5, 4, 3, 2, 1
3, 2, 1, 5, 4
4, 3, 1, 5, 2
..“Convolutional Neural Networks can perform various types of transformation (rotations or
scaling) in an input”. Is the statement correct True or False?
True
False
Which of the following techniques perform similar operations as dropout in a neural network?
Bagging
Boosting
Stacking
Noe of these
Which of the following gives non-linearity to a neural network?
Stochastic Gradient Descent
Rectified Linear Unit
Convolution function
None of the above
If you increase the number of hidden layers in a Multi Layer Perceptron, the classification error of
test data always decreases. True or False?
True
False
Which of the following is true about model capacity (where model capacity means the ability of
neural network to approximate complex functions) ?
As number of hidden layers increase, model capacity increases
As dropout ratio increases, model capacity increases
As learning rate increases, model capacity increases
None of these
If you increase the number of hidden layers in a Multi Layer Perceptron, the classification error of
test data always decreases. True or False?
True
False
Can a neural network model the function (y=1/x)?
Yes
No
In which neural net architecture, does weight sharing occur?
Convolutional neural Network
Recurrent Neural Network
Fully Connected Neural Network
Both A and B
Batch Normalization is helpful because
It normalizes (changes) all the input before sending it to the next layer
It returns back the normalized mean and standard deviation of weights
It is a very efficient backpropagation technique
None of these
Instead of trying to achieve absolute zero error, we set a metric called bayes error which is the
error we hope to achieve. What could be the reason for using bayes error?
Input variables may not contain complete information about the output variable
System (that creates input-output mapping) may be stochastic
Limited training data
All the above
The number of neurons in the output layer should match the number of classes (Where the number
of classes is greater than 2) in a supervised learning task. True or False?
True
False
What is the purpose of Gradient Descent algorithm?
To normalize the input
To minimize the weight and bias
To minimize the loss function
To prevent overfitting
Which is true for neural networks?
It has set of nodes and connections
Each node computes it's weighted input
Node could be in excited state or non-excited state
All of the mentioned
What is a dead unit in a neural network?
A unit which doesn’t update during training by any of its neighbour
A unit which does not respond completely to any of the training patterns
The unit which produces the biggest sum-squared error
None of these
Which of the following statement is the best description of early stopping?
Train the network until a local minimum in the error function is reached
Simulate the network on a test dataset after every epoch of training. Stop training when the generalization error starts to increase
Add a momentum term to the weight update in the Generalized Delta Rule, so that raining converges more quickly
A faster version of backpropagation, such as the `Quickprop‟ algorithm
What if we use a learning rate that’s too large?
Network will converge
Network will not converge
Can‟t Say
Which gradient technique is more advantageous when the data is too big to handle in RAM simultaneously?
Full Batch Gradient Descent
Stochastic Gradient Descent
What are the factors to select the depth of neural network?
1. Type of neural network (eg. MLP, CNN etc)
2. Input data
3. Computation power, i.e. Hardware capabilities and software capabilities
4. Learning Rate
5. The output function to map
1, 2, 4, 5
2, 3, 4, 5
1, 3, 4, 5
All of these
Consider the scenario. The problem you are trying to solve has a small amount of data. Fortunately, you have a pre-trained neural network that was trained on a similar problem. Which of the following methodologies would you choose to make use of this pre-trained network?
Re-train the model for the new dataset
Assess on every layer how the model performs and only select a few of them
Fine tune the last couple of layers only
Freeze all the layers except the last, re-train the last layer
Increase in size of a convolutional kernel would necessarily increase the performance of a
convolutional network
True
False
Which kind of activation function is typical for a convolution layer in an RNN
Gaussian
Sigmoid
Hyperbolic Tangent
ReLU
Which of the following method use arithmetic operation in evaluation of word representation?
Semantic relatedness
Synonym detection
Semantic analogy
None of the above
Which of the following model directly learn word representations?
Prediction based model
Count based model
Both prediction and count based model
None of these
Which of the following is correct in word representation model?
I. In continuous bag of word model, the softmax function is computationally
expensive.
II. In continuous bag of word model, the softmax function is computationally
inexpensive.
III. In Skip-gram model, the softmax function is computationally inexpensive.
IV. In Skip-gram model, the softmax function is computationally expensive
I only
II & III
III only
I & IV
Which of the following solution constructs a binary tree in learning word representation using prediction- based models?
Use negative sampling
Use contrastive estimation
Use hierarchical softmax
None of these
Which of the following method(s) use dot product in the evaluation of word representation?
I. Semantic relatedness
II. Synonym detection
III. Semantic analogy
I & II
III
I, II & III
None of above
If you need to design a model for textual entailment from the text, then which of the following steps will you choose?
I. CNN is used to encode the text
II. CNN is used to decode the text
III. RNN is used to decode the text from the encoding
IV. RNN is used to encode the text.
V. RNN is used to encode the text and decode the text.
IV, II
I, III
V
Noe of these
The problem of generating the sentence given an image can be possibly solved with the encoder decoder architecture
Yes
No
For document classification and summarization, it is important to look at the important sentences
and important words. What kind of “attention” mechanism is required for encoding?
Hierarchical
Ungraded
Sequential
Unordered
48 filters of size 21 x 21 is applied to an image of size 327 x 327, with zero padding and stride of 3. The image is an RGB image. The depth of the filter is same as the depth of image. What will be the volume of the final image?
103 x 103 x 3
103 x 103 x 48
327 x 327 x 3
327 x 327 x 48
While reconstructing images from embeddings, if we consider deeper layers of the network, how is the image affected?
The reconstructed image is blur
A more realistic copy of the original image is reconstructed
The reconstructed image is sharpened
The reconstructed image becomes abstract
Which of the following is true for content and style of image w.r.t. Deep Art?
Content should match and Style shouldn‟t match
Content shouldn‟t match and Style should match
Both Content and Style should match
Both Content and Style shouldn‟t match
It is very easy to fool a CNN. Which of the following statements doesn‟t support the above argument?
The CNN draws very stringent/strict boundaries for classification
The decision boundaries are loosely drawn
The input dimension for a certain class is very very large
None
Which of the following includes major tasks of NLP?
Discourse Analysis
Automatic Summarization
Machine Translation
All of above
Which of the following is used to mapping sentence plan into sentence structure?
Text planning
Sentence planning
Text Realization
None of the Above
Given a sound clip of a person or people speaking, determine the textual representation of the speech
Text-to-speech
Speech-to-text
All of the mentioned
None of the mentioned
