Articial Neural Networks & Deep Learning

A neural network trained with labelled data is an example of . . .

• supervised learning

• unsupervised learning

In the neural network shown,

• each neuron is connected to a random selection of other neurons in the network

• every neuron is connected to every other neuron in the network

• every neuron is conected to every neuron in the next layer

• each neuron is connected to a random selection of neurons in the next layer

The activation of each neuron in a layer is determined by the __________ of the activations of all the neurons in the previous layer.

• weighted sum

• sum

• level

Which of these equations means:

"Output O is equal to zero if input I is less than zero; or equal to input I if I is greater than or equal to zero"

?

• 
• 

Which of these equations means:

"Output O is always greater than or equal to zero, and less than or equal to 1, whatever the input"

?

• 
• 

Which of these corresponds to the output of a sigmoid activation function used for artificial neural networks?

• 
• 

Which of these corresponds to the output of the ReLu activation function used for Deep Learning networks?

• 
• 

Consider this diagram of a perceptron with an input layer, hidden layer and output layer.

The activations of neurons i1, i2, and i3 of the Input layer are, respectively:

• 0.3, 0.5, -0.5

• 0.4, 0.2, 0.2

Activation of:

i1 = 0.4, i2 = 0.2, i3 = 0.2

Connection weight to h2 from:

i1 = 0.3, i2 = 0.5, i3 = -0.5

What is the activation of h2? _

•