Deep Learning Algorithm

What is the purpose of the activation function in a neural network?

• To initialize weights

• To introduce non-linearity

• To calculate gradients

• To define the learning rate

Which of the following is a common activation function used for binary classification tasks?

• Softmax

• ReLU (Rectified Linear Unit)

• Sigmoid

• Tanh

Which of the following is a hyperparameter in a neural network?

• Weight values

• Learning rate

• Number of training samples

• Number of layers

What is the purpose of the softmax activation function in a neural network output layer for multi-class classification?

• Introduce non-linearity

• Convert raw scores into probabilities

• Prevent overfitting

• Normalize input features

Which type of neural network architecture is commonly used for image classification tasks?

• Recurrent Neural Network (RNN)

• Convolutional Neural Network (CNN)

• Long Short-Term Memory (LSTM)

• None of the above

What is the primary goal of the backpropagation algorithm in training a neural network?

• Initializing weights

• Minimizing the loss function by adjusting weights

• Increasing the learning rate

• Regularizing the model

In the context of deep learning, what does the term "epoch" refer to?

• The number of layers in the neural network

• The number of training examples processed by the algorithm

• The learning rate of the model

• The number of nodes in the output layer