WorksheetsIntro to ML: Decision Trees
Total questions: 7
Worksheet time: 7mins
Which system requires more entropy to be described?
Tossing a fair coin
Tossing a biased coin
Is it possible to test the same attribute twice along the same path on a decision tree for a categorical problem?
Yes
No
Is it possible that the same attribute will get selected twice in an ordinal or real-valued problem?
Yes
No
Decision trees are an algorithm for which machine learning task?
Clustering
Classification
Classification and Regression
Dimensionality reduction
Regression
When a tree is significantly deep, what does it indicate?
The samples have a large number of attributes
The dataset is possibly noisy
The tree under-fits the training data
None of these
Which of the following is true:
Deeper trees will always improve performance on the training data
Deeper trees will always improve performance when testing the model on unseen data
If a deeper tree improves performance on the training data, then it will also improve performance on new unseen data
For a binary classification problem with a balanced dataset, if one feature completely determines the class for each observation, what is the information gain from using this feature as the first node in a tree?
0
0.5
1
Not enough information
