FRM Part I · FRM Exam Part I · Machine Learning and Prediction
A data scientist increases the complexity of a prediction model by adding many more predictors and higher-order terms. Holding the training sample fixed, what is the typical effect on the model's bias and variance of its predictions?
Bias typically falls and variance rises. A more complex model can capture the true relationship more closely, reducing systematic error, but its predictions become more sensitive to the specific training sample, increasing variance. This is the core bias-variance tradeoff.
- ABias increases and variance decreases
- BBias decreases and variance increasesCorrect
- CBoth bias and variance decrease
- DBoth bias and variance increase
Explanation
More flexible models can approximate the true relationship more closely, which lowers bias. However, their fitted predictions become more sensitive to the particular training sample, so variance rises. This is the bias-variance tradeoff.
Did you get it right without looking?
One question tells you little. A timed set on Machine Learning and Prediction shows your real accuracy, how long you take and where you lose marks.
More Machine Learning and Prediction questions
- A risk analyst builds a feedforward neural network to predict loan defaults. Which description best characterizes the role of a hidden layer…
- A risk analyst fits a single, very deep classification tree to predict loan default. It classifies the training data almost perfectly but pe…
- A risk analyst fits a single classification tree to predict loan default and lets it grow until every terminal node contains only one class.…
- An analyst uses a regularized model with a tuning parameter that controls complexity. As the penalty is increased substantially from a very …
- A K-means model is fitted to stocks for K = 1 to 5, producing total within-cluster sum of squares of 500, 220, 100, 90 and 85 respectively. …
- A lender lowers the probability threshold used to classify a borrower as a predicted defaulter, from 0.50 to 0.30, using the same fitted mod…