FRM Part I · FRM Exam Part I · Machine-Learning Methods
A risk team chooses the penalty parameter lambda for an Elastic Net model using k-fold cross-validation. Which description of the procedure and rationale is correct?
Choose the lambda that gives the lowest average error on the held-out validation folds in cross-validation. This approximates out-of-sample performance and balances bias against variance. Minimizing in-sample error would pick no penalty and overfit, while an excessively large lambda would underfit.
- ASelect the lambda that minimizes the in-sample residual sum of squares, since this gives the best fit
- BSelect the lambda with the lowest average validation-fold error, because it estimates out-of-sample performanceCorrect
- CSelect the largest lambda available, because more shrinkage always improves forecasting
- DSelect lambda = 0, because Elastic Net is unbiased only when no penalty is applied and this ensures optimal prediction
Explanation
In-sample RSS is minimized at lambda = 0, which risks overfitting. Cross-validation repeatedly fits on training folds and measures error on held-out folds; the lambda with the lowest average validation error is chosen to balance bias and variance. Too large a lambda causes underfitting.
Did you get it right without looking?
One question tells you little. A timed set on Machine-Learning Methods shows your real accuracy, how long you take and where you lose marks.
More Machine-Learning Methods questions
- A bank compares a neural network with a regularized linear model for predicting corporate defaults using a modest dataset of 800 firms and 1…
- A risk analyst fits a regression of credit spread changes on 40 candidate predictors using only 120 observations. The ordinary least squares…
- A network has 4 inputs, one hidden layer with 5 neurons, and 1 output neuron. Every neuron in a layer is connected to every neuron in the pr…
- A LASSO model minimizes the sum of squared residuals plus lambda times the sum of absolute coefficients. A model has coefficients 2.0, -1.5,…
- A neuron has a sigmoid activation, f(z) = 1/(1+e^(-z)). Its inputs are x1 = 1 and x2 = 3, with weights w1 = 2 and w2 = -1, and bias b = 1. W…
- A risk analyst is building a model to predict loan defaults using features such as annual income (in thousands of dollars, ranging 20 to 500…