FRM Part I · FRM Exam Part I · Machine-Learning Methods
A risk team chooses the penalty parameter lambda for an elastic net model used to predict loan defaults. Which procedure is most appropriate?
Lambda should be chosen by cross-validation, picking the value with the best validation performance. In-sample error always favors a near-zero penalty and overfitting, while cross-validation estimates out-of-sample error and balances bias and variance in the elastic net.
- AChoose lambda that minimizes in-sample error on the full training set
- BChoose lambda by cross-validation, selecting the value with the best validation performanceCorrect
- CSet lambda to zero to maximize flexibility
- DChoose the largest lambda so all coefficients equal zero
Explanation
Lambda is a hyperparameter not estimated by the penalized fit itself. Minimizing in-sample error would always choose lambda near zero and overfit. Cross-validation estimates out-of-sample performance for each lambda, so the best validation value is chosen.
Did you get it right without looking?
One question tells you little. A timed set on Machine-Learning Methods shows your real accuracy, how long you take and where you lose marks.
More Machine-Learning Methods questions
- A hidden node in a neural network receives three inputs x1 = 2, x2 = -1 and x3 = 3 with weights 0.5, 2.0 and -0.4 respectively, and a bias o…
- Using the confusion matrix of 30 TP, 10 FP, 20 FN and 140 TN from a default classifier at a 0.5 threshold, the bank lowers the cutoff to 0.3…
- A K-nearest neighbors classifier predicts whether a firm will default using two features: leverage (ratio, range 0 to 5) and market capitali…
- A analyst compares penalized regressions on a data set with many correlated predictors, some of which are believed to be irrelevant. She wan…
- A node in a classification tree holds 40 observations: 30 non-defaults and 10 defaults. Using the Gini impurity, 1 minus the sum of squared …
- A risk manager lowers the probability threshold at which a logistic model classifies a borrower as a defaulter, from 0.50 to 0.30. Which out…