FRM Part I · FRM Exam Part I · Machine-Learning Methods
A LASSO model minimizes the sum of squared residuals plus lambda times the sum of absolute coefficients. A model has coefficients 2.0, -1.5, 0.5 and 0 for four predictors. If lambda is increased substantially, which outcome is most likely, all else equal?
A larger lambda shrinks coefficients further and drives more of them exactly to zero, giving a simpler model. In-sample fit worsens because bias rises, while variance falls, which may help out-of-sample performance if the original model overfitted.
- ATraining sum of squared residuals falls and more coefficients become nonzero
- BCoefficients move away from zero and variance increases
- CCoefficients shrink further, more become exactly zero, and in-sample fit worsensCorrect
- DCoefficients are unchanged because lambda only affects the intercept
Explanation
A larger lambda raises the cost of large coefficients, so estimates shrink and small ones reach zero. The model becomes simpler, with higher bias, lower variance, and a higher in-sample sum of squared residuals.
Did you get it right without looking?
One question tells you little. A timed set on Machine-Learning Methods shows your real accuracy, how long you take and where you lose marks.
More Machine-Learning Methods questions
- A bank has transaction records for 200,000 corporate clients with no predefined categories. The risk team applies k-means to group clients w…
- A ridge regression with one standardized predictor and no intercept has the OLS slope estimate of 1.20, where the predictor's sum of squares…
- A risk analyst fits a very flexible machine-learning model to predict loan defaults. The model achieves almost zero error on the training da…
- A data scientist standardizes a feature using the training set, which has a mean of 40 and a standard deviation of 8. A test observation has…
- A model predicting credit losses achieves a training mean squared error of 0.5 and a validation mean squared error of 4.8 on held-out data. …
- A deep neural network for credit scoring achieves very low training error but much higher validation error. Which single action is most dire…