FRM Part I · FRM Exam Part I · Machine Learning and Prediction
A risk analyst fits a linear model to predict loan losses using 60 correlated explanatory variables and only 120 observations. The analyst wants a method that shrinks coefficients toward zero but never sets any coefficient exactly to zero. Which approach fits this requirement?
Ridge regression with an L2 penalty fits the requirement. It shrinks coefficients toward zero by penalizing their squared sum, but with a finite penalty it never sets them exactly to zero. LASSO, using an L1 penalty, can eliminate variables entirely, so it does not meet the stated need.
- ARidge regression with an L2 penaltyCorrect
- BLASSO regression with an L1 penalty
- COrdinary least squares with no penalty
- DBest subset selection
Explanation
Ridge adds a penalty on the sum of squared coefficients (L2). This shrinks coefficients smoothly toward zero but, for a finite penalty, does not set them exactly to zero. LASSO's L1 penalty can set coefficients exactly to zero, so it performs variable selection and does not meet the requirement.
Did you get it right without looking?
One question tells you little. A timed set on Machine Learning and Prediction shows your real accuracy, how long you take and where you lose marks.
More Machine Learning and Prediction questions
- A risk team runs agglomerative hierarchical clustering on five funds using Euclidean distance. The first merge joins Funds A and B, which ar…
- An analyst runs PCA on three unstandardized variables whose variances are 100, 4 and 1, with small covariances between them. The analyst not…
- A single-output neural network uses squared-error loss L = 0.5(y - ŷ)², where ŷ = w·x with no activation and no bias. For one observation, x…
- Two variables are standardized and have a correlation of 0.60. What are the eigenvalues of their correlation matrix, and what proportion of …
- Compared with a regression using all original predictors, a principal components regression (PCR) that uses the first few components has whi…
- A risk team has transaction data for 50,000 corporate clients with no labels. They run k-means to group clients with similar trading behavio…