FRM Part I · FRM Exam Part I · Machine Learning and Prediction
Compared with a regression using all original predictors, a principal components regression (PCR) that uses the first few components has which main drawback?
The key drawback is that components are chosen by the variance they explain in the predictors, without regard to the target, so the retained components may not be the most predictive. Components are uncorrelated, not collinear, and PCR typically reduces variance.
- AThe leading components are chosen without reference to the target, so they may not be the most predictiveCorrect
- BThe components are perfectly collinear with each other
- CIt always has higher variance than the full regression
- DIt requires the number of components to exceed the number of variables
Explanation
PCA is unsupervised: components are ranked by variance explained in the predictors, not by relevance to the target. A low-variance component can still be highly predictive and be discarded. Components are orthogonal, not collinear, and the number of components cannot exceed the number of variables.
Did you get it right without looking?
One question tells you little. A timed set on Machine Learning and Prediction shows your real accuracy, how long you take and where you lose marks.
More Machine Learning and Prediction questions
- In training a deep neural network, what is the purpose of the backpropagation algorithm?
- A confusion matrix for a credit model on 1,000 borrowers shows: true positives 60, false positives 40, false negatives 20, true negatives 88…
- In a K-means run with K = 2, five one-dimensional observations are 1, 2, 4, 9 and 10. The initial centroids are 2 and 9. After assigning eac…
- Which task is best classified as a supervised learning regression problem rather than classification?
- An analyst applies principal components analysis (PCA) to a set of highly correlated predictors before fitting a prediction model. Which sta…
- A data scientist fits a model with very low training error but much higher error on a held-out validation set. Which is the most appropriate…