FRM Part I · FRM Exam Part I · Machine Learning and Prediction
Which feature of a random forest distinguishes it from plain bagging of decision trees?
A random forest considers only a random subset of predictors at each split, which decorrelates the trees and lowers the variance of the averaged prediction. Bootstrap sampling is shared with plain bagging, and sequential residual fitting describes boosting rather than random forests.
- AEach tree is trained on a bootstrap sample of the observations
- BAt each split only a random subset of predictors is considered, which decorrelates the treesCorrect
- CTrees are grown sequentially, each fitting the residuals of the previous one
- DPredictions are combined by weighting trees according to training error
Explanation
Both bagging and random forests use bootstrap samples. A random forest additionally restricts each split to a random subset of predictors, reducing correlation among trees and so the variance of the averaged prediction. Sequential residual fitting describes boosting.
Did you get it right without looking?
One question tells you little. A timed set on Machine Learning and Prediction shows your real accuracy, how long you take and where you lose marks.
More Machine Learning and Prediction questions
- A risk analyst at a bank has a historical dataset of 20,000 consumer loans. Each record contains borrower characteristics and a label showin…
- Which statement correctly contrasts agglomerative hierarchical clustering with K-means?
- A data scientist has 5,000 observations and wants to select among several models and then report an unbiased estimate of final performance. …
- An analyst runs PCA on three unstandardized variables whose variances are 100, 4 and 1, with small covariances between them. The analyst not…
- A single-output neural network uses squared-error loss L = 0.5(y - ŷ)², where ŷ = w·x with no activation and no bias. For one observation, x…
- Two variables are standardized and have a correlation of 0.60. What are the eigenvalues of their correlation matrix, and what proportion of …