FRM Part II · FRM Exam Part II · Advances in Artificial Intelligence: Implications for Capital Markets Activities
A quantitative team at an asset manager trains a gradient-boosted model to predict next-month equity returns. In-sample R-squared is very high, but out-of-sample performance is close to zero. Which diagnosis is most consistent with this pattern?
The pattern points to overfitting. A flexible model fitted noise unique to the training data, so in-sample fit is high but out-of-sample performance collapses. Underfitting would show weak results in both samples, not a large gap between them.
- AUnderfitting, because the model is too simple to capture the signal
- BOverfitting, because the model has learned noise specific to the training sampleCorrect
- CSurvivorship in the loss function, because gradient boosting ignores errors
- DMulticollinearity, because the model has too few predictors
Explanation
A large gap between strong in-sample fit and poor out-of-sample results is the classic sign of overfitting: the flexible model has fitted noise rather than stable relationships. Underfitting would produce poor performance in both samples.
Did you get it right without looking?
One question tells you little. A timed set on Advances in Artificial Intelligence: Implications for Capital Markets Activities shows your real accuracy, how long you take and where you lose marks.
More Advances in Artificial Intelligence: Implications for Capital Markets Activities questions
- A firm adds an L1 (lasso) penalty to a regression-based machine learning model with 200 candidate predictors. Compared with an unpenalized m…
- A trading desk deploys a deep neural network to generate short-term signals. Validators find that the model performs well in backtests but i…
- A trading firm uses a reinforcement-learning algorithm for execution. A risk manager worries that the algorithm could learn behaviour that r…
- A trading firm's AI surveillance model was trained on two calm years of order-book data. During a sudden volatility spike, alert patterns ch…
- A trading desk deploys a deep neural network to generate execution signals. The model performs well in testing, but the risk committee canno…
- A risk manager reviews an AI model that screens equity trades using alternative data (social media sentiment) supplied by a vendor. Which da…