FRM Part II · FRM Exam Part II · Advances in Artificial Intelligence: Implications for Capital Markets Activities
A firm trains a return-forecasting model using data on firms that are still listed today, excluding companies that were delisted or went bankrupt during the sample. Which bias does this introduce, and what is its likely effect?
This is survivorship bias, which tends to overstate model performance. By excluding delisted or bankrupt firms, the training data contains only winners that survived, so historical outcomes look better than a real-time investor would have experienced and the model's apparent skill is inflated.
- ASurvivorship bias, which tends to overstate model performanceCorrect
- BLook-ahead bias, which tends to understate model performance
- CSelection of too many features, which causes underfitting
- DLabel imbalance, which always lowers recall to zero
Explanation
Excluding failed firms leaves only survivors, making historical returns and the model's apparent skill look better than they would have been in real time. Look-ahead bias concerns using information not available at the time, which is a different problem.
Did you get it right without looking?
One question tells you little. A timed set on Advances in Artificial Intelligence: Implications for Capital Markets Activities shows your real accuracy, how long you take and where you lose marks.
More Advances in Artificial Intelligence: Implications for Capital Markets Activities questions
- A market-making desk at a mid-sized dealer deploys a machine learning model to adjust bid-ask quotes in real time based on order flow, inven…
- A bank compares a transparent logistic regression with a deep neural network for a trade surveillance alert system. The neural network has h…
- A firm adds an L1 (lasso) penalty to a regression-based machine learning model with 200 candidate predictors. Compared with an unpenalized m…
- A trading desk deploys a deep neural network to generate short-term signals. Validators find that the model performs well in backtests but i…
- A trading firm uses a reinforcement-learning algorithm for execution. A risk manager worries that the algorithm could learn behaviour that r…
- A trading firm's AI surveillance model was trained on two calm years of order-book data. During a sudden volatility spike, alert patterns ch…