FRM Part II · FRM Exam Part II · The Financial Stability Implications of Artificial Intelligence
A risk manager at an asset manager reviews an AI trading model whose training data covers only 2012-2021, a period of low inflation and low interest rates. The model performs well in backtests but degrades sharply when inflation spikes. Which model risk issue does this best illustrate?
The model has overfit to a narrow low-inflation, low-rate regime, so it generalises poorly when conditions change. Strong backtest results reflect the training period, not robustness, which is why validation should include out-of-sample and stressed scenarios.
- AOverfitting to a limited data regime, so the model generalises poorly to unseen conditionsCorrect
- BModel drift caused by improved data quality over time
- CLook-ahead bias caused by using future prices in the training sample
- DExcessive explainability that makes the model easy to game
Explanation
Training on a narrow regime produces a model that fits that regime but fails out of sample under different conditions, which is a limited-data or overfitting problem. Look-ahead bias would inflate backtests through use of future data, which the scenario does not describe. Data quality did not improve; it was unrepresentative.
Did you get it right without looking?
One question tells you little. A timed set on The Financial Stability Implications of Artificial Intelligence shows your real accuracy, how long you take and where you lose marks.
More The Financial Stability Implications of Artificial Intelligence questions
- A bank's board wants governance over its growing use of AI models in lending, trading and fraud detection. Which approach is most consistent…
- The FSB report notes that monitoring AI-related vulnerabilities is complicated by AI's rapid evolution. Which approach is most consistent wi…
- A mid-sized bank builds its credit-decisioning and fraud-detection tools on foundation models supplied by two AI vendors. Which of the follo…
- A regional bank is designing controls for its reliance on an external AI vendor for fraud detection. Which control best addresses the concer…
- A financial stability authority wants early warning of AI-related vulnerabilities in the financial system. Consistent with the FSB's Novembe…
- Ten banks each use one of two foundation model providers for trading signals: 8 banks use Provider X and 2 use Provider Y. A flaw in Provide…