FRM Part II · FRM Exam Part II · Advances in Artificial Intelligence: Implications for Capital Markets Activities
A risk analyst at an asset manager builds a supervised machine learning model to predict next-month default of corporate bonds. The model achieves near-perfect accuracy on the training data but performs poorly on a hold-out sample from a later period. Which diagnosis is most consistent with this pattern?
The pattern indicates overfitting. The model has memorized noise in the training data, so it scores almost perfectly in-sample but fails to generalize to a later hold-out sample. Underfitting would produce weak results in both samples, and leakage would flatter hold-out performance.
- AOverfitting, because the model has fitted noise specific to the training data and does not generalizeCorrect
- BUnderfitting, because the model is too simple to capture patterns in the training data
- CData leakage from the hold-out sample into the training set, which would inflate hold-out performance
- DMulticollinearity among inputs, which would reduce training accuracy
Explanation
Very high in-sample accuracy combined with weak out-of-sample performance is the classic sign of overfitting. Underfitting would show poor performance in both samples. Leakage from the hold-out into training would make hold-out results look better, not worse.
Did you get it right without looking?
One question tells you little. A timed set on Advances in Artificial Intelligence: Implications for Capital Markets Activities shows your real accuracy, how long you take and where you lose marks.
More Advances in Artificial Intelligence: Implications for Capital Markets Activities questions
- A bank's trading desk uses a third-party AI model whose internal logic is not disclosed by the vendor. The model risk team is concerned abou…
- A risk manager reviews an AI model that screens equity trades using alternative data (social media sentiment) supplied by a vendor. Which da…
- A bank deploys several AI surveillance and trading models that were all fine-tuned from the same third-party foundation model. A risk manage…
- A supervisor is designing a framework to address AI-related financial stability risks. Which combination of measures would most directly add…
- A regulator observes that many asset managers and banks rely on the same small group of providers for foundation models and cloud computing …
- Which practice best addresses explainability and model risk when a firm adopts a complex AI model for a capital markets function?