FRM Part II · FRM Exam Part II · Case Study: Model Risk and Model Validation
A risk manager reviewing lessons from LTCM and the London Whale proposes controls. Which proposal best addresses the common model risk lesson from both cases, namely that a model's output was trusted while its assumptions and limits were not effectively challenged?
The best control is independent validation with real authority to challenge assumptions, supplemented by stress and liquidity analysis beyond VaR and escalation when the model conflicts with other risk indicators. Both LTCM and the London Whale involved unchallenged reliance on models that understated risk.
- ALet the business line that uses the model approve any change so that approvals are quick
- BEstablish independent validation with authority to challenge assumptions, require stress and liquidity-adjusted analysis beyond VaR, and escalate when the model understates risk compared with other indicatorsCorrect
- CReplace the VaR measure with a lower confidence level to reduce the frequency of breaches
- DLimit model documentation to the final output so that reviewers focus on results
Explanation
Both cases show a reliance on a single model output. Independent challenge, stress analysis beyond VaR, and escalation of discrepancies address this. Letting the business approve changes, loosening confidence levels or thinning documentation weakens control.
Did you get it right without looking?
One question tells you little. A timed set on Case Study: Model Risk and Model Validation shows your real accuracy, how long you take and where you lose marks.
More Case Study: Model Risk and Model Validation questions
- A validator wants to test whether a credit risk model's performance deteriorates when applied to a borrower segment not represented in the d…
- A bank's credit-scoring model was developed by the retail risk team. The same team lead also performs the annual validation to save cost. Wh…
- A bank uses a vendor-supplied option pricing model whose code is proprietary and not disclosed. Which approach is most consistent with SR 11…
- Long-Term Capital Management (LTCM) relied on VaR estimates calibrated on a few years of historical data when it held highly leveraged conve…
- Validators find that a bank's loan loss model was tuned so closely to the development sample that it fits historical noise and performs poor…
- A bank's mortgage prepayment model has been validated and approved. Over two years, management adds several manual overrides to outputs, the…