FRM Part II · FRM Exam Part II · Case Study: Model Risk and Model Validation
A validator backtests a 99% one-day VaR model over 250 days and finds 7 exceedances. Under a simple Basel-style traffic-light approach, the yellow zone covers 5 to 9 exceptions. The expected number of exceptions is 2.5. Which conclusion and next step is most appropriate?
Seven exceptions against an expected 2.5 puts the model in the yellow zone. That signals possible risk underestimation without proving the model is flawed, so the validator should investigate causes such as data quality, volatility estimation or fat tails before concluding, rather than accepting or rejecting it outright.
- AGreen zone; accept the model with no action because 7 is close to 2.5
- BRed zone; the model must be rejected immediately and replaced
- CYellow zone; the result suggests possible underestimation, so investigate causes (e.g., data, volatility estimation, fat tails) before concludingCorrect
- DYellow zone; ignore because exceedances only matter above 10
Explanation
Expected exceptions are 250 x 1% = 2.5. Seven falls in the 5-9 yellow zone, which signals possible but not conclusive deficiency, so investigation of root causes is warranted. Green is wrong since 7 exceeds 4; red begins at 10 so immediate rejection is not supported.
Did you get it right without looking?
One question tells you little. A timed set on Case Study: Model Risk and Model Validation shows your real accuracy, how long you take and where you lose marks.
More Case Study: Model Risk and Model Validation questions
- A bank licenses a vendor's proprietary pricing model whose code is not disclosed. According to SR 11-7, what is the most appropriate expecta…
- A risk manager reviewing the London Whale lessons notes that the CIO's VaR model relied on spreadsheets with manual copy-and-paste steps. Wh…
- A validator wants to test whether a credit risk model's performance deteriorates when applied to a borrower segment not represented in the d…
- A bank's credit-scoring model was developed by the retail risk team. The same team lead also performs the annual validation to save cost. Wh…
- A bank uses a vendor-supplied option pricing model whose code is proprietary and not disclosed. Which approach is most consistent with SR 11…
- Long-Term Capital Management (LTCM) relied on VaR estimates calibrated on a few years of historical data when it held highly leveraged conve…