FRM Part II · FRM Exam Part II · Case Study: Model Risk and Model Validation
A bank's VaR model has been backtested over 250 days at 99% confidence and produced 9 exceptions. Validators conclude the model is likely underestimating risk. Which is the most appropriate model-risk mitigation response?
The bank should investigate the causes, recalibrate or redevelop the model, and apply a conservative overlay or add-on meanwhile. Nine exceptions against about 2.5 expected indicates underestimation, and changing the confidence level or deleting exception days would merely mask the weakness.
- ADocument the exceptions and continue using the model unchanged since 9 is close to 2.5
- BInvestigate the causes of exceptions, recalibrate or redevelop the model, and apply a conservative overlay or capital add-on until it is fixedCorrect
- CChange the confidence level to 95% so exceptions fall
- DRemove the days with exceptions from the backtest sample
Explanation
At 99% over 250 days about 2.5 exceptions are expected; 9 is well above and signals inadequacy. Appropriate action is root-cause analysis, remediation and interim conservatism. Lowering the confidence level or deleting exception days only hides the problem.
Did you get it right without looking?
One question tells you little. A timed set on Case Study: Model Risk and Model Validation shows your real accuracy, how long you take and where you lose marks.
More Case Study: Model Risk and Model Validation questions
- During ongoing monitoring, a bank finds that the population stability index for a key input variable of its probability-of-default model has…
- A validator wants to test whether a credit risk model's performance deteriorates when applied to a borrower segment not represented in the d…
- A bank's credit-scoring model was developed by the retail risk team. The same team lead also performs the annual validation to save cost. Wh…
- A bank uses a vendor-supplied option pricing model whose code is proprietary and not disclosed. Which approach is most consistent with SR 11…
- Long-Term Capital Management (LTCM) relied on VaR estimates calibrated on a few years of historical data when it held highly leveraged conve…
- Validators find that a bank's loan loss model was tuned so closely to the development sample that it fits historical noise and performs poor…