FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
A bank has a 99% VaR model that produced zero exceedances in 250 days. Which interpretation is most consistent with the limitations of exceedance-based backtesting?
Zero exceedances against 2.5 expected suggests VaR may be overly conservative, not necessarily accurate. Regulatory-style exceedance tests focus on too many breaches and have low power, so they do little to flag excess conservatism. Further validation using other backtesting methods is warranted.
- AThe model is clearly accurate because zero is below the expected count
- BThe model may be overly conservative, and exceedance counting alone is weak at identifying this because one-sided tests focus on too many breachesCorrect
- CThe model must be rejected because zero exceedances is impossible
- DThe model has perfect tail coverage and needs no further validation
Explanation
Expected exceedances are 2.5, so zero suggests VaR may be set too high, tying up excess capital. Regulatory traffic-light style approaches penalize only too many exceedances, and low power means zero is not proof of accuracy. Additional validation is warranted.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A risk manager has PIT values u_t from a VaR model and wants to test the full distribution rather than just tail exceedances. She transforms…
- When using a scoring function to compare competing VaR forecasts, which property makes a scoring function 'strictly consistent' for the quan…
- A risk analyst evaluates a bank's daily 99% VaR model using the probability integral transform (PIT). For each day, she computes the value o…
- Two models forecast 97.5% ES for a portfolio. Model A and Model B both pass a standard exceedance-count test on VaR at 97.5%. Over the sampl…
- A risk manager wants to test whether a bank's daily trading P&L is consistent with the full predictive distribution produced by its VaR mode…
- A bank's two VaR models both pass the Kupiec unconditional coverage test at 99%, each with 2 or 3 exceedances in 250 days. A validator wants…