FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
Two banks each run a 99% one-day VaR model and each record 4 exceedances in 250 days. Bank A's exceedance losses beyond VaR average 1.1 times VaR, while Bank B's average 3.5 times VaR. Bank B's VaR is also more than double Bank A's in the same portfolio. Which conclusion is best supported by exceedance-based backtesting alone?
Exceedance-based backtesting gives both banks the same result because each has four exceedances. It ignores breach magnitude and the level of VaR, so it cannot distinguish a model with mild tail losses from one with severe tail losses. Other tools like expected shortfall or distribution-based tests are needed.
- ABank B's model is riskier because its breaches are larger
- BBank A's model is better because its VaR is lower
- CThe two models are indistinguishable in terms of the backtest result, even though their tail risk and conservatism differ materiallyCorrect
- DBank B's model should be rejected and Bank A's accepted
Explanation
Both have 4 exceedances, so the binomial result is identical and a binary test gives the same verdict. Neither the breach magnitudes nor the VaR level enter the test. Tail severity and conservatism need loss-magnitude measures such as expected shortfall backtests or tests on the full distribution.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A validator applies the Kolmogorov-Smirnov (KS) test to 250 PIT values from a bank's VaR model. Which statement best describes the KS test s…
- Over a sample, Model A's average quantile score is 2.10 and Model B's is 2.35, with lower being better. The Diebold-Mariano style test on th…
- A risk analyst evaluates a bank's daily VaR model using the probability integral transform (PIT). For each day, the analyst computes the mod…
- A validator wants to address the weakness that exceedance-based tests ignore the full predicted distribution. Which approach most directly r…
- A risk team wants to assess a 99% VaR model using only 250 daily observations. The expected number of exceedances is 2.5. Which is the main …
- Compared with a simple exceedance-based backtest at 99% confidence, what is the main advantage of the Berkowitz test for a validator?