FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
Two banks each report 3 exceedances of their 99% one-day VaR over 250 days. Bank A's exceedance losses average 1.1 times VaR; Bank B's average 4 times VaR. Under an exceedance-only backtest, which conclusion is correct?
Both banks look identical to an exceedance-only backtest because it records just a count of three. Bank B's much larger losses beyond VaR signal a heavier tail, which only magnitude-sensitive methods such as expected shortfall comparisons would reveal.
- ABoth banks are indistinguishable, although Bank B's model likely has a far heavier unmodelled tailCorrect
- BBank B fails the test because its losses are larger
- CBank A fails the test because its exceedances are closer to VaR
- DBank B passes while Bank A fails since magnitude is weighted inversely
Explanation
The exceedance test uses a binary indicator, so both banks show 3 exceedances and receive identical results. Magnitude information, such as the expected shortfall or loss-severity comparison, would reveal Bank B's heavier tail. Hence the test cannot discriminate between them.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A bank has a 99% one-day VaR backtest with only 100 observations. The model shows 0 exceptions. A validator says the low power of exceedance…
- A validator applies the Kolmogorov-Smirnov (KS) test to 250 PIT values from a bank's VaR model. Which statement best describes the KS test s…
- Over a sample, Model A's average quantile score is 2.10 and Model B's is 2.35, with lower being better. The Diebold-Mariano style test on th…
- A risk analyst evaluates a bank's daily VaR model using the probability integral transform (PIT). For each day, the analyst computes the mod…
- A risk team wants to assess a 99% VaR model using only 250 daily observations. The expected number of exceedances is 2.5. Which is the main …
- Compared with a simple exceedance-based backtest at 99% confidence, what is the main advantage of the Berkowitz test for a validator?