FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
A bank's VaR model passes a standard 99% exceedance-count test over 250 days, with 2 exceedances. A PIT backtest of the same model, however, rejects uniformity because the PIT histogram shows a pronounced excess of values between 0.01 and 0.05 relative to 0.04 expected frequency, and the middle is normal. Which conclusion is best supported?
The PIT test uses the whole forecast distribution, so it can reveal misspecification between the 95% and 99% levels that a 99% exceedance count misses. The excess mass in the 1%-5% band shows losses in that region are underestimated, even though the 99% VaR looks adequate.
- AThe model understates losses beyond the 95% level but within the 99% quantile, a weakness the 99% exceedance count cannot detectCorrect
- BThe exceedance test is wrong and the model must understate the 99% VaR
- CThe PIT test is invalid because it uses the whole distribution rather than one quantile
- DThe model overstates risk at all quantiles because few exceedances occurred
Explanation
Exceedance tests only look at the single 99% quantile, so losses in the 1%-5% tail region are invisible to them. Excess PIT mass between 0.01 and 0.05 means losses in that band occur more often than forecast, so the lower tail is understated short of the 99% VaR. Few exceedances at 99% do not imply a correct tail elsewhere.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A validator finds that a bank's VaR model passes the Kolmogorov-Smirnov test on its PIT values, but she suspects the model misstates extreme…
- A bank backtests its 97.5% one-day ES model using a joint approach in which ES is treated as elicitable together with VaR. Which description…
- A bank backtests 97.5% one-day ES using the tail-loss approach. Over a window, a model forecasts ES of USD 10.0 million each day. On the 5 d…
- A risk manager wants to backtest a bank's full predictive VaR distribution rather than only counting exceedances. She converts each day's re…
- Two banks each report 99% one-day VaR of USD 10 million and each records exactly 3 exceptions in 250 days. Bank A's exception losses average…
- For a 95% VaR forecast, a quantile score is defined as S = (1{L > VaR} - 0.05)... applied as a loss: if realized loss L is at most VaR, pena…