FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
Two models forecast 97.5% ES for a portfolio. Model A and Model B both pass a standard exceedance-count test on VaR at 97.5%. Over the sample, Model A's realized average tail loss equals its forecast ES, while Model B's realized average tail loss is 25% above its forecast ES. Which conclusion is best supported?
Model B understates tail severity even though its VaR exceedance frequency is acceptable. Exceedance counts ignore the magnitude of losses beyond VaR, so ES backtesting that compares realized tail losses with forecast ES reveals the shortfall that the frequency test misses.
- ABoth models are equally adequate because they pass the VaR exceedance test
- BModel B should be preferred because its higher tail loss indicates conservative VaR
- CModel B understates tail severity despite adequate exceedance frequency, showing that exceedance counts do not capture the size of tail lossesCorrect
- DModel A is rejected because ES equal to realized loss implies overfitting
Explanation
Exceedance tests examine only how often VaR is breached, not how large the losses beyond VaR are. Model B's realized tail loss exceeds forecast ES by 25%, so its ES is underestimated. Model A's tail loss matching ES is the desired result, not overfitting.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A risk manager compares two competing 99% VaR models using a quantile (pinball) scoring function applied to realised losses over a long samp…
- Two banks each report 3 exceedances of their 99% one-day VaR over 250 days. Bank A's exceedance losses average 1.1 times VaR; Bank B's avera…
- A risk analyst notes that Value-at-Risk (VaR) is elicitable, whereas Expected Shortfall (ES) is not elicitable on its own. Which statement b…
- A bank's VaR model tends to misstate the extreme tail of losses while fitting the central part of the distribution well. The validation team…
- A validator finds that a bank's VaR model passes the Kolmogorov-Smirnov test on its PIT values, but she suspects the model misstates extreme…
- A bank backtests its 97.5% one-day ES model using a joint approach in which ES is treated as elicitable together with VaR. Which description…