FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
A risk manager compares two competing 99% VaR models using a quantile (pinball) scoring function applied to realised losses over a long sample. Model A has a lower average score than Model B. Assuming lower scores are better, what is the most appropriate conclusion?
Model A is better. VaR is elicitable, so the quantile scoring function is consistent for it, and a lower average score means better VaR forecasts in expectation. Higher scores indicate worse forecasts, and ranking does not require zero exceedances.
- AModel A provides better VaR forecasts in terms of that scoring functionCorrect
- BModel B is better because the higher score shows greater conservatism
- CNeither can be ranked, because VaR is not elicitable
- DThe scores can rank models only if both have zero exceedances
Explanation
Because VaR is elicitable, the quantile scoring function is consistent, so a lower average score indicates a better forecast in expectation. Higher scores are worse, not more conservative in a favourable sense. Zero exceedances are not required.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- Two banks each report 3 exceedances of their 99% one-day VaR over 250 days. Bank A's exceedance losses average 1.1 times VaR; Bank B's avera…
- A risk analyst notes that Value-at-Risk (VaR) is elicitable, whereas Expected Shortfall (ES) is not elicitable on its own. Which statement b…
- A bank's VaR model tends to misstate the extreme tail of losses while fitting the central part of the distribution well. The validation team…
- An analyst compares two VaR models using average quantile scores over 500 days and finds Model X has a lower (better) average score than Mod…
- A validator finds that a bank's VaR model passes the Kolmogorov-Smirnov test on its PIT values, but she suspects the model misstates extreme…
- A bank backtests its 97.5% one-day ES model using a joint approach in which ES is treated as elicitable together with VaR. Which description…