FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
A risk team wants to assess a 99% VaR model using only 250 daily observations. The expected number of exceedances is 2.5. Which is the main statistical limitation of exceedance-based backtesting at this confidence level and sample size?
With only about 2.5 expected exceedances in 250 days at 99%, the test has low statistical power. A misspecified model can easily show an acceptable count, and a good model can breach by chance, so exceedance counts give weak evidence about model quality.
- AExceedances are too frequent to be informative
- BThe test has low power: with so few expected exceedances, an inaccurate model can easily pass and a sound one can fail by chanceCorrect
- CThe test overstates the number of expected exceedances because of fat tails
- DThe test cannot be applied unless returns are normal
Explanation
At 99% over 250 days only about 2.5 exceedances are expected, so one or two extra or fewer observations change the conclusion. This gives low power to distinguish good from bad models. Exceedances are rare, not frequent, and the binomial test does not need normal returns.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A risk manager wants to backtest a bank's full predictive VaR distribution rather than only counting exceedances. She converts each day's re…
- Two banks each report 99% one-day VaR of USD 10 million and each records exactly 3 exceptions in 250 days. Bank A's exception losses average…
- For a 95% VaR forecast, a quantile score is defined as S = (1{L > VaR} - 0.05)... applied as a loss: if realized loss L is at most VaR, pena…
- In the Berkowitz test, PIT values are transformed with the inverse standard normal CDF to give z_t. The z_t are modeled as z_t - mu = rho(z_…
- A bank's trading desk model forecasts P&L as normal with a standard deviation of 2 million. Over 250 days, a histogram of PIT values shows a…
- A scoring function is described as 'strictly consistent' for the 99% quantile. What does this property guarantee?