FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
A bank's 250 daily PIT values are transformed to z_t = Φ^-1(u_t). The sample mean of z_t is 0, the sample standard deviation is 1.40, and the lag-1 autocorrelation is near zero. Which conclusion is best supported, and what is the approximate ratio of the model's predicted standard deviation to the realized dispersion?
The model understates risk. Correct forecasts produce transformed PIT values with standard deviation 1, but the observed 1.40 shows realized outcomes are more dispersed than predicted. The predicted spread is roughly 1/1.40, about 0.71, of the realized spread, despite zero mean and no autocorrelation.
- ARisk is understated; the predicted spread is about 0.71 (1/1.40) of the realized spreadCorrect
- BRisk is overstated; the predicted spread is about 1.40 times the realized spread
- CRisk is understated; the predicted spread is about 1.40 times the realized spread
- DThe model is acceptable because the mean and autocorrelation are zero
Explanation
If the model were right, z_t would have standard deviation 1. A sample value of 1.40 means realized outcomes are more dispersed than predicted, so risk is understated. The predicted-to-realized ratio is 1/1.40 ≈ 0.714. Zero mean and autocorrelation do not offset the variance failure, so the model is not acceptable.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A risk manager wants to backtest a bank's full predictive VaR distribution rather than only counting exceedances. She converts each day's re…
- A risk analyst notes that Value-at-Risk (VaR) can be backtested directly by counting exceedances, but Expected Shortfall (ES) cannot be back…
- Why is backtesting ES generally considered more demanding in data terms than backtesting VaR at the same confidence level?
- Two models A and B are compared over 250 days using average quantile scores at 99%. Model A averages 0.052 and Model B averages 0.047. The d…
- A risk analyst backtests a bank's daily VaR model using the probability integral transform (PIT). For each day, she evaluates the model's fo…
- A risk team reviewing its backtesting framework notes that Expected Shortfall (ES) is not elicitable, whereas VaR is. Which statement best d…