FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
A bank backtests its 97.5% one-day VaR and ES. Over a test sample, VaR was exceeded on five days. The realised losses on those days exceeded VaR by: day 1 loss 12 vs VaR 10; day 2 loss 14 vs VaR 10; day 3 loss 11 vs VaR 10; day 4 loss 17 vs VaR 10; day 5 loss 16 vs VaR 10 (all USD millions). The model's average forecast ES on those days was USD 13 million. What is the average realised loss on exceedance days, and how does it compare with forecast ES?
The average realised loss on the five exceedance days is 70/5 = USD 14 million, which is above the forecast ES of USD 13 million. This suggests the model underestimates tail severity, so ES appears understated, which is directly relevant to ES calibration.
- AUSD 14 million, above forecast ES, suggesting ES is underestimatedCorrect
- BUSD 13 million, equal to forecast ES, suggesting no ES misspecification
- CUSD 4 million, below forecast ES, suggesting ES is overestimated
- DUSD 14 million, above forecast ES, but this is irrelevant to ES calibration
Explanation
Average loss = (12+14+11+17+16)/5 = 70/5 = 14. This exceeds the forecast ES of 13, which indicates the tail severity is underestimated. USD 4 million is the average excess over VaR (20/5), not the loss itself, and the realised average tail loss is directly relevant to ES calibration.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A validator applies the Kolmogorov-Smirnov (KS) test to 250 PIT values from a bank's VaR model. Which statement best describes the KS test s…
- Over a sample, Model A's average quantile score is 2.10 and Model B's is 2.35, with lower being better. The Diebold-Mariano style test on th…
- Using the Berkowitz approach, an analyst fits z_t = μ + ρ z_(t-1) + σ ε_t to transformed PIT values and gets a log-likelihood of -310.0 for …
- A risk analyst evaluates a bank's daily VaR model using the probability integral transform (PIT). For each day, the analyst computes the mod…
- A risk team wants to assess a 99% VaR model using only 250 daily observations. The expected number of exceedances is 2.5. Which is the main …
- Compared with a simple exceedance-based backtest at 99% confidence, what is the main advantage of the Berkowitz test for a validator?