FRM Part II · FRM Exam Part II · Backtesting VaR
A bank backtests a 99% one-day VaR over 500 days and observes 12 exceptions. The expected number is 5. A review finds that the model assumes normal returns, and the exceptions' losses were on average 2.3 times VaR. The risk committee proposes four responses. Which is most consistent with the evidence?
The model underestimates tail risk. Twelve exceptions versus five expected is about 3.15 standard deviations above the mean, which is too many to be chance, and the large exceedances suggest fat tails. Fat-tailed methods such as historical simulation, Student-t or extreme value theory should be considered, along with checking clustering.
- ATreat the model as accurate because 12 is close to 5 given sampling error
- BRecognize that the model underestimates tail risk, and consider fat-tailed approaches such as historical simulation, Student-t or extreme value theory, while also checking clusteringCorrect
- CRaise the confidence level to 99.9% under the same normal assumption, since that will remove the fat-tail problem
- DShorten the horizon to one hour so exceptions become rarer
Explanation
Under the null the count is Binomial(500, 0.01) with mean 5 and standard deviation sqrt(500*0.01*0.99)=2.22. Twelve is (12-5)/2.22 = 3.15 standard deviations above, so it is not just sampling error. Large average exceedances point to a fat-tailed reality, so fat-tailed methods such as EVT or Student-t help. Raising the confidence level under normality still understates tails.
Did you get it right without looking?
One question tells you little. A timed set on Backtesting VaR shows your real accuracy, how long you take and where you lose marks.
More Backtesting VaR questions
- Under the Basel traffic light approach to backtesting a 99% one-day VaR model over the most recent 250 trading days, a bank records 7 except…
- A bank backtests its one-day 99% VaR model using 250 trading days of P&L. Assuming the model is correctly calibrated and exceptions are inde…
- A bank's risk committee asks why the market risk team compares daily trading P&L with the previous day's 99% one-day VaR over a long period.…
- A regulator-style backtest uses 250 daily observations. A bank's model understates risk, so its true exception probability is 3% rather than…
- A desk's 99% one-day VaR is backtested over 250 days with 5 exceptions observed. Using the binomial distribution with p = 1%, which statemen…
- A bank's 95% VaR backtest shows exactly 5% exceptions over a long sample, so the Kupiec test is not rejected. However, the independence test…