FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
In a Berkowitz test, PIT values are transformed with the inverse standard normal CDF to produce z_t. The model is z_t - mu = rho(z_{t-1} - mu) + epsilon_t, with epsilon_t having variance sigma^2. The null hypothesis is mu = 0, sigma^2 = 1, rho = 0. The log-likelihood is -1,000.0 under the unrestricted model and -1,004.2 under the restricted model. Using the likelihood ratio statistic, what is the statistic and the conclusion at 5% significance (chi-square critical values with 3 df: 7.81)?
The likelihood ratio statistic is 2 times the 4.2 difference in log-likelihoods, or 8.4. This exceeds the 5% chi-square critical value of 7.81 with three degrees of freedom, so the model is rejected. Omitting the factor of two would wrongly suggest it passes.
- ALR = 4.2; fail to reject the model
- BLR = 8.4; reject the modelCorrect
- CLR = 8.4; fail to reject the model
- DLR = 2,004.2; reject the model
Explanation
LR = -2(LL_restricted - LL_unrestricted) = -2(-1004.2 + 1000.0) = 8.4. With 3 restrictions, the critical value is 7.81, and 8.4 exceeds it, so the null of a correct model is rejected. Forgetting the factor of 2 gives 4.2, which would wrongly not reject.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A risk team backtests daily 99% VaR forecasts from two models over 250 days. Both models record exactly 2 exceedances, so a simple exceedanc…
- A bank backtests ES with a method that compares the realised average of losses beyond VaR to forecast ES, using a bootstrap or simulation un…
- Compared with a traditional exceedance-count backtest at the 99% level, what is a key advantage of PIT-based backtesting?
- A bank's 99% one-day VaR backtest over 500 days shows 5 exceptions, exactly the expected number. However, 4 of the 5 exceptions occurred in …
- A bank's PIT backtest over 500 days produces a histogram of PIT values that is U-shaped, with excess frequency near 0 and near 1 and too few…
- A bank backtests its 99% VaR model using 500 daily PIT values. A histogram of the PIT values shows large excesses in the bins near 0 and nea…