FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
A risk manager has PIT values u_t from a VaR model and wants to test the full distribution rather than just tail exceedances. She transforms each value by z_t = Φ^-1(u_t), where Φ^-1 is the inverse standard normal CDF. Under a correctly specified model, what should be true of z_t, and what is the main practical benefit of this transformation?
Under a correct model the inverse-normal transformed PIT values are i.i.d. standard normal. This allows standard parametric tests, such as likelihood ratio tests of zero mean, unit variance and no autocorrelation, to evaluate the whole distribution. Independence must still be tested.
- Az_t should be i.i.d. standard normal, which allows standard normal-based tests such as likelihood ratio tests for mean, variance and autocorrelationCorrect
- Bz_t should be uniform on (0,1), which allows a simple count of exceedances
- Cz_t should be i.i.d. standard normal, which removes the need to test independence
- Dz_t should have mean 0.5 and variance 1/12, which allows a binomial test
Explanation
Applying the inverse normal CDF to uniform PIT values yields i.i.d. N(0,1) variables under a correct model. This lets the analyst use well-developed normal-based tests on mean, variance and serial correlation. Independence still has to be tested. Mean 0.5 and variance 1/12 describe the uniform before transformation.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A bank backtests ES with a method that compares the realised average of losses beyond VaR to forecast ES, using a bootstrap or simulation un…
- A bank's 99% one-day VaR backtest over 500 days shows 5 exceptions, exactly the expected number. However, 4 of the 5 exceptions occurred in …
- A bank backtests its 99% VaR model using 500 daily PIT values. A histogram of the PIT values shows large excesses in the bins near 0 and nea…
- A validator applies the Berkowitz test to a VaR model. She transforms PIT values using the inverse standard normal CDF to get z_t. Under the…
- A risk team backtests two 99% VaR models using only the count of exceedances over 500 days. Both models record 5 exceedances, yet one model'…
- A bank backtests a 99% daily VaR over 250 days with 2.5 expected exceedances. It observes 3 exceedances, but all 3 occurred in consecutive d…