FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
A risk manager wants to backtest a bank's full predictive VaR distribution rather than only counting exceedances. She converts each day's realized P&L into its probability integral transform (PIT) value using the model's forecast distribution. If the model is correctly specified, which distribution should these PIT values follow?
The PIT values should be independent and identically distributed uniform on [0,1]. If the forecast distribution is correct, each realized outcome is equally likely to fall at any quantile. The normal result only appears after an additional inverse-normal transform, as in the Berkowitz test.
- AStandard normal, independent across days
- BUniform on [0,1], independent and identically distributedCorrect
- CBinomial with success probability equal to 1 minus the VaR confidence level
- DStudent's t with degrees of freedom equal to the number of observations minus one
Explanation
Under a correctly specified forecast distribution, the PIT of the realized outcome is uniform on [0,1] and independent over time. Standard normality only arises after applying the inverse normal transform, which is the Berkowitz step. The binomial describes exceedance counts, not the PIT values.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A bank backtests ES with a method that compares the realised average of losses beyond VaR to forecast ES, using a bootstrap or simulation un…
- A bank's 99% one-day VaR backtest over 500 days shows 5 exceptions, exactly the expected number. However, 4 of the 5 exceptions occurred in …
- A bank backtests its 99% VaR model using 500 daily PIT values. A histogram of the PIT values shows large excesses in the bins near 0 and nea…
- A validator applies the Berkowitz test to a VaR model. She transforms PIT values using the inverse standard normal CDF to get z_t. Under the…
- A risk team backtests two 99% VaR models using only the count of exceedances over 500 days. Both models record 5 exceedances, yet one model'…
- A bank backtests a 99% daily VaR over 250 days with 2.5 expected exceedances. It observes 3 exceedances, but all 3 occurred in consecutive d…