FRM Part II · FRM Exam Part II · Beyond Exceedance-Based Backtesting of Value-at-Risk Models
A bank's trading desk model forecasts P&L as normal with a standard deviation of 2 million. Over 250 days, a histogram of PIT values shows a pronounced U-shape, with many observations near 0 and near 1 and few near 0.5. What is the most appropriate interpretation?
A U-shaped PIT histogram indicates the model underestimates risk: realized P&L lands in the forecast tails too often, so the forecast distribution is too narrow or too thin-tailed. An overstated risk forecast would instead give a hump-shaped histogram concentrated near the middle.
- AThe model overestimates risk, with forecast distributions too wide
- BThe model underestimates risk, with forecast tails too thin or the distribution too narrowCorrect
- CThe model is well calibrated but biased in the mean only
- DThe model is correct because extreme PIT values occur in both tails
Explanation
A U-shaped PIT histogram means realized outcomes fall in the forecast tails more often than expected, so the forecast distribution is too narrow or too light-tailed. An overly wide forecast would produce a hump-shaped histogram with mass concentrated near 0.5. A pure mean bias would produce a skewed histogram, not a symmetric U.
Did you get it right without looking?
One question tells you little. A timed set on Beyond Exceedance-Based Backtesting of Value-at-Risk Models shows your real accuracy, how long you take and where you lose marks.
More Beyond Exceedance-Based Backtesting of Value-at-Risk Models questions
- A bank wants to compare VaR models using a method that rewards models for the size of tail losses rather than only the frequency of breaches…
- A validator applies the Kolmogorov-Smirnov (KS) test to 250 PIT values from a bank's VaR model. Which statement best describes the KS test s…
- Over a sample, Model A's average quantile score is 2.10 and Model B's is 2.35, with lower being better. The Diebold-Mariano style test on th…
- A risk analyst evaluates a bank's daily VaR model using the probability integral transform (PIT). For each day, the analyst computes the mod…
- A risk team wants to assess a 99% VaR model using only 250 daily observations. The expected number of exceedances is 2.5. Which is the main …
- Compared with a simple exceedance-based backtest at 99% confidence, what is the main advantage of the Berkowitz test for a validator?