FRM Part II · FRM Exam Part II · Validating Bank Holding Companies' Value-at-Risk Models for Market Risk
Why do backtesting tests of 99% VaR models generally have low power, according to the validation literature?
Because a 99% VaR model produces only a few exceptions in a typical sample, such as about 2.5 in 250 days, a moderately wrong model can generate counts that look acceptable. This gives backtests low power and a high risk of failing to reject inaccurate models.
- AExceptions are too frequent at 99%, so the sample is dominated by noise
- BWith few expected exceptions, a moderately misspecified model often produces counts indistinguishable from a correct one over a typical sampleCorrect
- CStatistical tests cannot be applied to profit and loss data
- DThe chi-square distribution is not valid for likelihood ratios
Explanation
At 99% and 250 days only about 2.5 exceptions are expected, so a model whose true exception rate is, say, 2% can easily generate counts that look acceptable. This yields a high chance of Type II errors. Option A reverses the issue: exceptions are rare, not frequent.
Did you get it right without looking?
One question tells you little. A timed set on Validating Bank Holding Companies' Value-at-Risk Models for Market Risk shows your real accuracy, how long you take and where you lose marks.
More Validating Bank Holding Companies' Value-at-Risk Models for Market Risk questions
- A bank backtests a 99% VaR model over 250 days with 6 exceptions. Using the approximation that the number of exceptions is normal with mean …
- A risk manager at a bank holding company reviews a validation report on the bank's trading VaR model. The report relies solely on comparing …
- A bank's 99% one-day VaR model is backtested over 250 trading days and produces 6 exceptions. Under the Basel traffic-light approach, the nu…
- A bank's 99% one-day VaR model is backtested over 250 trading days and produces 9 exceptions. The validator is deciding how to interpret thi…
- A bank's trading desk shows more exceptions when VaR is compared with actual (clean-plus-dirty) P&L than with hypothetical P&L. Which is the…
- A validator benchmarks a bank's 99% one-day VaR of USD 12.0 million against a vendor model giving USD 15.0 million. Over 250 days, the bank'…