FRM Part II · FRM Exam Part II · Backtesting VaR
A regulator-style backtest uses 250 daily observations. A bank's model understates risk, so its true exception probability is 3% rather than the stated 1%. Which statement best describes the power of the backtest?
Power of a backtest is the probability of correctly rejecting an inaccurate model, which equals one minus the Type II error probability. It rises as the true exception rate departs further from the stated rate and as the sample grows.
- APower is the probability of correctly rejecting this flawed model, and equals one minus the Type II error probabilityCorrect
- BPower is the probability of rejecting an accurate model, and equals the Type I error probability
- CPower is the probability of accepting a flawed model, and equals the Type II error probability
- DPower depends only on the VaR confidence level and not on the true exception rate
Explanation
Power = 1 - P(Type II error), the chance of rejecting a model that is truly wrong. With a true 3% rate the expected exceptions (7.5) far exceed 2.5, so power is moderate to high, and it depends on how far the true rate departs from 1%.
Did you get it right without looking?
One question tells you little. A timed set on Backtesting VaR shows your real accuracy, how long you take and where you lose marks.
More Backtesting VaR questions
- A risk manager backtests a 99% one-day VaR model over 250 trading days. Under the assumption that the model is correctly calibrated and exce…
- A bank's 99% one-day VaR model produced 4 exceptions in 250 days, all in the same two-week period following a market shock. Which conclusion…
- A risk manager backtests a 99% one-day VaR model and rejects the model whenever the number of exceptions exceeds a chosen cutoff. In this co…
- A bank's 95% one-day VaR is backtested over 250 days with 20 exceptions. Using the normal approximation to the binomial under the null that …
- A risk manager notes that a 99% VaR model had 3 exceptions in 250 days, all in consecutive days during one stress week. What is the most app…
- A risk manager at a trading firm explains why the bank backtests its 99% one-day VaR model against daily trading results. Which statement be…