FRM Part II · FRM Exam Part II · Validating Bank Holding Companies' Value-at-Risk Models for Market Risk
A validation team at a bank holding company reviews its VaR model. It performs backtesting comparing daily VaR to P&L, but does not examine the model's data inputs, mapping of positions to risk factors, or code. A senior reviewer criticizes the approach. Which criticism is most appropriate?
Outcomes analysis alone is insufficient. Validation should also evaluate conceptual soundness, data quality, position mapping and implementation, because backtests have limited statistical power and can fail to reveal model weaknesses. Backtesting remains useful but must be complemented by other validation components.
- ABacktesting is irrelevant to validation because VaR is only a theoretical number
- BOutcomes analysis alone is insufficient; validation should also include evaluation of conceptual soundness, data quality and implementation, since backtests have limited power to detect model flawsCorrect
- CValidation should rely only on input data checks because backtesting results are too precise
- DValidation should only be carried out by the model developers to preserve expertise
Explanation
Backtests have low statistical power, especially at 99% with about 250 observations, so they can miss deficient models. A complete framework combines outcomes analysis with review of design, data, mapping and implementation. Developer-only validation lacks independence.
Did you get it right without looking?
One question tells you little. A timed set on Validating Bank Holding Companies' Value-at-Risk Models for Market Risk shows your real accuracy, how long you take and where you lose marks.
More Validating Bank Holding Companies' Value-at-Risk Models for Market Risk questions
- Which feature is a recognized limitation of using historical-scenario stress tests as part of VaR model validation?
- A risk manager at a bank holding company reviews a validation report on the bank's trading VaR model. The report relies solely on comparing …
- A bank's 99% one-day VaR model is backtested over 250 trading days and produces 6 exceptions. Under the Basel traffic-light approach, the nu…
- Supervisory review of several large bank holding companies found that reported trading VaR was often well above the realized daily trading l…
- A bank's 99% one-day VaR model is backtested over 250 trading days and produces 9 exceptions. The validator is deciding how to interpret thi…
- A bank's trading desk shows more exceptions when VaR is compared with actual (clean-plus-dirty) P&L than with hypothetical P&L. Which is the…