Abstract:This paper concerns sequential computation of risk measures for financial data and asks how, given a risk measurement procedure, we can tell whether the answers it produces are `correct'. We draw the distinction between `external' and `internal' risk measures and concentrate on the latter, where we observe data in real time, make predictions and observe outcomes. It is argued that evaluation of such procedures is best addressed from the point of view of probability forecasting or Dawid's theory of `prequential statistics' [Dawid, JRSS(A)1984]. We introduce a concept of `calibration' of a risk measure in a dynamic setting, following the precepts of Dawid's weak and strong prequential principles, and examine its application to quantile forecasting (VaR -- value at risk) and to mean estimation (applicable to CVaR -- expected shortfall). The relationship between these ideas and `elicitability' [Gneiting, JASA 2011] is examined. We show in particular that VaR has special properties not shared by any other risk measure. Turning to CVaR we argue that its main deficiency is the unquantifiable tail dependence of estimators. In a final section we show that a simple data-driven feedback algorithm can produce VaR estimates on financial data that easily pass both the consistency test and a further newly-introduced statistical test for independence of a binary sequence.

What Is a Good External Risk Measure: Bridging the Gaps between Robustness, Subadditivity, and Insurance Risk Measures

External Risk Measures and Basel Accords

Optimal reinsurance under VaR and CTE risk measures

Conditional Tail-Related Risk Estimation Using Composite Asymmetric Least Squares and Empirical Likelihood

Risk Measures: Robustness, Elicitability, and Backtesting.

Robustness in the Optimization of Risk Measures

A Framework for Measures of Risk under Uncertainty

Verification of internal risk measure estimates

Scenario-based risk evaluation

Coherent Measures of Risk

On the necessity of five risk measures

Risk Measures beyond Frictionless Markets

Measures of Model Risk for Continuous-Time Finance Models

Worst-Case Range Value-at-Risk with Partial Information

EP-CVaR Risk Measure Approach and Its Application in Portfolio Optimization

Assessing financial model risk

Intrinsic risk measures

The measure of model risk in credit capital requirements

Can a regulatory risk measure induce profit-maximizing risk capital allocations? The case of conditional tail expectation

Quantitative Models Improved on VaR to Measure Operational Risk