You are on page 1of 12

International Journal of Forecasting 33 (2017) 958–969

Contents lists available at ScienceDirect

International Journal of Forecasting


journal homepage: www.elsevier.com/locate/ijforecast

Forecasting multidimensional tail risk at short and long


horizons
Arnold Polanski a , Evarist Stoja b, *
a
University of East Anglia, Norwich Research Park, Norwich, NR4 7TJ, UK
b
School of Economics, Finance and Management, University of Bristol, 8 Woodland Road, Bristol, BS8 1TN, UK

article info a b s t r a c t
Keywords: We define the Multidimensional Value at Risk (MVaR) as a natural generalization of VaR.
Multidimensional risk This generalization makes a number of important applications possible. For example, many
Multidimensional value at risk techniques developed for VaR can be applied to MVaR directly. As an illustration, we
Two-factor decomposition
employ VaR forecasting and evaluation techniques. One of our forecasting models builds on
Long horizon forecasting
the progress made in the volatility literature and decomposes MVaR into long-term trend
and short-term cycle components. We compute short- and long-term MVaR forecasts for
several multidimensional time series and discuss their (un)conditional accuracy.
© 2017 International Institute of Forecasters. Published by Elsevier B.V. All rights reserved.

1. Introduction deviations from the expected results. In the univariate


context, a measure of extreme risk that is used widely
The interest in multidimensional tail (MT) events is in practice is the Value at Risk (VaR). VaR is defined as
driven by their importance in economics, finance, insur- the maximum loss on a portfolio over a certain period
ance and many other areas of applied probability, statis- of time that can be expected with a nominal probabil-
tics and decision theory. The modeling and forecasting ity. However, modern risk management generally involves
of MT events is paramount for many important applica- more than one risk factor and is particularly concerned
tions in economics and finance, such as portfolio decisions with the evaluation and balancing of their impacts. For
(e.g., Ang and Bekaert, 2002), risk management (e.g., Em- example, multifactor models (e.g., Chen, Roll, and Ross,
brechts, McNeil, and Straumann, 2002; Meine, Supper, 1986; Ferson and Harvey, 1998) are used to measure and
and Weiß, 2016), multidimensional options (e.g., Cheru-
manage the exposure to each one of multiple economy-
bini and Luciano, 2002), credit derivatives, collateralised
wide risk factors.
debt obligations and insurance (e.g., Hull and White,
This paper discusses a new angle on the modeling and
2006; Kalemanova, Schmid, and Werner, 2007; Su and
forecasting of multidimensional tail events. Building on
Spindler, 2013), contagion, spillovers and economic crises
related recent literature (e.g., Polanski and Stoja, 2012;
(Bae, Karolyi, and Stulz, 2003; Hautsch, Schaumburg, and
Prékopa, 2012; Torres, Lillo, and Laniado, 2015), we apply
Schienle, 2015; Zheng, Shi, and Zhang, 2012), systemic risk
and financial stability (Adrian and Brunnermeier, 2016; a generalized version of VaR, the Multidimensional Value
Gonzáles-Rivera, 2014), and market integration (e.g., Bar- at Risk (MVaR), which is defined as a value that delimits
tram, Taylor, and Wang, 2006; Lehkonen, 2015). a multidimensional tail with a nominal probability mass
Tail events are related closely to extreme risk that is under a given density function. MVaR can be seen as an
generally defined as the potential for significant adverse illustration of the multiple sources of risk: if VaR is a uni-
variate risk measure, which instead of the variance takes
into account the entire tail density, then MVaR is a measure
* Corresponding author.
E-mail addresses: A.Polanski@uea.ac.uk (A. Polanski), of multidimensional risk that instead of the covariances
E.Stoja@bristol.ac.uk (E. Stoja). takes into account the entire multidimensional tail density.

http://dx.doi.org/10.1016/j.ijforecast.2017.05.005
0169-2070/© 2017 International Institute of Forecasters. Published by Elsevier B.V. All rights reserved.
A. Polanski, E. Stoja / International Journal of Forecasting 33 (2017) 958–969 959

Why should we care about MVaR when in typical port- that we apply to MVaR. This model has several advantages.
folio applications it is the portfolio VaR that matters and It is simple to estimate and can easily produce multi-step-
not the multidimensional tail risk of the components of ahead forecasts. Our two-factor model (2FM) decomposes
the portfolio? Although VaR might be the appropriate risk MVaR into a long-term trend and a short-term cycle which
measure in portfolio applications, MVaR is useful in other can then be examined for relationships with economic
circumstances where either the risk sources cannot be and other variables. Finally, we use the scaling property
aggregated to form an informative risk measure or the of financial and economic time series to forecast MVaR at
portfolio interpretation of a collection of variables is not different frequencies and horizons. We evaluate the MVaR
natural, useful or possible. forecasts by employing adapted conditional and uncondi-
A prominent example of the importance of account- tional VaR forecast evaluation techniques. To the best of
ing for the distributional characteristics of the multiple our knowledge, this paper is the first to raise these issues
sources of risk properly comes from the stress testing of in relation to (multidimensional) tail events.
portfolios or financial systems. Stress testing frameworks
typically begin by developing scenarios with negative out- 2. Multidimensional value at risk
looks (tail events) for the evolution of certain economic
drivers (e.g., GDP growth, interest rates, unemployment, For the continuous and strictly increasing CDF F (PDF
stock market performance, investor sentiment), then pro- f ) of a unidimensional random variable Y on the real line,
ceed to evaluate the impacts of these on portfolios or the VaR at the nominal level a is usually identified with
systemically important institutions (e.g., Bank of England, the quantile qa for which F (qa ) = a. More generally, VaR
2015; European Banking Authority, 2016). Treating with can be defined as the cutoff qa such that the probability
these drivers individually presents a problem, as they are mass under f of the interval {y ∈ R : y/d ≥ qa } for a non-
obviously interdependent. Moreover, it would be difficult zero number d is equal to a. Depending on the value of
to construct a portfolio of these factors and use its VaR as d, this definition can apply to either the left (d < 0) or
a tail risk measure. For example, what is the appropriate right (d > 0) tail of a distribution, and also allows for
weight and its interpretation for each source of risk in such normalization.
a portfolio? The only alternative is to consider the sources In analogy to VaR, for a joint CDF F (PDF f ) of a vector
of risk jointly. In this case, MVaR can simplify the task Y = (Y1 , . . . , YN ) of N random variables on RN with
considerably. continuous and strictly increasing marginal CDFs, the Mul-
Another example related to stress testing that high- tidimensional Value at Risk (MVaR) in direction d ∈ RN at
lights the importance of MVaR is systemic risk. This is the nominal probability level a is the unique cut-off value
the risk of collapse that is faced by the financial sys- qda ∈ R, such that the set
tem as a whole when one of its constituent parts gets
Mda = y ∈ RN : yi /di ≥ qda , ∀di ̸ = 0
{ }
into financial distress. The interconnectivity of financial (1)
institutions means that a shock faced by one institution
has probability mass a under f . We refer to the set Mda
in the form of a tail event increases the probability of
as the MVaR-region or multidimensional tail. In Fig. 1, we
other financial institutions experiencing similar tail events,
illustrate the construction of the multidimensional tail Mda
leading to a domino effect (e.g., Gai and Kapadia, 2010;
as a Cartesian product of univariate tails (VaR-intervals)
Hautsch, Schaumburg, and Schienle, 2014; Rogers and Ver-
Mda = y1 ∈ R : y1 /d1 ≥ qda
{ }
aart, 2013). In this case, it would be both inappropriate and
uninformative to treat the financial system as a portfolio of
× · · · × yN ∈ R : yN /dN ≥ qda ,
{ }
banks and compute its VaR.
Therefore, while it is important to have a measure of {where the probability mass for each VaR-interval
yi ∈ R : yi /di ≥ qda can be computed from the corre-
}
the aggregate tail risk, often it is also important to know
the direct dependence on, interrelationships among as well sponding marginal CDF.
as the co-dynamics of the specific sources of tail risk. By We also say that x ∈ RN is an extreme observation
focusing on the joint distribution of the individual sources when x lies in the MVaR-region. The directional vector d
of tail risks, we provide a framework for characterizing the (together with the significance level a) defines the region
co-dependence of these risks. of interest, and also has a distinct financial interpretation.
One important advantage of MVaR is that, in principle, For example, in the case of systemic risk, the choice of
any techniques and applications that have been devel- the directional vector hinges on the particular economic
oped for VaR can also be applied directly to MVaR. We metric that is of interest to the regulator. This could be,
illustrate this here with both short- and long-term MVaR for example, how much the regulator may have to ‘pour
forecasting and evaluation. First, we obtain one-step-ahead into’ an institution that is in distress in order to prevent it
MVaR forecasts using the conditional autoregressive value from ‘infecting’ its counterparties, where Core Equity Tier
at risk (CAViaR) of Engle and Manganelli (2004). How- 1 (CET1) capital, as one of the most important macropru-
ever, CAViaR is a purely statistical model and does not dential policy ratios for financial stability, is an obvious
distinguish between long-term, persistent movements in candidate. If a bank gets into distress and ‘eats up’ its CET1
the tails, driven perhaps by macroeconomic and company ratio, the regulator may be forced to bail it out by providing
fundamentals, and transitory movements that are due to funding equal to CET1 to return the bank’s capital to its
investor sentiment or other short-lived effects. With this in pre-distress level. Suppose that a financial system is made
mind, we investigate a new two-factor forecasting model up of three banks with CET1 ratios of 2, 1 and 4. Then,
960 A. Polanski, E. Stoja / International Journal of Forecasting 33 (2017) 958–969

under the PDF f . Then, the a-quantile that is computed from


a series of i.i.d. observations drawn from f is the natural
estimator of (M)VaR qda . In higher dimensions, the MVaR qda
for d = −1 can be estimated in a similar manner as the a-
quantile of the projections v d (xt ) of multidimensional ob-
servations xt . When estimating MVaR from projections, we
omit the reference to the directional vector d and simply
write qa .
In the reminder of this section, we apply three different
MVaR forecasting methods in order to obtain forecasts over
horizons of k steps ahead.1 The methods presented in
Sections 3.1 and 3.2 are useful for forecasting the daily
MVaR both one step ahead and k steps ahead, where k =
1 and k ≥ 5 refer to short- and long-horizon forecasts,
Fig. 1. The MVaR-region as a Cartesian product: VaR-intervals for N = 2.
Notes: MVaR-region Mda (dark shaded area) in the direction of the vector
respectively. The method presented in Section 3.3 allows
d. Note that the upper left corner of Mda corresponds to the point qda · d. for the forecasting of low frequency (e.g., monthly) MVaR,
which would be difficult otherwise, due to the limited
number of such observations in practice.

3.1. Conditional autoregressive value at risk

Several approaches to short-term VaR forecasting have


been proposed (for surveys of VaR forecasting techniques,
see e.g. Kuester, Mittnik, and Paolella, 2006; Nieto and
Ruiz, 2016). Some estimate the volatility of the time series
first (e.g., using a GARCH model) and then compute the
VaR, often under an assumption of normality. Others use
rolling historical quantiles (e.g., Boudoukh, Richardson,
and Whitelaw, 1998) or rely on extreme value theory
Fig. 2. Projections (Eq. (2)) of observations inside and outside the MVaR
(e.g., Danielsson and de Vries, 2000). Engle and Manganelli
region. Notes: All points inside (outside) the shaded area that is the MVaR
region Mda are projected inside (outside) Mda . (2004), on the other hand, propose a different approach to
VaR estimation and forecasting: instead of modeling the
whole distribution from heteroscedasticity-adjusted re-
turns, they model the quantiles directly from raw returns.
a directional vector that is of particular interest for the
As VaR is linked closely to volatility, which is clustered in
regulator of this financial system is d = (d1 , d2 , d3 )′ =
financial data, a natural way to model VaR would be to use
−(2, 1, 4)′ , as it succinctly represents the exposure of the
an autoregressive process. Engle and Manganelli (2004)
economy to the systemic risk originating from these three
banks, and thus, the relative level of capital which the specify the evolution of the quantile over time using the
regulator may need to pour in to bail out these banks if they conditional autoregressive Value at Risk (CAViaR) model,
fail. and estimate its parameters by quantile regression. CAViaR
In spite of its conceptual simplicity, working with MVaR allows for many specifications of the autoregressive pro-
directly can prove challenging in higher dimensions. How- cess that can be used for MVaR forecasting. In our empir-
ever, the relevant MVaR inference can be obtained easily ical exercise in Section 4, we use their asymmetric slope
by transforming points in the domain of f into scalars. function
Specifically, for each x ∈ RN , we define the point xd ∈ RN
qa,t +1 = β1 + β2 qa,t + β3 max vtd , 0
( )
on the line along the directional vector d ∈ RN as follows:
− β4 min vtd , 0 ,
( )
(4)
x = v (x) · d , w here v (x) = min {xi /di } .
d d d
(2)
di ̸ =0 where the next period quantile qa,t +1 is a function of the
Fig. 2 illustrates, as is shown in the Appendix A, the current period quantile qa,t and projection vtd .
following property of the projection v d (x) ∈ R: The quantile regression estimation of the parameter
vector β = (β1 , β2 , β3 , β4 ) in Eq. (4) boils down to the
v d (x) ≥ qda ⇔ x ∈ Mda . (3) solution of the minimization problem
T
Intuitively, the fact that observation x lies in the MVaR- 1 ∑[
a − I(vtd < qa,t ) vtd − qa,t ,
][ ]
region implies that its projection v d (x) exceeds the MVaR min (5)
β T
qda , and vice-versa. t =1

3. Forecasting MVaR 1 We also apply these techniques to VaR and find that the models do a

d
similarly good job at forecasting VaR. As MVaR encompasses VaR, we do
{ d 1 = −1, the}multidimensional tail Ma
For N = 1 and not report these results here in order to preserve space. They are available
takes the form y ∈ R : y ≤ −qda ; i.e., −qda is the a-quantile upon request.
A. Polanski, E. Stoja / International Journal of Forecasting 33 (2017) 958–969 961

where qa,t is computed by Eq. (4), I(.) is the indicator We implement the two-factor model given by Eq. (6) in
function and a is the nominal probability. In our empirical two steps. In the first step, we extract the long-run compo-
study, we use CAViaR not as a competing short-term MVaR nent ϱa,t non-parametrically from the historical estimate of
forecasting model, but as a complementary model, and the a-quantile q̃a,t . There are several techniques available
obtain the k-step-ahead forecasts of the MVaR qa,t +k using for extracting the long-run component from a time series
the technique that we present next. (see for example Durbin and Koopman, 2012). Here, we use
the low-pass filter of Hodrick and Prescott (1997), which
3.2. Two-factor model extracts a low frequency non-linear trend from a time se-
ries, and is often employed in applied macroeconomics. We
Similarly to GARCH, CAViaR is a purely statistical model also experimented with other filters, such as the Christiano
which cannot be related easily to either macroeconomic or and Fitzgerald (2003) band pass filter, and obtained similar
company fundamentals. However, tail events – similarly to
results for some values of the oscillation parameters.2
the volatility – must be connected to fundamentals (see
We implement the two-factor MVaR model with the
for example Bloom, 2009; Massacci, in press). Moreover,
Hodrick–Prescott filter by setting the smoothing param-
the evidence increasingly suggests that the volatility is
eter to the commonly-used value of 100 multiplied by
characterised by a multi-factor structure, with different
the squared frequency of the data, which for daily data
dynamic processes governing its long-term and short-term
(assuming 240 trading days per year) gives 5,760,000 (see
dynamics. Engle and Lee (1999) introduce a component
GARCH model which decomposes the volatility into a for example Baxter and King, 1999). In the second step, we
permanent long-run trend component and a transitory estimate an autoregressive model for the cyclical compo-
short-run component that is mean-reverting towards the nent:
long-run trend. They find that a two-factor model pro-
q̃a,t − ϱ̃a,t = ϕ q̃a,t −1 − ϱ̃a,t −1 + et ,
( )
(7)
vides a better fit to the data than an equivalent one-
factor model (see also Alizadeh, Brandt, and Diebold, 2002; where et is a zero mean random error. We forecast MVaR
Brandt and Jones, 2006). Importantly, the two-factor spec- using the 2FM by assuming that the long-term trend fol-
ification makes it possible to link the long-term volatility lows a random walk over the forecast horizon, so that the
trend to macroeconomic variables (e.g., Engle and Rangel, k-step-ahead forecast ϱ̂a,t +k = ϱ̃a,t for all k > 0, and
2008). The literature includes a significant number of VaR use the estimated autoregressive parameter from Eq. (7)
forecasting models, but thus far models that link the VaR to forecast the cyclical component. Thus, the k-step-ahead
to macroeconomic fundamentals have remained elusive. MVaR forecast is given by
While it may be possible to extend the spline-GARCH
model of Engle and Rangel (2008) to MVaR, it would be q̂a,t +k = 1 − ϕ̃ k ϱ̃a,t + ϕ̃ k q̃a,t .
( )
(8)
computationally demanding. The two-factor model that
we present here offers a simple and efficient way to de- This is a weighted average of the current estimate of the
compose MVaR into a long-term trend and a short-term long-term trend ϱ̃a,t and the current estimate of q̃a,t . For
cycle. This decomposition would then allow the long-term very long-term horizons, i.e., as k → ∞, q̂a,t +k → ϱ̃a,t , with
trend to be linked to macroeconomic and company funda- a speed that is determined by the estimated coefficient ϕ̃ .
mentals, while the short-term cyclical component may be
related to transient investor sentiment or other short-lived 3.3. Scaled MVaR
effects. For the sake of brevity, we do not pursue this idea
in this paper, but are investigating it in a separate project. The fact that financial returns at lower frequencies can
The finding that the volatility has both a highly per- be computed as the sum of returns at higher frequencies
sistent factor and a strongly stationary factor has impor- suggests that we can use the latter to estimate the MVaR
tant implications for the modeling and forecasting of VaR. of the former. So far we have focused on the highest fre-
As VaR is related closely to the volatility (e.g., Taka-
quency, which in our empirical section is one day. How-
hashi, Watanabe, and Omori, 2016), any improvements in
ever, often risk forecasts at lower frequencies are needed.
volatility forecasts are inherited by VaR forecasts. Moti-
For example, the Basel Accords require financial institu-
vated by the interpretation of two-factor volatility mod-
tions to model the risk using a 10-day holding period. It
els, we explore a simple alternative approach to modeling
has become the industry standard to estimate the daily VaR
and forecasting MVaR over both short and long horizons.
Specifically, we hypothesize that MVaRs follow a two- and then scale it up by 101/2 in order to get the 10-day
factor process that is given by VaR. This is known as the square-root-of-time rule (SQRT-
rule). The SQRT-rule arises from the scaling property of i.i.d.
qa,t = ϱa,t + ϕ qa,t −1 − ϱa,t −1 + εt , Gaussian variables X1 , . . . , Xk ,
( )
(6)

X1 + X2 + · · · + Xk = k1/2 · X1 .
d
where ϱa,t is the long-term trend component of MVaR,
qa,t −ϱa,t is the short-term cyclical deviation from the long-
term trend, and εt is a random error term with zero mean As financial asset returns strongly violate the assump-
and constant variance. We assume that the long-term trend tion of normality, neither the moments of distributions
ϱa,t is a stationary but highly persistent process, but leave
its precise dynamics unspecified. The parameter ϕ mea- 2 To preserve space, we do not present the results of the MVaR
sures the speed of reversion of the cyclical component of forecasts with the Christiano and Fitzgerald (2003) filter here. They are
MVaR to the long-term trend. available upon request.
962 A. Polanski, E. Stoja / International Journal of Forecasting 33 (2017) 958–969

(such as volatility) nor their quantiles should be scaled The test statistic of Kupiec’s (1995) unconditional accu-
according to the SQRT-rule.3 racy test is given by
In general, the distribution of the random variables ) √ (
X1 , . . . , Xk displays a scaling behavior if it holds that tu = â − a / â â − a /T ,
( )
(11)
d δ
X1 + X2 + · · · + Xk = k · X1 , where â is the percentage of actual MVaR exceptions (vio-
lations), a is the nominal probability of exceptions and T is
where δ is the scaling exponent. Then, the a-quantile satis-
fies the number of observations. Intuitively, an unconditionally
( ) accurate model has an exception rate â that is close to a.
k
The second, more stringent criterion relates to the con-
= kδ · qa (X1 ) .

qa Xi (9)
ditional accuracy. The likelihood ratio test of Christoffersen
i=1
(1998) examines the serial independence of MVaR viola-
For many empirical distributions, the scaling property tions, and is given by
Eq. (9) is only a good approximation if the nominal proba-
bility a is sufficiently close to zero. For these distributions, LRc = 2 (ln LA − ln L0 ) , (12)
one can estimate an extreme event at a high frequency
for which there is an abundance of data (e.g., daily), then where
use the scaling laws to estimate the extreme event at T
LA = (1 − Π01 )T00 Π0101 (1 − Π11 )T10 Π1111 ,
T

the lower frequency of interest (e.g., monthly; see Gabaix, T


2009; Mandelbrot, 1997; McNeil and Frey, 2000). Taking L0 = (1 − Π )T00 +T10 Π T01 +T11 (1 − Π11 )T10 Π1111 ,
the logarithm of Eq. (9) gives
( ( )) and
k
Tij
Πij = ,

ln qa Xi = ln (qa (X1 )) + δ · ln (k) , (10)
Ti0 + Ti1
i=1

which makes it obvious why a straight line on the log–log T01 + T11
plot is called a signature of the scaling law. Π= .
T00 + T01 + T10 + T11
4. Empirical evaluation of MVaR forecasts Tij is the number of cases in which state j follows state i .
Here, state 0 obtains if no exceedence of the MVaR forecast
4.1. Statistical evaluation of MVaR forecasts occurs and state 1 obtains if such an exceedence does occur.
This statistic has an asymptotic χ2 distribution with one
There is a vast number of alternative methods for evalu- degree of freedom, LRc → χ2 (1).
ating VaR forecasts (see, for example, Nieto and Ruiz, 2016, Engle and Manganelli (2004) remark that unconditional
for a recent review). Due to their intuitive appeal and pop- and conditional accuracies are necessary but not sufficient
ularity among practitioners, we focus in what follows on conditions for assessing the performance of a quantile
three simple and mutually complementary tests. Although forecasting model. They construct an example where the
these tests have been designed for testing the VaR accuracy, unconditional exceedances are correct and serially uncor-
they
( d clearly
)T also apply to the univariate projection series related, but the conditional probability of violation, given
v (xt ) t =1 . the quantile forecast, differs dramatically from the nomi-
Under the correct forecasting model, the proportion of nal level. Their dynamic quantile (DQ) test aims to avoid
MVaR violations, i.e., the proportion of projections v d (xt ) of such errors. Complementing the Christoffersen (1998) and
observation xt that verify Eq. (3), should approach the nom- Kupiec (1995) tests, we use a version of the DQ statistic to
inal probability a for a sufficiently large sample. We refer to test the null that the conditional coverage, given the MVaR
this procedure as the unconditional accuracy. On the other forecast, is equal to the nominal level a:
hand, the conditional accuracy requires that the number
of projections exceeding MVaR should be unpredictable hit ′ qa q′a hit
DQ = , (13)
when conditioned on past violations. In other words, MVaR a (1 − a) q′a qa
violations should be serially uncorrelated. We assess both
types of accuracy by resorting to the original unconditional where hit and qa are T ×1 column vectors containing hit t =
accuracy test of Kupiec (1995) and the test of independence I(vtd < qa,t ) − a and the MVaR forecasts qa,t , respectively.
by Christoffersen (1998), labeled the conditional accuracy This statistic has an asymptotic χ2 distribution with one
test here for consistency.4 degree of freedom, DQ → χ2 (1).

3 Indeed, the Basel Committee’s technical guidance paper (Basel Com- 4.2. Data
mittee on Banking Supervision, 2002) no longer suggests that the SQRT-
rule be used, but instead says that, ‘‘in constructing VaR models estimating We use three different datasets to evaluate the perfor-
potential quarterly losses, institutions may use quarterly data or convert mances of the MVaR forecasting models: the main US and
shorter period data to a quarterly equivalent using an analytically appro- European stock indices, and EU bond indices. The US stock
priate method supported by empirical evidence’’.
4 Christoffersen (1998) also proposes a test of conditional coverage index dataset contains daily closing prices for S&P 500,
that tests for unconditional and conditional accuracy simultaneously.
Dow Jones and Nasdaq, considered here as proxies for the
However, as we are interested in testing these hypotheses separately, we performances of the underlying general sectors. The Euro-
omit it here. pean stock index dataset contains daily closing prices of
A. Polanski, E. Stoja / International Journal of Forecasting 33 (2017) 958–969 963

Table 1
Summary statistics and autocorrelations.
Panel A: Summary statistics
Mean Standard deviation Skewness Excess kurtosis Bera-Jarque

DJ30 0.023% 1.155% −0.143 7.871 12 924.742


SP500 0.023% 1.227% −0.231 7.994 13 356.985
NASDAQ 0.030% 1.615% −0.050 5.391 6 056.037
US projections −24.84% 97.88% −0.634 7.698 12 681.444
FTSE100 0.027% 1.122% −0.215 6.071 7 716.688
DAX 0.031% 1.265% 0.078 8.855 16 339.224
CAC40 0.035% 1.294% −0.086 4.524 4 269.501
MIB30 0.026% 1.371% −0.162 4.243 3 772.200
E-S projections −40.59% 98.06% −0.813 9.600 19 752.610
UK bonds 0.027% 0.381% −0.006 2.146 959.166
German bonds 0.025% 0.338% −0.260 2.411 1 267.072
French bonds 0.025% 0.345% −0.224 2.993 1 908.178
Italian bonds 0.031% 0.427% 0.537 3.414 1 977.693
E-B projections −61.01% 98.67% −1.634 13.544 40 437.863

Panel B: Autocorrelations projected returns


1 2 3 4 5 6 Q p-value
US projections −0.046 −0.031 0.009 0.004 −0.008 −0.005 16.356 0.012
E-S projections 0.056 −0.019 −0.032 0.056 −0.017 0.009 40.056 0.000
E-B projections 0.215 0.127 0.106 0.132 0.103 0.098 557.405 0.000
Notes: Panel A reports the mean, standard deviation, skewness, excess kurtosis and Bera-Jarque statistic for daily log close-to-close returns for US stock
indices DJ30, SP500 and Nasdaq, European stock indices FTSE100, DAX, CAC40 and MIB30, and 10-year bond prices for the UK, Germany, France and Italy.
The corresponding projections are computed for the directional vector of standard deviations of the relevant variables. The sample period is 1/09/1996 to
31/10/2015 (5000 observations). Panel B reports the first six autocorrelation coefficients and the Ljung–Box Q statistic for autocorrelation of up to six lags,
for projected US and EU stock returns and EU bond returns. p-values are also reported.

FTSE100 (UK), DAX (Germany), CAC40 (France) and MIB30 kurtosis. The excess kurtosis for bond returns is almost half
(Italy), used here as proxies for the health of the respec- that of the stock returns. The projected series are highly au-
tive economies. Finally, the European bond index dataset tocorrelated and, by construction, have different empirical
contains daily closing prices of 10-year government bonds, properties from the returns from which they originate.
considered here as proxies for the country risk. From the As was discussed above, asset returns are condition-
raw prices, we compute the continuously compounded ally heteroscedastic. We account for this feature of the
daily returns over the period from 1 September 1996 to data by also performing the analysis for returns standard-
31 October 2015, which gives 5000 daily observations for ized by the square root of the volatility, obtained from a
each return series. We use the first 2000 observations for GARCH(1,1) model estimated over a rolling window. To
the initial estimation and the remaining 3000 observations preserve space, we do not present these results here, but
for evaluating the out-of-sample forecasts, where the esti- they are available in Table 1A–3A in the Online Appendix.
mation window is rolled forward daily. Panel A of Fig. 3 plots the projected US stock index
For each set of returns, we compute the corresponding returns (US projections) and their ‘‘realized’’ daily MVaR
vector of standard deviations SD. The projection v d (xt ) for over the period 2 January 2012 to 31 October 2015. The
each observation xt in this set is then computed for the ‘‘realized’’ MVaR is estimated as the historical fifth quantile
directional vector d = −SD using Eq. (2). Note that the in the estimation window, rolled forward daily. It is clear
projections would be identical if we computed them from
that the ‘‘realized’’ MVaR is evolving slowly. Panel B plots
the standardized returns using the directional vector d =
the same ‘‘realized’’ MVaR (note the different scale from
−1. For consistency with the VaR literature, we multiply
Panel A) together with its long-term trend, estimated using
each projection v d (x) by −1 so that more extreme negative
the Hodrick-Prescott filter over the sample. The trend is
returns correspond to lower values of –v d (x).
a smoothed version of the ‘‘realized’’ MVaR and tracks it
In what follows, we refer to the daily (k-day period) re-
closely, although the deviation is evident in some periods,
turns and MVaRs as frequency-1 (frequency-k). For exam-
for example during 2013. Panel C of Fig. 3 plots the re-
ple, frequency-5 and frequency-20 MVaRs are computed
sulting cyclical component of the ‘‘realized’’ MVaR using
from weekly and monthly returns, respectively.
Table 1 reports summary statistics for the daily log the Hodrick-Prescott filter. It is clear that the long-term
return series in the sample. Panel A reports the mean, trend in MVaR is time-varying and highly persistent, while
standard deviation, skewness, excess kurtosis and Bera- the cyclical component is strongly mean-reverting, lending
Jarque statistic for the log returns and their projections. support to the two-factor representation of MVaR. { }
7
Panel B reports the first six autocorrelation coefficients, the Fig. 4 shows log–log plots of the frequencies 2i i=0
i
Ljung–Box Q statistic for autocorrelation of up to six lags days (x-axis) vs. the empirical frequency-2 MVaR esti-
for the projections, and the p-values. All series are highly mates for US projections (y-axis), with the corresponding
non-normal, with negative skewness and positive excess fitted straight lines. The estimates of frequency-2i MVaRs
964 A. Polanski, E. Stoja / International Journal of Forecasting 33 (2017) 958–969

5. Results

The out-of-sample MVaR estimation is performed using


the last 3000 observations. For the out-of-sample forecasts,
we moved a window of T = 2000( observations along the
time axis. For each window νdt = νtd−T +1 , . . . , νtd , where
)
t = T , . . . , 3000+T , we first estimate the parameter vector
β in Eq. (4) by solving the minimization problem in Eq. (5)
numerically and estimate ϕ in Eq. (7) by a simple regression
of the deviations q̃a,t − ϱ̃a,t on their one-lagged values.
For each window, we also compute frequency-k returns in
non-overlapping intervals of length k = 2i , i = {0, . . . , 4},
within this window. From these returns, we estimate the
frequency-k MVaR using the relevant quantiles, and the
scaling exponent by regressing the frequency-k log-MVaR
on the log-frequencies log(k).
Subsequently, we use the estimated parameters to ob-
tain MVaR forecasts as follows. For the CAViaR and 2FM
models, the k-day-ahead forecasts q̂a,t +k of the daily MVaR
are given directly by Eqs. (4) and (8) respectively, where
k = 1 in the case of CAViaR. Finally, for the scaling model,
Eq. (9) delivers at date t a forecast of the frequency-k MVaR
for the period (t + 1, . . . , t + k) (i.e., weekly, monthly and
quarterly MVaR for k = 5, 20 and 60).
The performance statistics for the MVaR forecasting
models are presented in Tables 2–4. The tables report both
the actual exception rates (â) and the p-values of the tu ,
LRc and DQ statistics for testing the null hypotheses of
unconditional and conditional accuracy for different MVaR
specifications and nominal probability levels across the
three datasets.
In line with previous findings, CAViaR performs well
for one-day-ahead forecasts of stock indices, both condi-
tionally and unconditionally. Indeed, the p-values of the tu
statistics indicate that the null of unconditional accuracy
cannot be rejected for all three nominal probabilities. Fur-
thermore, the p-values of the LRc and DQ statistics suggest
that the conditional accuracy performance is satisfactory.
The results for the bond return projections are the excep-
tion. In all three cases, CAViaR generates exceptions that
Fig. 3. Decomposition of US return projections MVaR into trend and cycle are considerably below the required nominal probability a.
components. Notes: The sample period in the figure is 02/01/2012 to Perhaps this should be expected, as the CAViaR model is de-
31/10/2015 (1000 observations). Panel A shows the ‘‘realized’’ MVaR esti-
signed for forecasting the quantiles of series that are more
mator of the US stock indices’ return projections, computed using Eq. (2).
Panel B shows the ‘‘realized’’ MVaR estimator (q5) and its long-run trend prone to tail events. Focusing on the stock indices datasets
(t5), estimated using the Hodrick-Prescott filter with a smoothing param- (Tables 2 and 3), its performance varies for different levels
eter of 5,760,000. Panel C shows the cyclical component of the MVaR (c5), of a: it appears that CAViaR is more accurate for higher
defined as the difference between the original series and the trend. values of a. For example, in the case of US indices, the actual
exceedance rate â for a = 5% is 5.2%, whereas the actual
exceedance rate for a = 1% is 1.3%. This finding is similar
have been computed from non-overlapping intervals of to previous findings in the VaR literature (e.g., Kuester et
length 2i , i = {0, . . . , 7} (i.e., one day to 6.4 months), al., 2006).
spanning the whole sample of 5,000 observations. We find On the other hand, the two-factor model appears to
a good linear fit for all our datasets, which indicates the perform well for all three portfolios and at all nominal
presence of scaling in the tails of the projected return levels. At the longer end of the forecast horizon (60 days;
distributions. For the US (EU) projections and for a = 1%, i.e., approximately three months ahead), the forecast er-
2.5% and 5%, the scaling exponents δ are 0.52 (0.53), 0.56 rors start to become considerable, and the p-values of the
(0.57) and 0.59 (0.55) respectively, which implies that the LRc statistics suggest that the conditional accuracy perfor-
underlying distributions have fat tails. These estimates dif- mance of the model is inadequate. However, the perfor-
fer markedly from Hauksson, Dacorogna, Domenig, Muller, mance generally seems acceptable for the shorter horizons.
and Samorodnitsky (2001) estimates of around 0.42 for the Interestingly, the performance of the 2FM appears more
univariate VaRs. balanced than that of CAViaR with regard to a. For example,
A. Polanski, E. Stoja / International Journal of Forecasting 33 (2017) 958–969 965

Fig. 4. MVaR scaling for US stock indices. Notes: A log–log plot of the empirical frequency-k MVaR (y-axis) at 1% (top left), 2.5% (top right) and 5% (bottom),
computed from the returns of US stock indices at different frequencies (x-axis, k days). The respective scaling parameters (slopes) are 0.52, 0.56 and 0.59.
The sample period is 1/09/1996 to 31/10/2015 (5000 observations).

Table 2
MVaR out-of-sample forecasting results for US stock indices.
k Model a = 1% a = 2.5% a = 5%
â p -val. p -val. p -val. â p -val. p -val. p -val. â p -val. p -val. p -val.
(tu ) (LRc ) (DQ) (tu ) (LRc ) (DQ) (tu ) (LRc ) (DQ)
CAViaR 0.013 0.111 0.298 0.290 0.027 0.571 0.924 0.295 0.052 0.622 0.217 0.183
2FM 0.017 0.002 0.074 0.009 0.030 0.109 0.023 0.874 0.056 0.132 0.256 0.695
1 Scaling 0.009 0.852 0.000 0.533 0.023 0.465 0.005 0.301 0.040 0.005 0.011 0.077
2FM 0.018 0.001 0.101 0.004 0.032 0.036 0.004 0.138 0.057 0.111 0.164 0.760
5 Scaling 0.006 0.012 0.000 0.010 0.016 0.000 0.000 0.000 0.454 0.226 0.000 0.171
2FM 0.018 0.001 0.018 0.004 0.033 0.010 0.002 0.055 0.057 0.091 0.183 0.713
10 Scaling 0.009 0.441 0.000 0.125 0.015 0.000 0.000 0.000 0.048 0.636 0.000 0.318
2FM 0.018 0.001 0.019 0.011 0.034 0.007 0.003 0.192 0.057 0.098 0.181 0.885
20 Scaling 0.011 0.577 0.000 0.257 0.014 0.000 0.000 0.000 0.053 0.417 0.000 0.271
2FM 0.022 0.000 0.010 0.001 0.038 0.000 0.023 0.055 0.060 0.024 0.088 0.156
60 Scaling 0.019 0.000 0.000 0.018 0.019 0.027 0.000 0.005 0.052 0.621 0.000 0.167
Notes: The table reports the actual exception rate (α̂ ) for each MVaR forecasting model out of 3000 observations (i.e., the proportion of the time that the
forecasted MVaR is exceeded), using the p-value of the t-statistic to test the null hypothesis of unconditional accuracy (Eq. (11)) and the p-values of the
LR and DQ statistics (Eqs. (12) and (13), respectively) to test the null hypothesis of conditional accuracy for different confidence levels. The out-of-sample
period of 3000 observations is from14 August 2007 to 31 October 2015. For the CAViaR and 2FM models, the daily MVaR forecasts are k-day-ahead forecasts,
while for scaling, the forecasts are for the frequency-k MVaR.

in the case of one-day-ahead MVaR forecasts for US indices rate is 1.2%. In the case of 60-day-ahead forecasts, these
and the actual exceedance rate for a = 5% is â = 5.6%, statistics are 5.1% and 1.4%, respectively. The errors are
whereas that for a = 1% is 1.7. However, in the case of Eu- smaller for the shorter horizons. However, the conditional
ropean indices, these statistics are 5.4% and 1.3% for a = 5% accuracy tests suggest that the violations are serially corre-
and 1%, respectively. This pattern can also be observed for lated for the one- and 60-day-ahead forecasts for a = 1%,
the longer horizon forecasts, although the relative forecast but improve for the intermediate horizons. The conditional
errors increase with the horizon. For example, the actual accuracy does not appear to change much with the horizon
exceedance rates â for a = 5% and 1% are 6% and 2.2% in
for a = 2.5%, but improves slightly with the horizon for
the case of 60-day-ahead MVaR forecasts for US indices,
a = 5%. Thus, on balance the two-factor model produces
while these statistics are 5.8% and 1.7%, respectively, for
unconditionally accurate MVaR forecasts for all datasets.
the European indices.
Importantly, the two-factor model performs remark- The scaling model delivers frequency-k MVaR fore-
ably well unconditionally for the bond indices, and the casts of reasonable unconditional accuracy, especially for
forecasts appear to be more accurate than in the case of shorter periods, except perhaps for the bond return projec-
stock indices. Moreover, the accuracy does not deteriorate tions. However, the p-values of the Christoffersen (1998)
substantially with the horizon (Table 4). For example, in test indicate that the MVaR violations are highly serially
the case of one-day-ahead forecasts, the actual exceedance correlated. This is not surprising, given that we move a rel-
rate â for a = 5% is 5%, whereas for a = 1%, the exceedance atively long window of 2000 observations one day at each
966 A. Polanski, E. Stoja / International Journal of Forecasting 33 (2017) 958–969

Table 3
MVaR out-of-sample forecasting results for European stock indices.
k Model a = 1% a = 2.5% a = 5%
â p -val. p -val. p -val. â p -val. p -val. p -val. â p -val. p -val. p -val.
(tu ) (LRc ) (DQ) (tu ) (LRc ) (DQ) (tu ) (LRc ) (DQ)
CAViaR 0.012 0.247 0.562 0.735 0.026 0.731 0.413 0.319 0.048 0.609 0.324 0.211
2FM 0.013 0.147 0.106 0.679 0.027 0.433 0.275 0.575 0.054 0.333 0.000 0.903
1 Scaling 0.009 0.431 0.500 0.183 0.023 0.465 0.098 0.159 0.046 0.296 0.005 0.290
2FM 0.013 0.189 0.096 0.768 0.027 0.427 0.278 0.492 0.055 0.224 0.000 0.818
5 Scaling 0.011 0.595 0.000 0.755 0.024 0.729 0.000 0.198 0.049 0.747 0.000 0.316
2FM 0.013 0.108 0.119 0.523 0.028 0.261 0.135 0.580 0.056 0.189 0.000 0.613
10 Scaling 0.015 0.017 0.000 0.007 0.025 0.887 0.000 0.466 0.051 0.653 0.000 0.348
2FM 0.014 0.043 0.146 0.576 0.031 0.052 0.094 0.924 0.056 0.176 0.000 0.571
20 Scaling 0.021 0.000 0.000 0.000 0.034 0.007 0.000 0.170 0.057 0.114 0.000 0.267
2FM 0.017 0.005 0.050 0.172 0.032 0.040 0.000 0.130 0.058 0.059 0.000 0.325
60 Scaling 0.026 0.000 0.000 0.002 0.036 0.002 0.000 0.084 0.058 0.059 0.000 0.217
Notes: The table reports the actual exception rate (α̂ ) for each MVaR forecasting model out of 3000 observations (i.e., the proportion of the time that the
forecasted MVaR is exceeded), using the p-value of the t-statistic to test the null hypothesis of unconditional accuracy (Eq. (11)) and the p-values of the
LR and DQ statistics (Eqs. (12) and (13), respectively) to test the null hypothesis of conditional accuracy for different confidence levels. The out-of-sample
period of 3000 observations is from 14 August 2007 to 31 October 2015. For the CAViaR and 2FM models, the daily MVaR forecasts are k-day-ahead forecasts,
while for scaling, the forecasts are for the frequency-k MVaR.

Table 4
MVaR out-of-sample forecasting results for European bond indices.
k Model a = 1% a = 2.5% a = 5%
â p -val. p -val. p -val. â p -val. p -val. p -val. â p -val. p -val. p -val.
(tu ) (LRc ) (DQ) (tu ) (LRc ) (DQ) (tu ) (LRc ) (DQ)
CAViaR 0.006 0.011 0.623 0.096 0.019 0.010 0.110 0.166 0.039 0.003 0.060 0.025
2FM 0.012 0.314 0.009 0.944 0.025 0.908 0.103 0.161 0.050 1.000 0.053 0.301
1 Scaling 0.007 0.049 0.586 0.346 0.019 0.024 0.445 0.051 0.042 0.037 0.134 0.058
2FM 0.012 0.311 0.077 0.924 0.026 0.809 0.063 0.205 0.050 0.920 0.025 0.168
5 Scaling 0.007 0.089 0.000 0.127 0.013 0.000 0.000 0.000 0.041 0.042 0.000 0.003
2FM 0.012 0.307 0.078 0.790 0.026 0.711 0.064 0.255 0.051 0.838 0.029 0.173
10 Scaling 0.005 0.000 0.000 0.013 0.013 0.000 0.000 0.000 0.041 0.011 0.000 0.007
2FM 0.012 0.378 0.071 0.340 0.026 0.775 0.067 0.278 0.050 0.997 0.113 0.122
20 Scaling 0.007 0.054 0.000 0.048 0.011 0.000 0.000 0.000 0.046 0.336 0.000 0.157
2FM 0.014 0.068 0.001 0.262 0.025 0.955 0.098 0.289 0.051 0.870 0.201 0.238
60 Scaling 0.004 0.000 0.000 0.008 0.009 0.000 0.000 0.000 0.053 0.370 0.000 0.442
Notes: The table reports the actual exception rate (α̂ ) for each MVaR forecasting model out of 3000 observations (i.e., the proportion of the time that the
forecasted MVaR is exceeded), using the p-value of the t-statistic to test the null hypothesis of unconditional accuracy (Eq. (11)) and the p-values of the
LR and DQ statistics (Eqs. (12) and (13), respectively) to test the null hypothesis of conditional accuracy for different confidence levels. The out-of-sample
period of 3000 observations is from 14 August 2007 to 31 October 2015. For the CAViaR and 2FM models, the daily MVaR forecasts are k-day-ahead forecasts,
while for scaling, the forecasts are for the frequency-k MVaR.

step, meaning that the resulting scaling forecasts change ahead). However, there is no obvious relationship between
very slowly and cannot anticipate clusters of turbulence. the p-values of the DQ and LRc statistics. The intuition for
There is also an interesting performance discrepancy this regularity is exemplified by a constant forecast. If this
between bonds and stocks. For bonds, the scaling model forecast generates a correct unconditional coverage, then
consistently generates pessimistic forecasts, with actual the DQ statistic in Eq. (13) takes a value of zero, giving a
exception rates that are below the nominal ones. On the p-value of one even if the violations are serially correlated.
other hand, for stocks, the scaling model generates op- On the other hand, an unconditional actual coverage that
timistic forecasts that are violated more often than they deviates significantly from the nominal level will lead to a
should be. Somewhat surprisingly, the actual exception large value of the DQ statistic in Eq. (13), and thus, a low
rate for a = 5% tends to increase for longer periods. For p-value.
example, for US indices, the actual exception rates are 0.40, One interesting question is, how do the performances
0.45, 0.48, 0.53 and 0.52 for horizons of 1, 5, 10, 20 and of the MVaR and VaR forecasts compare for a portfolio
60 days ahead, respectively. However, the scaling model made up of the same underlying series? We investigated
forecasts in this empirical exercise should be treated with this issue for an equally-weighted portfolio5 and found
caution, as the scaling exponents (slopes of the regression that, overall, equally-weighted portfolio VaR forecasts are
lines in the log–log plots) have been estimated from only comparable to MVaR forecasts. Moreover, as we discuss in
five 2i —MVaRs (i = 0, . . . , 4) in each window.
For all three models, we observe that the p-values of 5 We would like to thank the reviewer for suggesting this analysis.
the DQ and the tu statistics are well aligned (except in a To preserve space, these results are not presented in this paper, although
few instances, such as for the 1% scaling forecast 10 days they are available in Tables 4A–6A in the online Appendix.
A. Polanski, E. Stoja / International Journal of Forecasting 33 (2017) 958–969 967

the Introduction the advantage of MVaR relative to VaR is of a behavioral nature, with little or no relationship to the
in situations where a portfolio cannot be constructed and long-term fundamentals.
thus, a portfolio VaR cannot be obtained. This decomposition highlights the difficulty of long-
Our results above rely on quantile estimates that are term (M)VaR forecasting. A comprehensive forecasting
computed from samples of projections of multidimen- model should not only capture the long-term general
sional observations on the directional vector. It is well- movements in fundamentals, but also anticipate short-
known that sample quantiles are convergent and biased lived bursts of turbulence. As it is almost impossible to
estimators, whose asymptotic variances can be derived forecast the latter component accurately, well in advance,
using the delta method. A confidence interval (CI) for their it is too demanding to expect any long-term (M)VaR fore-
true value can be constructed by exploiting the binomial casting model to be conditionally accurate. Thus, we argue
property of quantiles (see for example Serfling, 1980). that the adequacy of long-term (M)VaR forecasts should
Based on this property, the exact confidence coefficient for be judged primarily on the basis of the unconditional ac-
the quantile qa in an ordered sample (x1 , . . . , xn ) can be curacy test. The conditional accuracy test, on the other
calculated from the binomial distribution with parameters hand, is relevant mainly for short-term (M)VaR forecasts.
n (sample size) and a, The practical implication of these observations is that these
models can provide institutions with only an indication of
j−1 ( )
∑ n their average long-term exposure; institutions also need
Pr xi < qa < xj = ak (1 − a)n−k .
( )
(14) to monitor their short-term exposures using short-term,
k
k=i conditionally accurate forecasting models such as CAViaR.
Table 5 reports the CIs and their lengths, computed
from the projections of observations using Eq. (14), where 6. Conclusions
xi and xj are chosen such that the probability on the r.h.s. of
Eq. (14) approximates the nominal confidence coefficient, The aggregation of multiple sources of risk sidelines
which we set to 95%. Furthermore, we also report the questions which are paramount for hedging, risk man-
CIs computed by Monte Carlo simulations from samples agement and financial stability. Interesting answers can
that were bootstrapped from the relevant data set or gen- be obtained by considering the individual sources of risks
erated from the multivariate Student-t distribution with jointly. We propose a simple and flexible framework for
parameters estimated in the same set.6 In particular, we capturing the multidimensional tail risk, which allows us
find that the CIs computed from a Student-t distribution to adapt the techniques and applications that have been
are significantly shorter than those computed using either developed for unidimensional tail risk, which is relatively
Eq. (14) or bootstrapping. This observation may cast doubts straightforward even in higher dimensions.
on the suitability of the Student-t distribution as a mod- We apply this framework to the forecasting of multidi-
elling tool for MVaR estimation. In addition, we observe mensional tail events out-of-sample at different horizons,
that the length of the CIs decreases with a, which suggests and evaluate the resulting forecasts statistically. While
a stronger confidence in the (forecasting) results for higher short horizon forecasts are both conditionally and uncon-
values of a. ditionally accurate, we find that long horizon forecasts
In line with the 2FM (cf. Eq. (6)), we argue that an MVaR are unconditionally accurate but fail the conditional accu-
forecast has two components. We conjecture that the first racy tests. However, we argue that this is to be expected,
as conditional accuracy is too demanding a criterion for
component evolves slowly and captures the evolution of
any long horizon (multidimensional) tail event forecasting
macroeconomic or other (e.g., company) fundamentals.
model. Given our understanding of and ability to model
The second component captures fast and occasionally vio-
(multidimensional) tail events, only short horizon fore-
lent but transitory movements, perhaps reflecting investor
casts should be subjected to conditional accuracy tests.
sentiment or other short-lived effects. Changes in senti-
Long horizon forecasting models of (multidimensional) tail
ment can trigger strong liquidity shocks, with a significant
events should be judged primarily on their ability to gen-
impact on the volatility (Campbell, Grossman, and Wang,
erate unconditionally accurate forecasts. In this context,
1993). In the short run, a change in one set of prices may
it would be interesting to understand the relationships
influence investor sentiment, thus triggering changes in a
between the long-term trend and short-term cycle of MVaR
seemingly unrelated set of prices (Eichengreen and Mody,
and macroeconomic and other fundamentals and investor
1998) and leading to multidimensional tail risk.
sentiment, respectively.
In this context, the unconditional Kupiec (1995) and
conditional Christoffersen (1998) tests can be linked in- Acknowledgments
tuitively to these two components of forecasts. The un-
conditional accuracy test effectively examines whether a We would like to thank the Editor Esther Ruiz, the Asso-
model is consistent with the fundamentals, and, over the ciate Editor, and an anonymous referee for their insightful
long term, generates the correct exception rates. The con- comments and suggestions that have helped to improve
ditional accuracy test, on the other hand, examines how the paper greatly. We have also benefited from discus-
well a forecasting model responds to the twists and turns sions with Richard Harris, George Bulkley, Michael Moore,
of ‘‘animal spirits’’ in the market, which, by definition, are Nick Taylor, Jon Danielsson, Jean-Pierre Zigrand, Lorenzo
Cappiello, George Kapetanios, Fernando Vega Redondo,
6 We would like to thank the Associate Editor for suggesting this Rohan Churm, Amar Radia, Vas Madouros, Paul Nahai-
analysis. Williamson, and colleagues in the Stress Testing Strategy
968 A. Polanski, E. Stoja / International Journal of Forecasting 33 (2017) 958–969

Table 5
95% confidence intervals (CI) and their lengths for MVaR estimates.
Dataset CI α = 1% α = 2.5% α = 5%
Eq. (14) (−3.62, −2.82), 0.80 (−2.48, −2.19), 0.29 (−1.99, −1.73), 0.26
EU equities Bootstrap (−3.49, −2.70), 0.79 (−2.46, −2.16), 0.30 (−1.97, −1.73), 0.24
Student-t (−3.29, −2.85), 0.44 (−2.57, −2.31), 0.26 (−2.08, −1.90), 0.18
Eq. (14) (−4.27, −3.26), 1.02 (−2.99, −2.55), 0.43 (−2.33, −2.11), 0.23
EU bonds Bootstrap (−4.22, −3.21), 1.01 (−2.93, −2.52), 0.40 (−2.32, −2.11), 0.21
Student-t (−3.91, −3.57), 0.34 (−2.92, −2.72), 0.20 (−2.29, −2.16), 0.12
Eq. (14) (−3.43, −2.63), 0.79 (−2.32, −1.94), 0.38 (−1.69, −1.48), 0.21
US indices Bootstrap (−3.29, −2.58), 0.70 (−2.31, −1.91), 0.40 (−1.67, −1.47), 0.20
Student-t (−3.13, −2.90), 0.23 (−2.43, −2.30), 0.13 (−1.99, −1.90), 0.09
Notes: Eq. (14) computes the (approximate) 95%-CI from the projections of the last 3000 observations (between 1/05/2004 and 31/10/2015) in the relevant
data set. The bootstrap (Student-t) computes the 95%-CI from 1000 samples of size 3000 each, drawn from projections of the last 3000 observations in the
relevant data set (from multivariate Student-t with parameters estimated from the last 3000 observations in the relevant data set).

Division of the Bank of England, as well as the seminar Baxter, M., & King, R. (1999). Measuring business cycles: approximate
and conference participants at the University of Bristol, band-pass filters for economic time series. Review of Economics and
Statistics, 81, 575–593.
University of East of Anglia, Bank of England, Systemic Risk
Bloom, N. (2009). The impact of uncertainty shocks. Econometrica, 77,
Centre at the LSE and European Central Bank. Parts of this 623–685.
paper were written while Evarist Stoja was a Houblon- Boudoukh, J., Richardson, M., & Whitelaw, R. F. (1998). The best of both
Norman Fellow at the Bank of England, whose hospitality worlds. Risk, 11, 64–67.
is gratefully acknowledged. The views expressed here are Brandt, M., & Jones, C. (2006). Volatility forecasting with range-based
EGARCH models. Journal of Business and Economic Statistics, 79, 61–74.
solely our own, and do not necessarily reflect those of the
Campbell, J. Y., Grossman, S. J., & Wang, J. (1993). Trading volume and
Bank of England. serial correlation in stock returns. Quarterly Journal of Economics, 108,
905–939.
Appendix A Chen, N.-F., Roll, R., & Ross, S. A. (1986). Economic forces and the stock
market. Journal of Business, 59, 383–403.
Proof of Eq. (3). Cherubini, U., & Luciano, E. (2002). Bivariate option pricing with copulas.
Applied Mathematical Finance, 9, 69–85.
v d (x) ≥ qda ⇔ x ∈ Mda . Christiano, L., & Fitzgerald, T. (2003). The band pass filter. International
Economic Review, 44, 435–465.
xi xi
⇒: v d (x) = min ≥ qda ⇒ ≥ qda , Christoffersen, P. F. (1998). Evaluating interval forecasts. International
i:di ̸ =0 di di Economic Review, 39, 841–862.
Danielsson, J., & de Vries, C. G. (2000). Value-at-Risk and extreme returns.
∀i : di ̸= 0 ⇒ x ∈ Mda . Annales d’Economie et de Statistique, 60, 239–270.
xi Durbin, J., & Koopman, S. J. (2012). Time series analysis by state space
⇐: x ∈ Mda ⇒ ≥ qda , methods. Oxford Statistical Science Series.
di
xi Eichengreen, B. & Mody, A. (1998). What explains changing spreads on
∀i : di ̸= 0 ⇒ min = v d (x) ≥ qda . emerging-market debt: fundamentals or market sentiment? NBER
i:di ̸ =0 di Working Paper 6408.
Embrechts, P., McNeil, A., & Straumann, D. (2002). Correlation and de-
pendence properties in risk management: properties and pitfalls.
Appendix B. Supplementary data In M. Dempster (Ed.), Risk management: value at risk and beyond.
Cambridge University Press.
Supplementary material related to this article can be Engle, R., & Lee, G. (1999). A permanent and transitory model of stock
found online at http://dx.doi.org/10.1016/j.ijforecast.2017. return volatility. In R. F. Engle, & H. White (Eds.), Cointegration,
causality, and forecasting: a festschrift in honor of clive W. J. Granger
05.005.
(pp. 475–497). New York: Oxford University Press.
Engle, R., & Manganelli, S. (2004). CAViaR: conditional autoregressive
References value at risk by regression quantiles. Journal of Business and Economic
Statistics, 22, 367–381.
Adrian, T., & Brunnermeier, M. (2016). CoVaR. American Economic Review, Engle, R., & Rangel, J. G. (2008). The spline GARCH model for low frequency
106, 1705–1741. volatility and its global macroeconomic causes. Review of Financial
Alizadeh, S., Brandt, M., & Diebold, F. (2002). Range-based estimation of Studies, 21, 1187–1222.
stochastic volatility models. Journal of Finance, 57, 1047–1092. European Banking Authority, (2016). Adverse macro-financial scenario
Ang, A., & Bekaert, G. (2002). International asset allocation with regime for the EBA 2016 EU-wide bank stress testing exercise. European
shifts. Review of Financial Studies, 15, 1137–1187. Systemic Risk Board, https://www.eba.europa.eu/documents/10180
Bae, K.-H., Karolyi, G. A., & Stulz, R. M. (2003). A new approach to measur- /1383302/2016+EU-wide+stress+test-Adverse+macro-financial+scen
ing financial contagion. Review of Financial Studies, 16, 717–763. ario.pdf.
Bank of England, (2015). The Bank of England’s approach to stress testing Ferson, W., & Harvey, C. R. (1998). Fundamental determinants of national
the UK banking system. Technical document available at http://w equity market returns: a perspective on conditional asset pricing.
ww.bankofengland.co.uk/financialstability/Documents/stresstesting/ Journal of Banking & Finance, 21, 1625–1665.
2015/approach.pdf. Gabaix, X. (2009). Power laws in economics and finance. Annual Review of
Bartram, S. M., Taylor, S. J., & Wang, Y.-H. (2006). The euro and Euro- Economics, 1, 255–293.
pean financial market dependence. Journal of Banking & Finance, 31, Gai, P., & Kapadia, S. (2010). Contagion in financial networks. Proceedings
1461–1481. of the Royal Society, Series A, 466, 2401–2423.
Basel Committee on Banking Supervision, (2002). Overview of the amend- Gonzáles-Rivera, G. (2014). Predicting rare events: evaluating systemic
ment to the capital accord to incorporate market risk. Technical re- and idiosyncratic risk. International Journal of Forecasting, 30,
port. 688–690.
A. Polanski, E. Stoja / International Journal of Forecasting 33 (2017) 958–969 969

Hauksson, H. A., Dacorogna, M., Domenig, T., Muller, U., & Samorodnitsky, Polanski, A., & Stoja, E. (2012). Efficient evaluation of multidimensional
G. (2001). Multivariate extremes, aggregation and risk estimation. time-varying density forecasts with applications to risk management.
Quantitative Finance, 1, 79–95. International Journal of Forecasting, 28, 343–352.
Hautsch, N., Schaumburg, J., & Schienle, M. (2014). Forecasting systemic Prékopa, A. (2012). Multivariate value at risk and related topics. Annals of
impact in financial networks. International Journal of Forecasting, 30, Operations Research, 193, 49–69.
781–794. Rogers, L., & Veraart, L. (2013). Failure and rescue in an interbank network.
Hautsch, N., Schaumburg, J., & Schienle, M. (2015). Financial network Management Science, 59, 882–898.
systemic risk contributions. Review of Finance, 19, 685–738. Serfling, R. J. (1980). Approximation theorems of mathematical statistics.
Hodrick, R., & Prescott, E. (1997). Post-war US business cycles: an empiri- New York: John Wiley & Sons.
cal investigation. Journal of Money, Credit and Banking, 29, 1–16. Su, L., & Spindler, M. (2013). Nonparametric testing for asymmetric infor-
Hull, J. C., & White, A. D. (2006). Valuing credit derivatives using an implied mation. Journal of Business and Economic Statistics, 31, 208–225.
copula approach. Journal of Derivatives, 8, 28–39. Takahashi, M., Watanabe, T., & Omori, Y. (2016). Volatility and quan-
Kalemanova, A., Schmid, B., & Werner, R. (2007). The normal inverse tile forecasts by realized stochastic volatility models with general-
Gaussian distribution for synthetic CDO pricing. Journal of Derivatives, ized hyperbolic distribution. International Journal of Forecasting, 32,
14, 80–93. 437–457.
Kuester, K., Mittnik, S., & Paolella, M. S. (2006). Value-at-Risk prediction: a Torres, R., Lillo, R. E., & Laniado, H. (2015). A directional multivariate value
comparison of alternative strategies. Journal of Financial Econometrics, at risk. Insurance: Mathematics & Economics, 65, 111–123.
4, 53–89. Zheng, S., Shi, N., & Zhang, Z. (2012). Generalized measures of correlation
Kupiec, P. H. (1995). Techniques for verifying the accuracy of risk mea- for asymmetry, nonlinearity, and beyond. Journal of the American
surement models. Journal of Derivatives, 3, 73–84. Statistical Association, 107, 1239–1252.
Lehkonen, H. (2015). Stock market integration and the global financial
crisis. Review of Finance, 19, 2039–2094.
Mandelbrot, B. (1997). Fractals and scaling in finance. New York: Springer. Arnold Polanski is a Senior Lecturer in Economics at the University of East
Massacci, D. (2016). Tail risk dynamics in stock returns: links to the Anglia. He holds a Masters Degree from the University of Bielefeld and a
macroeconomy and global markets. Management Science (in press). Ph.D. in Economics from the University of Alicante. His research interests
McNeil, A. J., & Frey, R. (2000). Estimation of tail-related risk measures are mainly in socio-economic networks, bargaining theory, and financial
for heteroscedastic financial time series: an extreme value approach. and computational economics.
Journal of Empirical Finance, 7, 271–300.
Meine, C., Supper, H., & Weiß, G. (2016). Is tail risk priced in credit default Evarist Stoja is a Reader in Finance at the University of Bristol. He received
swap premia?. Review of Finance, 20, 287–336. his Ph.D. and MBA from Xfi Centre for Finance and Investment, University
Nieto, M. R., & Ruiz, E. (2016). Frontiers in VaR forecasting and backtesting. of Exeter. His research interests are in applied financial econometrics and
International Journal of Forecasting, 32, 475–501. financial risk management.

You might also like