Autoregressive conditional heteroskedasticity

Autoregressive conditional heteroskedasticity (ARCH) is the condition that one or more data points in a series for which the variance of the current error term or innovation is a function of the actual sizes of the previous time periods' error terms: often the variance is related to the squares of the previous innovations. In econometrics, ARCH models are used to characterize and model time series.^[1] A variety of other acronyms are applied to particular structures that have a similar basis.

ARCH models are commonly employed in modeling financial time series that exhibit time-varying volatility clustering, i.e. periods of swings interspersed with periods of relative calm. ARCH-type models are sometimes considered to be in the family of stochastic volatility models, although this is strictly incorrect since at time t the volatility is completely pre-determined (deterministic) given previous values.^[2]

ARCH(q) model specification

To model a time series using an ARCH process, let $~\epsilon _{t}~$ denote the error terms (return residuals, with respect to a mean process), i.e. the series terms. These $~\epsilon _{t}~$ are split into a stochastic piece $z_{t}$ and a time-dependent standard deviation $\sigma _{t}$ characterizing the typical size of the terms so that

~\epsilon _{t}=\sigma _{t}z_{t}~

The random variable $z_{t}$ is a strong white noise process. The series $\sigma _{t}^{2}$ is modelled by

\sigma _{t}^{2}=\alpha _{0}+\alpha _{1}\epsilon _{t-1}^{2}+\cdots +\alpha _{q}\epsilon _{t-q}^{2}=\alpha _{0}+\sum _{i=1}^{q}\alpha _{i}\epsilon _{t-i}^{2}

where $~\alpha _{0}>0~$ and $\alpha _{i}\geq 0,~i>0$ .

An ARCH(q) model can be estimated using ordinary least squares. A methodology to test for the lag length of ARCH errors using the Lagrange multiplier test was proposed by Engle (1982). This procedure is as follows:

Estimate the best fitting autoregressive model AR(q) $y_{t}=a_{0}+a_{1}y_{t-1}+\cdots +a_{q}y_{t-q}+\epsilon _{t}=a_{0}+\sum _{i=1}^{q}a_{i}y_{t-i}+\epsilon _{t}$ .
Obtain the squares of the error ${\hat {\epsilon }}^{2}$ and regress them on a constant and q lagged values:

${\hat {\epsilon }}_{t}^{2}={\hat {\alpha }}_{0}+\sum _{i=1}^{q}{\hat {\alpha }}_{i}{\hat {\epsilon }}_{t-i}^{2}$

where q is the length of ARCH lags.
The null hypothesis is that, in the absence of ARCH components, we have $\alpha _{i}=0$ for all $i=1,\cdots ,q$ . The alternative hypothesis is that, in the presence of ARCH components, at least one of the estimated $\alpha _{i}$ coefficients must be significant. In a sample of T residuals under the null hypothesis of no ARCH errors, the test statistic T'R² follows $\chi ^{2}$ distribution with q degrees of freedom, where $T'$ is the number of equations in the model which fits the residuals vs the lags (i.e. $T'=T-q$ ). If T'R² is greater than the Chi-square table value, we reject the null hypothesis and conclude there is an ARCH effect in the ARMA model. If T'R² is smaller than the Chi-square table value, we do not reject the null hypothesis.

GARCH

If an autoregressive moving average model (ARMA model) is assumed for the error variance, the model is a generalized autoregressive conditional heteroscedasticity(GARCH)^[3] model.

In that case, the GARCH (p, q) model (where p is the order of the GARCH terms $~\sigma ^{2}$ and q is the order of the ARCH terms $~\epsilon ^{2}$ ), following the notation of original paper is given by

$y_{t}=x'_{t}b+\epsilon _{t}$

$\epsilon _{t}|\psi _{t}\sim {\mathcal {N}}(0,\sigma _{t}^{2})$

$\sigma _{t}^{2}=\omega +\alpha _{1}\epsilon _{t-1}^{2}+\cdots +\alpha _{q}\epsilon _{t-q}^{2}+\beta _{1}\sigma _{t-1}^{2}+\cdots +\beta _{p}\sigma _{t-p}^{2}=\omega +\sum _{i=1}^{q}\alpha _{i}\epsilon _{t-i}^{2}+\sum _{i=1}^{p}\beta _{i}\sigma _{t-i}^{2}$

Generally, when testing for heteroscedasticity in econometric models, the best test is the White test. However, when dealing with time series data, this means to test for ARCH and GARCH errors.

Exponentially weighted moving average (EWMA) is an alternative model in a separate class of exponential smoothing models. As an alternative to GARCH modelling it has some attractive properties such as a greater weight upon more recent observations, but also drawbacks such as an arbitrary decay factor that introduces subjectivity into the estimation.

GARCH(p, q) model specification

The lag length p of a GARCH(p, q) process is established in three steps:

Estimate the best fitting AR(q) model

$y_{t}=a_{0}+a_{1}y_{t-1}+\cdots +a_{q}y_{t-q}+\epsilon _{t}=a_{0}+\sum _{i=1}^{q}a_{i}y_{t-i}+\epsilon _{t}$ .
Compute and plot the autocorrelations of $\epsilon ^{2}$ by

$\rho ={{\sum _{t=i+1}^{T}({\hat {\epsilon }}_{t}^{2}-{\hat {\sigma }}_{t}^{2})({\hat {\epsilon }}_{t-1}^{2}-{\hat {\sigma }}_{t-1}^{2})} \over {\sum _{t=1}^{T}({\hat {\epsilon }}_{t}^{2}-{\hat {\sigma }}_{t}^{2})^{2}}}$
The asymptotic, that is for large samples, standard deviation of $\rho (i)$ is $1/{\sqrt {T}}$ . Individual values that are larger than this indicate GARCH errors. To estimate the total number of lags, use the Ljung-Box test until the value of these are less than, say, 10% significant. The Ljung-Box Q-statistic follows $\chi ^{2}$ distribution with n degrees of freedom if the squared residuals $\epsilon _{t}^{2}$ are uncorrelated. It is recommended to consider up to T/4 values of n. The null hypothesis states that there are no ARCH or GARCH errors. Rejecting the null thus means that such errors exist in the conditional variance.

NGARCH

Nonlinear GARCH (NGARCH) is also known as Nonlinear Asymmetric GARCH(1,1) (NAGARCH).^[4]
$~\sigma _{t}^{2}=~\omega +~\alpha (~\epsilon _{t-1}-~\theta ~\sigma _{t-1})^{2}+~\beta ~\sigma _{t-1}^{2}$

$~\alpha ,~\beta \geq 0;~\omega >0$ .
For stock returns, parameter $~\theta$ is usually estimated to be positive; in this case, it reflects the leverage effect, signifying that negative returns increase future volatility by a larger amount than positive returns of the same magnitude.^[5]^[6]

This model should not be confused with the NARCH model, together with the NGARCH extension, introduced by Higgins and Bera in 1992.^{[clarification needed]}

IGARCH

Integrated Generalized Autoregressive Conditional heteroscedasticity I GARCH is a restricted version of the GARCH model, where the persistent parameters sum up to one, and imports a unit root in the GARCH process. The condition for this is

$\sum _{i=1}^{p}~\beta _{i}+\sum _{i=1}^{q}~\alpha _{i}=1$ .

EGARCH

The exponential generalized autoregressive conditional heteroskedastic (EGARCH) model by Nelson (1991) is another form of the GARCH model. Formally, an EGARCH(p,q):

$\log \sigma _{t}^{2}=\omega +\sum _{k=1}^{q}\beta _{k}g(Z_{t-k})+\sum _{k=1}^{p}\alpha _{k}\log \sigma _{t-k}^{2}$

where $g(Z_{t})=\theta Z_{t}+\lambda (|Z_{t}|-E(|Z_{t}|))$ , $\sigma _{t}^{2}$ is the conditional variance, $\omega$ , $\beta$ , $\alpha$ , $\theta$ and $\lambda$ are coefficients. $Z_{t}$ may be a standard normal variable or come from a generalized error distribution. The formulation for $g(Z_{t})$ allows the sign and the magnitude of $Z_{t}$ to have separate effects on the volatility. This is particularly useful in an asset pricing context.^[7]

Since $\log \sigma _{t}^{2}$ may be negative there are no (fewer) restrictions on the parameters. E-GARCH model mean Exponential General Autoregressive Conditional Hetroskedacity. This model is introduced by Nelson & Cao (1991). They claim that plus or nonnegative limitation are prohibiting in GARCH model. Whether there is no limitation in EGARCH model. This model is required no restriction This is also a form of GARCH model, for the reason is that it has no long variation on the condition whether change itself

GARCH-M

The GARCH-in-mean (GARCH-M) model adds a heteroscedasticity term into the mean equation. It has the specification:

$y_{t}=~\beta x_{t}+~\lambda ~\sigma _{t}+~\epsilon _{t}$

The residual $~\epsilon _{t}$ is defined as:

$~\epsilon _{t}=~\sigma _{t}~\times z_{t}$

QGARCH

The Quadratic GARCH (QGARCH) model by Sentana (1995) is used to model asymmetric effects of positive and negative shocks.

In the example of a GARCH(1,1) model, the residual process $~\sigma _{t}$ is

$~\epsilon _{t}=~\sigma _{t}z_{t}$

where $z_{t}$ is i.i.d. and

$~\sigma _{t}^{2}=K+~\alpha ~\epsilon _{t-1}^{2}+~\beta ~\sigma _{t-1}^{2}+~\phi ~\epsilon _{t-1}$

GJR-GARCH

Similar to QGARCH, The Glosten-Jagannathan-Runkle GARCH (GJR-GARCH) model by Glosten, Jagannathan and Runkle (1993) also models asymmetry in the ARCH process. The suggestion is to model $~\epsilon _{t}=~\sigma _{t}z_{t}$ where $z_{t}$ is i.i.d., and

$~\sigma _{t}^{2}=K+~\delta ~\sigma _{t-1}^{2}+~\alpha ~\epsilon _{t-1}^{2}+~\phi ~\epsilon _{t-1}^{2}I_{t-1}$

where $I_{t-1}=0$ if $~\epsilon _{t-1}\geq 0$ , and $I_{t-1}=1$ if $~\epsilon _{t-1}<0$ .

TGARCH model

The Threshold GARCH (TGARCH) model by Zakoian (1994) is similar to GJR GARCH. The specification is one on conditional standard deviation instead of conditional variance:

$~\sigma _{t}=K+~\delta ~\sigma _{t-1}+~\alpha _{1}^{+}~\epsilon _{t-1}^{+}+~\alpha _{1}^{-}~\epsilon _{t-1}^{-}$

where $~\epsilon _{t-1}^{+}=~\epsilon _{t-1}$ if $~\epsilon _{t-1}>0$ , and $~\epsilon _{t-1}^{+}=0$ if $~\epsilon _{t-1}\leq 0$ . Likewise, $~\epsilon _{t-1}^{-}=~\epsilon _{t-1}$ if $~\epsilon _{t-1}\leq 0$ , and $~\epsilon _{t-1}^{-}=0$ if $~\epsilon _{t-1}>0$ .

fGARCH

Hentschel's fGARCH model,^[8] also known as Family GARCH, is an omnibus model that nests a variety of other popular symmetric and asymmetric GARCH models including APARCH, GJR, AVGARCH, NGARCH, etc.

COGARCH

In 2004, Claudia Klüppelberg, Alexander Lindner and Ross Maller proposed a continuous-time generalization of the discrete-time GARCH(1,1) process. The idea is to start with the GARCH(1,1) model equations

\epsilon _{t}=\sigma _{t}z_{t},

\sigma _{t}^{2}=\alpha _{0}+\alpha _{1}\epsilon _{t-1}^{2}+\beta _{1}\sigma _{t-1}^{2}=\alpha _{0}+\alpha _{1}\sigma _{t-1}^{2}z_{t-1}^{2}+\beta _{1}\sigma _{t-1}^{2},

and then to replace the strong white noise process $z_{t}$ by the infinitesimal increments $\mathrm {d} L_{t}$ of a Lévy process $(L_{t})_{t\geq 0}$ , and the squared noise process $z_{t}^{2}$ by the increments $\mathrm {d} [L,L]_{t}^{\mathrm {d} }$ , where

[L,L]_{t}^{\mathrm {d} }=\sum _{s\in [0,t]}(\Delta L_{t})^{2},\quad t\geq 0,

is the purely discontinuous part of the quadratic variation process of $L$ . The result is the following system of stochastic differential equations:

\mathrm {d} G_{t}=\sigma _{t-}\,\mathrm {d} L_{t},

\mathrm {d} \sigma _{t}^{2}=(\beta -\eta \sigma _{t}^{2})\,\mathrm {d} t+\varphi \sigma _{t-}^{2}\,\mathrm {d} [L,L]_{t}^{\mathrm {d} },

where the positive parameters $\beta$ , $\eta$ and $\varphi$ are determined by $\alpha _{0}$ , $\alpha _{1}$ and $\beta _{1}$ . Now given some initial condition $(G_{0},\sigma _{0}^{2})$ , the system above has a pathwise unique solution $(G_{t},\sigma _{t}^{2})_{t\geq 0}$ which is then called the continuous-time GARCH (COGARCH) model.^[9]

References

^ Engle, Robert F. (1982). "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation". Econometrica. 50 (4): 987–1007. JSTOR 1912773.
^ Brooks, Chris (2014). Introductory Econometrics for Finance (3rd ed.). Cambridge: Cambridge University Press. p. 461. ISBN 9781107661455.
^ Bollerslev (1986)
^ Engle and Ng in 1993
^ Engle, R.F.; Ng, V.K. (1991). "Measuring and testing the impact of news on volatility". Journal of Finance. 48 (5): 1749–1778. doi:10.1111/j.1540-6261.1993.tb05127.x.
^ Posedel, Petra (2006). "Analysis Of The Exchange Rate And Pricing Foreign Currency Options On The Croatian Market: The Ngarch Model As An Alternative To The Black Scholes Model" (PDF). Financial Theory and Practice. 30 (4): 347–368.
^ St. Pierre, Eilleen F. (1998). "Estimating EGARCH-M Models: Science or Art". The Quarterly Review of Economics and Finance. 38 (2): 167–180. doi:10.1016/S1062-9769(99)80110-0.
^ Hentschel, Ludger (1995). "All in the family Nesting symmetric and asymmetric GARCH models". Journal of Financial Economics. 39 (1): 71–104. doi:10.1016/0304-405X(94)00821-H.
^ Klüppelberg, C.; Lindner, A.; Maller, R. (2004). "A continuous-time GARCH process driven by a Lévy process: stationarity and second-order behaviour". Journal of Applied Probability. 41 (3): 601–622. doi:10.1239/jap/1091543413.

v t e Stochastic processes
Discrete time	Bernoulli process Branching process Chinese restaurant process Galton–Watson process Independent and identically distributed random variables Markov chain Moran process Random walk Loop-erased Self-avoiding Biased Maximal entropy
Continuous time	Additive process Bessel process Birth–death process pure birth Brownian motion Bridge Excursion Fractional Geometric Meander Cauchy process Contact process Continuous-time random walk Cox process Diffusion process Dyson Brownian motion Empirical process Feller process Fleming–Viot process Gamma process Geometric process Hawkes process Hunt process Interacting particle systems Itô diffusion Itô process Jump diffusion Jump process Lévy process Local time Markov additive process McKean–Vlasov process Ornstein–Uhlenbeck process Poisson process Compound Non-homogeneous Schramm–Loewner evolution Semimartingale Sigma-martingale Stable process Superprocess Telegraph process Variance gamma process Wiener process Wiener sausage
Both	Branching process Gaussian process Hidden Markov model (HMM) Markov process Martingale Differences Local Sub- Super- Random dynamical system Regenerative process Renewal process Stochastic chains with memory of variable length White noise
Fields and other	Dirichlet process Gaussian random field Gibbs measure Hopfield model Ising model Potts model Boolean network Markov random field Percolation Pitman–Yor process Point process Cox Poisson Random field Random graph
Time series models	Autoregressive conditional heteroskedasticity (ARCH) model Autoregressive integrated moving average (ARIMA) model Autoregressive (AR) model Autoregressive–moving-average (ARMA) model Generalized autoregressive conditional heteroskedasticity (GARCH) model Moving-average (MA) model
Financial models	Binomial options pricing model Black–Derman–Toy Black–Karasinski Black–Scholes Chan–Karolyi–Longstaff–Sanders (CKLS) Chen Constant elasticity of variance (CEV) Cox–Ingersoll–Ross (CIR) Garman–Kohlhagen Heath–Jarrow–Morton (HJM) Heston Ho–Lee Hull–White Korn-Kreer-Lenssen LIBOR market Rendleman–Bartter SABR volatility Vašíček Wilkie
Actuarial models	Bühlmann Cramér–Lundberg Risk process Sparre–Anderson
Queueing models	Bulk Fluid Generalized queueing network M/G/1 M/M/1 M/M/c
Properties	Càdlàg paths Continuous Continuous paths Ergodic Exchangeable Feller-continuous Gauss–Markov Markov Mixing Piecewise-deterministic Predictable Progressively measurable Self-similar Stationary Time-reversible
Limit theorems	Central limit theorem Donsker's theorem Doob's martingale convergence theorems Ergodic theorem Fisher–Tippett–Gnedenko theorem Large deviation principle Law of large numbers (weak/strong) Law of the iterated logarithm Maximal ergodic theorem Sanov's theorem Zero–one laws (Blumenthal, Borel–Cantelli, Engelbert–Schmidt, Hewitt–Savage, Kolmogorov, Lévy)
Inequalities	Burkholder–Davis–Gundy Doob's martingale Doob's upcrossing Kunita–Watanabe Marcinkiewicz–Zygmund
Tools	Cameron–Martin formula Convergence of random variables Doléans-Dade exponential Doob decomposition theorem Doob–Meyer decomposition theorem Doob's optional stopping theorem Dynkin's formula Feynman–Kac formula Filtration Girsanov theorem Infinitesimal generator Itô integral Itô's lemma Karhunen–Loève theorem Kolmogorov continuity theorem Kolmogorov extension theorem Lévy–Prokhorov metric Malliavin calculus Martingale representation theorem Optional stopping theorem Prokhorov's theorem Quadratic variation Reflection principle Skorokhod integral Skorokhod's representation theorem Skorokhod space Snell envelope Stochastic differential equation Tanaka Stopping time Stratonovich integral Uniform integrability Usual hypotheses Wiener space Classical Abstract
Disciplines	Actuarial mathematics Control theory Econometrics Ergodic theory Extreme value theory (EVT) Large deviations theory Mathematical finance Mathematical statistics Probability theory Queueing theory Renewal theory Ruin theory Signal processing Statistics Stochastic analysis Time series analysis Machine learning
List of topics Category

v t e Volatility
Modelling volatility	Implied volatility Volatility smile Volatility clustering Local volatility Stochastic volatility Jump-diffusion models ARCH and GARCH
Trading volatility	Volatility arbitrage Straddle Volatility swap IVX VIX