In the world of finance and investments, statistical arbitrage is used in two related but distinct ways:
- In academic literature, "statistical arbitrage" is opposed to (deterministic) arbitrage. In deterministic arbitrage, a sure profit can be obtained from being long some securities and short others. In statistical arbitrage, there is a statistical mispricing of one or more assets based on the expected value of these assets. In other words, statistical arbitrage conjectures statistical mispricings of price relationships that are true in expectation, in the long run when repeating a trading strategy.
- Among those who follow the hedge fund industry, "statistical arbitrage" refers to a particular category of hedge funds (other categories include global macro, convertible arbitrage, and so on). In this narrower sense, statistical arbitrage is often abbreviated as Stat Arb or StatArb. According to Andrew Lo, StatArb "refers to highly technical short-term mean reversion strategies involving large numbers of securities (hundreds to thousands, depending on the amount of risk capital), very short holding periods (measured in days to seconds), and substantial computational, trading, and information technology (IT) infrastructure".
As a trading strategy, statistical arbitrage is a heavily quantitative and computational approach to equity trading. It involves data mining and statistical methods, as well as automated trading systems.
Historically, StatArb evolved out of the simpler pairs trade strategy, in which stocks are put into pairs by fundamental or market-based similarities. When one stock in a pair outperforms the other, the poorer performing stock is bought long with the expectation that it will climb towards its outperforming partner, the other is sold short. Mathematically speaking, the strategy is to find a pair of stocks with high cointegration (only high correlation is not enough). The time series of the two stocks must be non-stationary (Kalman filter can be used as for the test). This hedges risk from whole-market movements. Various statistical tools have been used in the context of pairs trading ranging from simple distance-based approaches to more complex tools such as cointegration and copula concepts.
StatArb considers not pairs of stocks but a portfolio of a hundred or more stocks—some long, some short—that are carefully matched by sector and region to eliminate exposure to beta and other risk factors. Portfolio construction is automated and consists of two phases. In the first or "scoring" phase, each stock in the market is assigned a numeric score or rank that reflects its desirability; high scores indicate stocks that should be held long and low scores indicate stocks that are candidates for shorting. The details of the scoring formula vary and are highly proprietary, but, generally (as in pairs trading), they involve a short term mean reversion principle so that, e.g., stocks that have done unusually well in the past week receive low scores and stocks that have underperformed receive high scores. In the second or "risk reduction" phase, the stocks are combined into a portfolio in carefully matched proportions so as to eliminate, or at least greatly reduce, market and factor risk. This phase often uses commercially available risk models like MSCI/Barra/APT/Northfield/Risk Infotech/Axioma to constrain or eliminate various risk factors.
Broadly speaking, StatArb is actually any strategy that is bottom-up, beta-neutral in approach and uses statistical/econometric techniques in order to provide signals for execution. Signals are often generated through a contrarian mean reversion principle but can also be designed using such factors as lead/lag effects, corporate activity, short-term momentum, etc. This is usually referred to[by whom?] as a multi-factor approach to StatArb.
Because of the large number of stocks involved, the high portfolio turnover and the fairly small size of the effects one is trying to capture, the strategy is often implemented in an automated fashion and great attention is placed on reducing trading costs.
Statistical arbitrage has become a major force at both hedge funds and investment banks. Many bank proprietary operations now center to varying degrees around statistical arbitrage trading.
In a general sense, statistical arbitrage is only demonstrably correct as the amount of trading time approaches infinity and the liquidity, or size of an allowable bet, approaches infinity. Over any finite period of time, a series of low probability events may occur that impose heavy short-term losses. If those short-term losses are greater than the liquidity available to the trader, default may occur, as in the case of Long-Term Capital Management.
Statistical arbitrage is also subject to model weakness as well as stock- or security-specific risk. The statistical relationship on which the model is based may be spurious, or may break down due to changes in the distribution of returns on the underlying assets. Factors, which the model may not be aware of having exposure to, could become the significant drivers of price action in the markets, and the inverse applies also. The existence of the investment based upon model itself may change the underlying relationship, particularly if enough entrants invest with similar principles. The exploitation of arbitrage opportunities themselves increases the efficiency of the market, thereby reducing the scope for arbitrage, so continual updating of models is necessary.
On a stock-specific level, there is risk of M&A activity or even default for an individual name. Such an event would immediately invalidate the significance of any historical relationship assumed from empirical statistical analysis of the past data.
Stat-arb and systemic risk: events of summer 2007
During July and August 2007, a number of StatArb (and other Quant type) hedge funds experienced significant losses at the same time, which is difficult to explain unless there was a common risk factor. While the reasons are not yet fully understood, several published accounts blame the emergency liquidation of a fund that experienced capital withdrawals or margin calls. By closing out its positions quickly, the fund put pressure on the prices of the stocks it was long and short. Because other StatArb funds had similar positions, due to the similarity of their alpha models and risk-reduction models, the other funds experienced adverse returns. One of the versions of the events describes how Morgan Stanley's highly successful StatArb fund, PDT, decided to reduce its positions in response to stresses in other parts of the firm, and how this contributed to several days of hectic trading.
In a sense, the fact of a stock being heavily involved in StatArb is itself a risk factor, one that is relatively new and thus was not taken into account by the StatArb models. These events showed that StatArb has developed to a point where it is a significant factor in the marketplace, that existing funds have similar positions and are in effect competing for the same returns. Simulations of simple StatArb strategies by Khandani and Lo show that the returns to such strategies have been reduced considerably from 1998 to 2007, presumably because of competition.
Statistical arbitrage faces different regulatory situations in different countries or markets. In many countries where the trading security or derivatives are not fully developed, investors find it infeasible or unprofitable to implement statistical arbitrage in local markets.
In China, quantitative investment including statistical arbitrage is not the mainstream approach to investment. A set of market conditions restricts the trading behavior of funds and other financial institutions. The restriction on short selling as well as the market stabilization mechanisms (e.g. daily limit) set heavy obstacles when either individual investors or institutional investors try to implement the trading strategy implied by statistical arbitrage theory.
- Currency correlation
- Fourier-related transforms
- Machine learning
- Volatility arbitrage
- Time series
- Bondarenko, O. (2003). "Statistical Arbitrage and Securities Prices". Review of Financial Studies. 16 (3): 875–919. doi:10.1093/rfs/hhg016.
- "Statistical Arbitrage". TheFreeDictionary.com.
- Andrew W. Lo (2010). Hedge Funds: An Analytic Perspective (Revised and expanded ed.). Princeton University Press. p. 260. ISBN 0-691-14598-9.
- Mahdavi Damghani, Babak (2013). "The Non-Misleading Value of Inferred Correlation: An Introduction to the Cointelation Model". Wilmott. 2013 (1): 50–61. doi:10.1002/wilm.10252.
- Rad, Hossein; Low, Rand Kwong Yew; Faff, Robert (2016-04-27). "The profitability of pairs trading strategies: distance, cointegration and copula methods". Quantitative Finance. 0 (0): 1–18. doi:10.1080/14697688.2016.1164337. ISSN 1469-7688.
- Avellaneda, Marco (Spring 2011). "Risk and Portfolio Management; Statistical Arbitrage" (PDF). Courant Institute of Mathematical Sciences. Retrieved 2015-03-30.
- For example, Andrew Lo (op.cit.) states "the widespread use of standardized factor risk models such as those from MSCI/BARRA or Northfield Information Systems ... will almost certainly create common exposures among those managers to the risk factors contained in such platforms"
- "Quant Congress: Models not to blame for stat arb crisis." Author: Peter Madigan, Risk magazine, 9 July 2008 http://www.risk.net/risk-magazine/news/1505311/quant-congress-models-blame-stat-arb-crisis
- Lowenstein, Roger (2000). When Genius Failed: The Rise and Fall of Long-Term Capital Management. Random House. ISBN 0-375-50317-X.
- Mahdavi Damghani, Babak (2012). "The Misleading Value of Measured Correlation". Wilmott. 2012 (1): 64–73. doi:10.1002/wilm.10167.
- Amir Khandani and Andrew Lo. What Happened to the Quants In August 2007?
- Scott Patterson (2010-01-22). "The Minds Behind the Meltdown". Wall Street Journal Online. Retrieved 2011-06-06.
- Amir Khandani and Andrew Lo. What Happened to the Quants in August 2007?: Evidence from Factors and Transactions Data
- Mahdavi Damghani, Babak (2013). "De-arbitraging With a Weak Smile: Application to Skew Risk". Wilmott. 2013 (1): 40–49. doi:10.1002/wilm.10201.
- Avellaneda, M. and J.H. Lee: "Statistical arbitrage in the US equities market". A well documented empirical study which confirms that StatArb profitability dropped after 2002 and 2003.
- Bertram, W.K., 2009, Analytic Solutions for Optimal Statistical Arbitrage Trading, Available at SSRN: http://ssrn.com/abstract=1505073.
- Bertram, W.K., 2009, Optimal Trading Strategies for Ito Diffusion Processes, Physica A, Forthcoming. Available at SSRN: http://ssrn.com/abstract=1371903. Presents a robust theoretical framework for statistical arbitrage trading.
- Richard Bookstaber: A Demon Of Our Own Design, Wiley (2006). Describes: the birth of Stat Arb at Morgan Stanley in the mid-1980s, out of the pairs trading ideas of Gerry Bamberger. The eclipse of the concept after the departure of Bamberger for Newport/Princeton Partners and of D.E. Shaw to start his own StatArb firm. And finally the revival of StatArb at Morgan Stanley under Peter Muller in 1992. Includes this comment (p. 194): “Statistical arbitrage is now past its prime. In mid-2002 the performance of stat arb strategies began to wane, and the standard methods have not recovered.”
- Jegadeesh, N., 1990, 'Evidence of Predictable Behavior of Security Returns', Journal of Finance 45, p. 881–898. An important early article (along with Lehmann’s) about short term return predictability, the source of StatArb returns
- Kolman, Joe (1998). "Inside D. E. Shaw". Derivatives Strategy. Retrieved 23 June 2013.
- Lehmann, B., 1990, 'Fads, Martingales, and Market Efficiency', Quarterly Journal of Economics 105, pp. 1–28. First article in the open literature to document the short term return-reversal effect that early StatArb funds exploited.
- Ed Thorp: A Perspective on Quantitative Finance – Models for Beating the Market Autobiographical piece describing Ed Thorp's stat arb work in the early and mid-1980s (see p. 5)
- Ed Thorp: Statistical Arbitrage, Wilmott Magazine, June 2008 (Part1 Part2 Part3 Part4 Part5 Part6). More reminiscences from the early days of StatArb from one of its pioneers.