Roll's critique

Roll's critique is a famous analysis of the validity of empirical tests of the capital asset pricing model (CAPM) by Richard Roll. It concerns methods to formally test the statement of the CAPM, the equation

$E(R_{i})=R_{f}+\beta _{im}[E(R_{m})-R_{f}].\,$

This equation relates an asset's expected return $E(R_{i})$ to the asset's sensitivity $\beta _{im}$ to the market portfolio return $R_{m}$. The market return is defined as the wealth-weighted sum of all investment returns in the economy.

Roll's critique makes two statements regarding the market portfolio:

1. Mean-variance tautology: Any mean-variance efficient portfolio $R_{p}$ satisfies the CAPM equation exactly:

$E(R_{i})=R_{f}+\beta _{ip}[E(R_{p})-R_{f}]\,$.

(A portfolio is mean-variance efficient if there is no portfolio that has a higher return and lower risk than those for the efficient portfolio.) Mean-variance efficiency of the market portfolio is equivalent to the CAPM equation holding. This statement is a mathematical fact, requiring no model assumptions.

Given a proxy for the market portfolio, testing the CAPM equation is equivalent to testing mean-variance efficiency of the portfolio. The CAPM is tautological if the market is assumed to be mean-variance efficient.

2. The market portfolio is unobservable: The market portfolio in practice would necessarily include every single possible available asset, including real estate, precious metals, stamp collections, jewelry, and anything with any worth. The returns on all possible investments opportunities are unobservable.

From statement 1, validity of the CAPM is equivalent to the market being mean-variance efficient with respect to all investment opportunities. Without observing all investment opportunities, it is not possible to test whether this portfolio, or indeed any portfolio, is mean-variance efficient. Consequently, it is not possible to test the CAPM.

Relationship to the APT

The mean-variance tautology argument applies to the arbitrage pricing theory and all asset-pricing models of the form

$E(R_{i})=\alpha +\beta _{1}F_{1}+...+\beta _{N}F_{N}.\,$

where $F_{1},...,F_{N}\,$ are unspecified factors. If the factors are returns on a mean-variance portfolio, the equation holds exactly.

It is always possible to identify in-sample mean-variance efficient portfolios within a dataset of returns. Consequently, it is also always possible to construct in-sample asset pricing models that exactly satisfy the above pricing equation. This is an example of data dredging.

Discussion

Roll's critique has received a large number of citations in the financial economics literature, with tens of citations per year as of 2017–2019. The majority of these citations refer to the second statement of critique; few papers address the first statement. Many researchers and practitioners interpret Roll's critique as stating only that "the market portfolio is unobservable".

References

• Roll, Richard (March 1977), "A critique of the asset pricing theory's tests Part I: On past and potential testability of the theory", Journal of Financial Economics, 4 (2): 129–176, doi:10.1016/0304-405X(77)90009-5