In linear algebra, an idempotent matrix is a matrix which, when multiplied by itself, yields itself. That is, the matrix M is idempotent if and only if MM = M. For this product MM to be defined, M must necessarily be a square matrix. Viewed this way, idempotent matrices are idempotent elements of matrix rings.
Examples of a and a idempotent matrix are and , respectively.
Real 2 × 2 case
If a matrix is idempotent, then
- implying so or
- implying so or
If b = c, the matrix will be idempotent provided so a satisfies the quadratic equation
which is a circle with center (1/2, 0) and radius 1/2. In terms of an angle θ,
- is idempotent.
However, b = c is not a necessary condition: any matrix
- with is idempotent.
With the exception of the identity matrix, an idempotent matrix is singular; that is, its number of independent rows (and columns) is less than its number of rows (and columns). This can be seen from writing , assuming that M has full rank (is non-singular), and pre-multiplying by to obtain .
When an idempotent matrix is subtracted from the identity matrix, the result is also idempotent. This holds since
- [I − M][I − M] = I − M − M + M2 = I − M − M + M = I − M.
A matrix A is idempotent if and only if for all positive integers n, . The 'if' direction trivially follows by taking . The 'only if' part can be shown using proof by induction. Clearly we have the result for , as . Suppose that . Then, , as required. Hence by the principle of induction, the result follows.
An idempotent matrix is always diagonalizable and its eigenvalues are either 0 or 1. The trace of an idempotent matrix — the sum of the elements on its main diagonal — equals the rank of the matrix and thus is always an integer. This provides an easy way of computing the rank, or alternatively an easy way of determining the trace of a matrix whose elements are not specifically known (which is helpful in statistics, for example, in establishing the degree of bias in using a sample variance as an estimate of a population variance).
Idempotent matrices arise frequently in regression analysis and econometrics. For example, in ordinary least squares, the regression problem is to choose a vector β of coefficient estimates so as to minimize the sum of squared residuals (mispredictions) ei: in matrix form,
Here both M and (the latter being known as the hat matrix) are idempotent and symmetric matrices, a fact which allows simplification when the sum of squared residuals is computed:
The idempotency of M plays a role in other calculations as well, such as in determining the variance of the estimator .
- Chiang, Alpha C. (1984). Fundamental Methods of Mathematical Economics (3rd ed.). New York: McGraw–Hill. p. 80. ISBN 0070108137.
- Greene, William H. (2003). Econometric Analysis (5th ed.). Upper Saddle River, NJ: Prentice–Hall. pp. 808–809. ISBN 0130661899.
- Horn, Roger A.; Johnson, Charles R. (1990). Matrix analysis. Cambridge University Press. p. p. 148. ISBN 0521386322.