Row and column vectors

In linear algebra, a column vector or column matrix is an m × 1 matrix, that is, a matrix consisting of a single column of m elements,

${\boldsymbol {x}}={\begin{bmatrix}x_{1}\\x_{2}\\\vdots \\x_{m}\end{bmatrix}}\,.$

Similarly, a row vector or row matrix is a 1 × m matrix, that is, a matrix consisting of a single row of m elements

${\boldsymbol {x}}={\begin{bmatrix}x_{1}&x_{2}&\dots &x_{m}\end{bmatrix}}\,.$

Throughout, boldface is used for the row and column vectors. The transpose (indicated by T) of a row vector is a column vector

${\begin{bmatrix}x_{1}\;x_{2}\;\dots \;x_{m}\end{bmatrix}}^{\rm {T}}={\begin{bmatrix}x_{1}\\x_{2}\\\vdots \\x_{m}\end{bmatrix}}\,,$

and the transpose of a column vector is a row vector

${\begin{bmatrix}x_{1}\\x_{2}\\\vdots \\x_{m}\end{bmatrix}}^{\rm {T}}={\begin{bmatrix}x_{1}\;x_{2}\;\dots \;x_{m}\end{bmatrix}}\,.$

The set of all row vectors forms a vector space called row space; similarly, the set of all column vectors forms a vector space called column space. The dimensions of the row and column spaces equals the number of entries in the row or column vector.

The column space can be viewed as the dual space to the row space, since any linear functional on the space of column vectors can be represented uniquely as an inner product with a specific row vector.

Notation

To simplify writing column vectors in-line with other text, sometimes they are written as row vectors with the transpose operation applied to them.

${\boldsymbol {x}}={\begin{bmatrix}x_{1}\;x_{2}\;\dots \;x_{m}\end{bmatrix}}^{\rm {T}}$

or

${\boldsymbol {x}}={\begin{bmatrix}x_{1},x_{2},\dots ,x_{m}\end{bmatrix}}^{\rm {T}}$

Some authors also use the convention of writing both column vectors and row vectors as rows, but separating row vector elements with commas and column vector elements with semicolons (see alternative notation 2 in the table below).

	Row vector	Column vector
Standard matrix notation (array spaces, no commas, transpose signs)	${\begin{bmatrix}x_{1}\;x_{2}\;\dots \;x_{m}\end{bmatrix}}$	${\begin{bmatrix}x_{1}\\x_{2}\\\vdots \\x_{m}\end{bmatrix}}{\text{ or }}{\begin{bmatrix}x_{1}\;x_{2}\;\dots \;x_{m}\end{bmatrix}}^{\rm {T}}$
Alternative notation 1 (commas, transpose signs)	${\begin{bmatrix}x_{1},x_{2},\dots ,x_{m}\end{bmatrix}}$	${\begin{bmatrix}x_{1},x_{2},\dots ,x_{m}\end{bmatrix}}^{\rm {T}}$
Alternative notation 2 (commas and semicolons, no transpose signs)	${\begin{bmatrix}x_{1},x_{2},\dots ,x_{m}\end{bmatrix}}$	${\begin{bmatrix}x_{1};x_{2};\dots ;x_{m}\end{bmatrix}}$

Operations

Matrix multiplication involves the action of multiplying each row vector of one matrix by each column vector of another matrix.

The dot product of two vectors a and b is equivalent to the matrix product of the row vector representation of a and the column vector representation of b,

$\mathbf {a} \cdot \mathbf {b} =\mathbf {a} \mathbf {b} ^{\mathrm {T} }={\begin{bmatrix}a_{1}&a_{2}&a_{3}\end{bmatrix}}{\begin{bmatrix}b_{1}\\b_{2}\\b_{3}\end{bmatrix}}=a_{1}b_{1}+a_{2}b_{2}+a_{3}b_{3}\,,$

which is also equivalent to the matrix product of the row vector representation of b and the column vector representation of a,

$\mathbf {b} \cdot \mathbf {a} =\mathbf {b} \mathbf {a} ^{\mathrm {T} }={\begin{bmatrix}b_{1}&b_{2}&b_{3}\end{bmatrix}}{\begin{bmatrix}a_{1}\\a_{2}\\a_{3}\end{bmatrix}}\,.$

The matrix product of a column and a row vector gives the outer product of two vectors a and b, an example of the more general tensor product. The matrix product of the column vector representation of a and the row vector representation of b gives the components of their dyadic product,

$\mathbf {a} \otimes \mathbf {b} =\mathbf {a} ^{\mathrm {T} }\mathbf {b} ={\begin{bmatrix}a_{1}\\a_{2}\\a_{3}\end{bmatrix}}{\begin{bmatrix}b_{1}&b_{2}&b_{3}\end{bmatrix}}={\begin{bmatrix}a_{1}b_{1}&a_{1}b_{2}&a_{1}b_{3}\\a_{2}b_{1}&a_{2}b_{2}&a_{2}b_{3}\\a_{3}b_{1}&a_{3}b_{2}&a_{3}b_{3}\\\end{bmatrix}}\,,$

which is the transpose of the matrix product of the column vector representation of b and the row vector representation of a,

$\mathbf {b} \otimes \mathbf {a} =\mathbf {b} ^{\mathrm {T} }\mathbf {a} ={\begin{bmatrix}b_{1}\\b_{2}\\b_{3}\end{bmatrix}}{\begin{bmatrix}a_{1}&a_{2}&a_{3}\end{bmatrix}}={\begin{bmatrix}b_{1}a_{1}&b_{1}a_{2}&b_{1}a_{3}\\b_{2}a_{1}&b_{2}a_{2}&b_{2}a_{3}\\b_{3}a_{1}&b_{3}a_{2}&b_{3}a_{3}\\\end{bmatrix}}\,.$

Preferred input vectors for matrix transformations

Frequently a row vector presents itself for an operation within n-space expressed by an n × n matrix M,

$vM=p\,.$

Then p is also a row vector and may present to another n × n matrix Q,

$pQ=t\,.$

Conveniently, one can write t = p Q = v MQ telling us that the matrix product transformation MQ can take v directly to t. Continuing with row vectors, matrix transformations further reconfiguring n-space can be applied to the right of previous outputs.

In contrast, when a column vector is transformed to become another column under an n × n matrix action, the operation occurs to the left,

$p^{\mathrm {T} }=Mv^{\mathrm {T} }\,,\quad t^{\mathrm {T} }=Qp^{\mathrm {T} }$,

leading to the algebraic expression QM v^T for the composed output from v^T input. The matrix transformations mount up to the left in this use of a column vector for input to matrix transformation.

The column vector approach to matrix transformation leads to a right-to-left orientation for successive transformations. In geometric transformations described by matrices, the two approaches are related by the transpose operator. Though equivalent, the fact that directionality of English text is left-to-right has led some English authors to have a preference for the row vector input to matrix transformation:

For instance, this row vector input convention has been used to good effect by Raiz Usmani, where on page 106 the convention allows the statement "The product mapping ST of U into W [is given] by:

$\alpha (ST)=(\alpha S)T=\beta T=\gamma$."

(The Greek letters represent row vectors).

Ludwik Silberstein used row vectors for spacetime events; he applied Lorentz transformation matrices on the right in his Theory of Relativity in 1914 (see page 143). In 1963 when McGraw-Hill published Differential Geometry by Heinrich Guggenheimer of the University of Minnesota, he used the row vector convention in chapter 5, "Introduction to transformation groups" (eqs. 7a,9b and 12 to 15). When H. S. M. Coxeter reviewed Linear Geometry by Rafael Artzy, he wrote, "[Artzy] is to be congratulated on his choice of the 'left-to-right' convention, which enables him to regard a point as a row matrix instead of the clumsy column that many authors prefer." J. W. P. Hirschfeld used right multiplication of row vectors by matrices in his description of projectivities on the Galois geometry PG(1,q).

In the study of stochastic processes with a stochastic matrix, it is conventional to use a row vector as the stochastic vector.

See also

• Covariance and contravariance of vectors
• Index notation
• Vector of ones
• Single-entry vector
• Standard unit vector
• Unit vector

References

See also: Linear algebra § Further reading

• Axler, Sheldon Jay (1997), Linear Algebra Done Right (2nd ed.), Springer-Verlag, ISBN 0-387-98259-0
• Lay, David C. (August 22, 2005), Linear Algebra and Its Applications (3rd ed.), Addison Wesley, ISBN 978-0-321-28713-7
• Meyer, Carl D. (February 15, 2001), Matrix Analysis and Applied Linear Algebra, Society for Industrial and Applied Mathematics (SIAM), ISBN 978-0-89871-454-8, archived from the original on March 1, 2001
• Poole, David (2006), Linear Algebra: A Modern Introduction (2nd ed.), Brooks/Cole, ISBN 0-534-99845-3
• Anton, Howard (2005), Elementary Linear Algebra (Applications Version) (9th ed.), Wiley International
• Leon, Steven J. (2006), Linear Algebra With Applications (7th ed.), Pearson Prentice Hall