Intuitively, if each distribution is viewed as a unit amount of "dirt" piled on M, the metric is the minimum "cost" of turning one pile into the other, which is assumed to be the amount of dirt that needs to be moved times the distance it has to be moved. Because of this analogy, the metric is known in computer science as the earth mover's distance.
The name "Wasserstein distance" was coined by R. L. Dobrushin in 1970, after the Russian mathematician Leonid Vaseršteĭn who introduced the concept in 1969. Most English-language publications use the German spelling "Wasserstein" (attributed to the name "Vaserstein" being of German origin).
Let (M, d) be a metric space for which every probability measure on M is a Radon measure (a so-called Radon space). For p ≥ 1, let Pp(M) denote the collection of all probability measures μ on M with finite pth moment: for some x0 in M,
Then the pth Wasserstein distance between two probability measures μ and ν in Pp(M) is defined as
where Γ(μ, ν) denotes the collection of all measures on M × M with marginals μ and ν on the first and second factors respectively. (The set Γ(μ, ν) is also called the set of all couplings of μ and ν.)
The above distance is usually denoted Wp(μ, ν) (typically among authors who prefer the "Wasserstein" spelling) or ℓp(μ, ν) (typically among authors who prefer the "Vaserstein" spelling). The remainder of this article will use the Wp notation.
The Wasserstein metric may be equivalently defined by
Point masses (degenerate distributions)
Let and be two degenerate distributions (i.e. Dirac delta distributions) located at points and in . There is only one possible coupling of these two measures, namely the point mass located at . Thus, using the usual absolute value function as the distance function on , for any , the -Wasserstein distance between and is
By similar reasoning, if and are point masses located at points and in , and we use the usual Euclidean norm on as the distance function, then
Let and be two non-degenerate Gaussian measures (i.e. normal distributions) on , with respective expected values and and symmetric positive semi-definite covariance matrices and . Then, with respect to the usual Euclidean norm on , the 2-Wasserstein distance between and is
This result generalises the earlier example of the Wasserstein distance between two point masses (at least in the case ), since a point mass can be regarded as a normal distribution with covariance matrix equal to zero, in which case the trace term disappears and only the term involving the Euclidean distance between the means remains.
The Wasserstein metric is a natural way to compare the probability distributions of two variables X and Y, where one variable is derived from the other by small, non-uniform perturbations (random or deterministic).
It can be shown that Wp satisfies all the axioms of a metric on Pp(M). Furthermore, convergence with respect to Wp is equivalent to the usual weak convergence of measures plus convergence of the first pth moments.
Dual representation of W1
where Lip(f) denotes the minimal Lipschitz constant for f.
Compare this with the definition of the Radon metric:
If the metric d is bounded by some constant C, then
and so convergence in the Radon metric (identical to total variation convergence when M is a Polish space) implies convergence in the Wasserstein metric, but not vice versa.
Separability and completeness
- Lévy metric
- Lévy–Prokhorov metric
- Total variation distance of probability measures
- Transportation theory
- Earth mover's distance
||This article includes a list of references, but its sources remain unclear because it has insufficient inline citations. (July 2012) (Learn how and when to remove this template message)|
- Olkin, I. and Pukelsheim, F. (1982). "The distance between two random vectors with given dispersion matrices". Linear Algebra Appl. 48: 257–263. ISSN 0024-3795. doi:10.1016/0024-3795(82)90112-4.
- Bogachev, V.I.; Kolesnikov, A.V. "The Monge-Kantorovich problem: achievements, connections, and perspectives". Russian Math. Surveys. 67: 785–890. doi:10.1070/RM2012v067n05ABEH004808.
- Ambrosio, L., Gigli, N. & Savaré, G. (2005). Gradient Flows in Metric Spaces and in the Space of Probability Measures. Basel: ETH Zürich, Birkhäuser Verlag. ISBN 3-7643-2428-7.
- Jordan, Richard; Kinderlehrer, David; Otto, Felix (1998). "The variational formulation of the Fokker-Planck equation". SIAM J. Math. Anal. 29 (1): 1–17 (electronic). ISSN 0036-1410. MR 1617171. doi:10.1137/S0036141096303359.
- Rüschendorf, L. (2001) , "Wasserstein metric", in Hazewinkel, Michiel, Encyclopedia of Mathematics, Springer Science+Business Media B.V. / Kluwer Academic Publishers, ISBN 978-1-55608-010-4