Multiset

From Wikipedia, the free encyclopedia

In mathematics, a multiset (or bag) is a generalization of a set. While each member of a set has only one membership, a member of a multiset can have more than one membership (meaning that there may be multiple instances of a member in a multiset, not that a single member instance may appear simultaneously in several multisets). The term "multiset" was coined by Nicolaas Govert de Bruijn in the 1970s.^[1] The use of multisets in mathematics predates the name "multiset" by nearly 90 years. Richard Dedekind used multisets in a paper published in 1888.^[2]

[edit] Overview

The total number of elements in a multiset, including repeated memberships, is the cardinality of the multiset. The number of times an element belongs to the multiset is the multiplicity of that member. For example, in the multiset {a, a, b, b, b, c} the multiplicities of the members a, b, and c are respectively 2, 3, and 1, and the cardinality of the multiset is 6.

In multisets, as in sets and in contrast to tuples, the order of elements is irrelevant. The following list displays the difference between the three concepts. Note how a (finite) multiset can also be considered as an unordered tuple:

The tuples (a, b) and (b, a) are not equal because in tuples order is important. The tuples (a, a) and (a) are not equal either because in tuples and multisets multiplicity is considered, affecting cardinality.

The multisets {a, b} and {b, a} are equal because in multisets order is unimportant. The multisets {a, a} and {a} are not equal as they have different cardinalities.

The sets {a, b} and {b, a} are equal, like the multisets {a, b} and {b, a}. The sets {a, a} and {a} are equal, unlike the multisets {a, a} and {a}. This is because in sets the concept of multiplicity does not exist. As such, most authors consider {a, a} to be a syntactically incorrect notation for a set.

[edit] Formal definition

Within set theory, a multiset can be formally defined as a pair (A, m) where A is some set and m : A → N_≥1 is a function from A to the set N_≥1 = {1, 2, 3, ...} of positive natural numbers. The set A is called the underlying set of elements. For each a in A the multiplicity (that is, number of occurrences) of a is the number m(a). If a universe U in which the elements of A must live is specified, the definition can be simplified to just a multiplicity function m_U : U → N from U to the set N = {0, 1, 2, 3, ...} of natural numbers, obtained by extending m to U with values 0 outside A. This extended multiplicity function is the multiplicity function called 1_A below. Like any function, the function m may be defined as its graph: the set of ordered pairs { (a, m(a)) : a in A }. With these definitions the multiset written as { a, a, b } is defined as ({ a, b },{ (a, 2), (b, 1) }), and the multiset { a, b } is defined as ({ a, b },{ (a, 1), (b, 1) }).

The concept of a multiset is a generalization of the concept of a set. A multiset corresponds to an ordinary set if the multiplicity of every element is one (as opposed to some larger natural number). However to replace set theory by "multiset theory" so as to have multisets directly into the foundations is not easy: a privileged role would still have to be given to (ordinary) sets when defining maps, as there is no clear notion of maps (functions) between multisets. It can be done, with the result that classical theorems such as the Cantor–Bernstein–Schroeder theorem or Cantor's theorem, when generalized to multisets, are false; they remain true only in the case of finite multisets. In addition, the notion of a set as a "class of items satisfying a certain property" - i.e. the extension of a predicate - is used throughout mathematics, and this notion lacks a sensible generalization to multisets with multiple memberships.

One advantage of treating multisets in their own right (as primitive, rather than defined in terms of something else) is that one can talk naturally about multiplicity 0 without having to admit that multisets are infinite - in the classical sense - since multisets have automatically their own notion of size.

An indexed family, ( a_i ), where i is in some index-set, may define a multiset, sometimes written { a_i }, in which the multiplicity of any element x is the number of indices i such that a_i = x. The condition for this to be possible is that no element occurs infinitely many times in the family: even in an infinite multiset, the multiplicities must be finite numbers.

[edit] Multiplicity function

Let us first consider the set indicator function of a normal set, then generalize this concept to the multiplicity function for multisets. The set indicator function of a subset $\ A$ of a set $\ X$ is the function

$\mathbf{1}_A : X \to \lbrace 0,1 \rbrace \,$

defined by

$\mathbf{1}_A(x) = \left\{\begin{matrix} 1 &\mbox{if}\ x \in A, \\ 0 &\mbox{if}\ x \notin A. \end{matrix}\right.$

The set indicator function of the intersection of sets is the minimum function of the indicator functions

$\mathbf{1}_{A\cap B}(x) = \min\{\mathbf{1}_A(x),\mathbf{1}_B(x)\}$

The set indicator function of the union of sets is the maximum function of the indicator functions

$\mathbf{1}_{A\cup B}(x) = \max\{{\mathbf{1}_A(x),\mathbf{1}_B(x)}\}$

The set indicator function of a subset is smaller than or equal to that of the superset

$A\subseteq B \Leftrightarrow \mathbf{1}_{A}(x) \le \mathbf{1}_{B}(x)$

The set indicator function of a cartesian product is the product of the indicator functions of the cartesian factors

$\mathbf{1}_{A \times B}(x,y) = \mathbf{1}_A(x) \cdot\mathbf{1}_B(y)$

The cardinality of a (finite) set is the sum of the indicator function values

$|A|=\sum_{x\in X} \mathbf{1}_{A}(x)$

Now generalize the concept of set indicator function by releasing the constraint that the values are 0 and 1 only and allow the values 2, 3, 4 and so on. The resulting function is called a multiplicity function and such a function defines a multiset. The concepts of intersection, union, subset, cartesian product and cardinality of multisets are defined by the above formulas.

The multiplicity function of a join, sometimes called the sum, is the sum of the multiplicity functions

$\mathbf{1}_{A \uplus B}(x) = \mathbf{1}_A(x) + \mathbf{1}_B(x)$ .

A small finite multiset, A, is represented by a list where each element, x, occurs as many times as the multiplicity, 1_A(x), indicates.

$\{1,1\} \cap \{1,2\} = \{1\}$

$\{1,1\} \cup \{1,2\} = \{1,1,2\}$

$\{1,1\} \subseteq \{1,1,1,2\}$

$\left|\{1,1\}\right|=2$

$\{1,1\} \times \{1,2\} = \{(1,1), (1,1), (1,2), (1,2)\}$

$\{1,1\} \uplus \{1,2\} = \{1,1,1,2\}$

[edit] Examples

One of the simplest and most natural examples is the multiset of prime factors of a number n. Here the underlying set of elements is the set of prime divisors of n. For example the number 120 has the prime factorization

120 = 2 33151

which gives the multiset {2, 2, 2, 3, 5}.

A related example is the multiset of solutions of an algebraic equation. A quadratic equation, for example, has two solutions. However, in some cases they are both the same number. Thus the multiset of solutions of the equation could be { 3, 5 }, or it could be { 4, 4 }. In the latter case it has a solution of multiplicity 2.

[edit] Free commutative monoids

The free commutative monoid on a set X (see free object) can be taken to be the set of finite multisets with elements drawn from X, with the monoid operation being multiset join. Such monoids are also known as (finite) formal sums of elements of X with natural coefficents.

Free abelian groups are formal sums (i.e. linear combinations) of elements of X with integer coefficients. Equivalently, they may be seen as signed finite multisets with elements drawn from X.

[edit] Multiset coefficients

[edit] Polynomial notation

The set {x} may be represented by the monomial x. The set of subsets, { {}, {x} } , is represented by the binomial 1 + x.

The set {x,y} may be represented by the monomial x·y. The set of subsets, { {}, {x}, {y}, {x,y} } , is represented by the polynomial

(1 + x)·(1 + y) = 1 + x + y + x·y.

The multiset {x,x} may be represented by the monomial x·x = x². The multiset of submultisets, { {}, {x}, {x}, {x,x} } , is represented by the polynomial

(1 + x)² = 1 + x + x + x·x = 1 + 2·x + x².

The multiset of submultisets of the multiset xⁿ is

$(1+x)^n=\sum_{k=0}^n{n \choose k}\cdot x^k.$

That is why the binomial coefficient counts the number of k-combinations of an n-set.

The multiset x^K·y^N−K , containing N elements, K of which are hits, is called a statistical population, and a submultiset is called a statistical sample. The set of samples is

(1 + x)^K·(1 + y)^N−K

which by the binomial theorem equals

$\sum_{n=0}^N\sum_{k=0}^K{K \choose k}\cdot{N-K \choose n-k}\cdot x^k\cdot y^{n-k}.$

So the number of n-samples with k hits is

${K \choose k}\cdot{N-K \choose n-k}$

See hypergeometric distribution and inferential statistics for further on the distribution of hits.

The infinite set of finite multisets of elements taken from the set {x}:

{ {}, {x}, {x,x}, {x,x,x}, ... }

may be represented by the formal power series

S = 1 + x + x² + x³ + ... = 1 + xS .

The formal solution,

S = (1 − x)⁻¹,

makes sense as a set of multisets, but the intermediate result, 1−x, does not make sense as a set of multisets.

The infinite set of finite multisets of elements taken from the set x·y is

(1 − x)⁻¹·(1 − y)⁻¹ = 1 + (x + y) + (x² + x·y + y²) + ...

The special case y=x : The infinite multiset of finite multisets of elements taken from the multiset x² is

(1 − x)⁻² = 1 + 2·x + 3·x² + ...

The general case: The infinite multiset of finite multisets of elements taken from the multiset xⁿ is

$(1-x)^{-n}=\sum_{k=0}^\infty{-n \choose k} \cdot(-x)^k$ .

This explains why "multisets are negative sets". The negative binomial coefficients count the number of k-multisets of elements taken from an n-set.

[edit] Cumulant generating function

A non-negative integer, n, can be represented by the monomial xⁿ . A finite multiset of non-negative integers, say {2, 2, 2, 3, 5}, can likewise be represented by a polynomial f(x), say f(x) = 3·x² + x³ + x⁵ .

It is convenient to consider the cumulant generating function g(t) = log(f(e^t)), say g(t) = log(3·e^2·t + e^3·t + e^5·t) .

The cardinality of the multiset is e^g(0) = f(1), say 3 + 1 + 1 = 5.

The derivative g is g '(t) = f(e^t)⁻¹·f '(e^t)·e^t, say g '(t) = (3·e^2·t + e^3·t + e^5·t)⁻¹·(6·e^2·t + 3·e^3·t + 5·e^5·t) .
- The mean value of the multiset is μ = g '(0) = f(1)⁻¹·f '(1), say μ = (3+1+1)⁻¹·(6+3+5) = 2.8 .
- The variance of the multiset is σ² = g ' '(0) .

The numbers ( μ, σ², ··· ) = ( g '(0), g ' '(0), ··· ) are called cumulants.

The infinite set of non-negative integers {0, 1, 2, ···} is represented by the formal power series 1 + x + x² + ··· = (1 − x)⁻¹. The mean value and standard deviation are undefined. Nevertheless it has a cumulant-generating function, g(t) = −log(1−e^t). The derivative of this cumulant-generating function is g '(t) = (e^−t−1)⁻¹.

A finite multiset of real numbers , A = { A_i }, is represented by the cumulant generating function

$g_{A}(t) = \log \left(\sum_{i} e^{t \cdot A_i}\right) .$

This representation is unique: different multisets have different cumulant generating functions. See partition function (statistical mechanics) for the case where the numbers in question are the energy levels of a physical system.

The cumulant-generating function of a multiset of n real numbers having mean μ and standard deviation σ is: g(t) = log(n) + μ·t + 2⁻¹·(σ·t)² + ··· , and the derivative is simply: g '(t) = μ + σ²·t + ···

The cumulant-generating function of set, {k}, consisting of a single real number, k, is g(t) = k·t , and the derivative is the number itself: g '(t) = k . So the concept of the derivative of the cumulant generating function of a multiset of real numbers is a generalization of the concept of a real number.

The cumulant-generating function of a constant multiset, {k, k, k, k, ··· , k} of n elements all equal to the same real number k, is g(t) = log(n)+k·t , and the derivative is the number itself: g '(t) = k , irrespective of n.

The cumulant-generating function of the multiset of sums of elements of two multisets of numbers is the sum of the two cumulant-generating functions:

$g_{A+B}(t) = \log \left(\sum_i \sum_j e^{t\cdot(A_i+B_j)}\right) = \log \left(\sum_i\sum_j e^{t\cdot A_i}\cdot e^{t\cdot B_j}\right) \,$

$= \log \left(\sum_i e^{t\cdot A_i}\cdot \sum_j e^{t\cdot B_j}\right) = \log \left(\sum_i e^{t\cdot A_i}\right)+ \log\left(\sum_j e^{t\cdot B_j}\right) = g_A(t) + g_B(t).$

There is unfortunately no general formula for computing the cumulant generating function of a product

$g_{A\cdot B}(t) = \log \left(\sum_i\sum_j e^{t\cdot A_i\cdot B_j}\right) \,$

but the special case of a constant times a multiset of numbers is:

$g_{k\cdot A}(t) = \log \left(\sum_{i} e^{t\cdot (k\cdot A_i)}\right) = \log \left(\sum_{i} e^{(t\cdot k)\cdot A_i}\right) = g_{A}\left(k\cdot t\right).$

The multiset 2·A = {2·A_i} is not the same multiset as 2×A =A+A = {A_i+A_j}. For example, 2·{+1,−1} = {+2,−2} while 2×{+1,−1} = {+1,−1} + {+1,−1} = {+1+1,+1−1,−1+1,−1−1} = {+2,0,0,−2}.

$g_{k\times A}(t) = k\cdot g_{A}(t).$

The standard normal distribution is like a limit of big multisets of numbers.

$\lim_{k \rarr \infty}k^{-1}\cdot (k^2\times \{+1,-1\}).$

This limit does not make sense as a multiset of numbers, but the derivative of the cumulant generating functions of the multisets in question makes sense, and the limit is well defined.

$\begin{align} \lim_{k \rarr \infty} g'_{k^{-1}\cdot (k^2\times \{+1,-1\})}(t) & = \lim_{k \rarr \infty} \frac{d(k^2\cdot \log(e^{+t\cdot k^{-1}}+e^{-t\cdot k^{-1}}))}{dt} \\ & = \lim_{k \rarr \infty} \frac{d(k^2\cdot \log(2)+2^{-1}\cdot t^2+\cdots)}{dt}=t. \end{align}$

The constant term k²·log(2) vanishes by differentiation. The terms ··· vanish in the limit. So for the standard normal distribution, having mean 0 and standard deviation 1, the derivative of the cumulant generating function is simply g '(t) = t . For the normal distribution having mean μ and standard deviation σ, the derivative of the cumulant generating function is g '(t) = μ + σ²·t .

[edit] Footnotes

^ Knuth, Donald E. (1998). The Art of Computer Programming - Vol. 2: Seminumerical Algorithms (3rd edition ed.). Addison Wesley. pp. 694. ISBN 0201896842. Knuth also lists other names that were proposed for multisets, such as list, bunch, bag, heap, sample, weighted set, collection, and suite.
^ Syropoulos, Apostolos (2001), p. 347

[edit] References

Blizard, Wayne D. (1989) "Multiset theory," Notre Dame Journal of Formal Logic, Volume 30, Number 1, Winter: pp. 36-66. doi:doi:10.1305/ndjfl/1093634995 http://projecteuclid.org/euclid.ndjfl/1093634995 MR990203 0668.03027
Bogart, Kenneth P. (2000). Introductory combinatorics, 3rd. ed. San Diego CA: Harcourt.
Gessel, Ira M., and Richard P. Stanley (1995) "Algebraic enumeration" in Graham, R. L., M. Grötschel, & L. Lovász, eds., Handbook of combinatorics, Vol. 2. Elsevier: 1021-1061. ISBN 0-444-82351-4, 0-444-88002-X, 0-262-07171-1, 0-262-07169-X.

Multisets are discussed on pp. 1036-1039.

Hickman, J. L. (1980) "A note on the concept of multiset," Bulletin of the Australian Mathematical Society 22: 211-17.
Stanley, Richard P. (1997, 1999) Enumerative Combinatorics, Vols. 1 and 2. Cambridge University Press. ISBN 0-521-55309-1, 0-521-56069-1.
Syropoulos, Apostolos (2001) "Mathematics of Multisets" in C. S. Calude et al., eds., Multiset processing: Mathematical, computer science, and molecular computing points of view, LNCS 2235. Springer-Verlag: 347-358.

[0] Knuth, Donald E. (1998). The Art of Computer Programming - Vol. 2: Seminumerical Algorithms (3rd edition ed.). Addison Wesley. pp. 694. ISBN 0201896842. Knuth also lists other names that were proposed for multisets, such as list, bunch, bag, heap, sample, weighted set, collection, and suite.

[1] Syropoulos, Apostolos (2001), p. 347

[1]

[2]

Multiset

From Wikipedia, the free encyclopedia

Contents

[edit] Overview

[edit] Formal definition

[edit] Multiplicity function

[edit] Examples

[edit] Free commutative monoids

[edit] Multiset coefficients

[edit] Polynomial notation

[edit] Cumulant generating function

[edit] Footnotes

[edit] References

Views

Personal tools

Navigation

Search

Interaction

Toolbox

Languages