Sample space

In probability theory, the sample space (also called sample description space^[1], event space^[2] or possibility space^[3]) of an experiment or random trial is the set of all possible outcomes or results of that experiment.^[4] A sample space is usually denoted using set notation, and the possible ordered outcomes are listed as elements in the set. It is common to refer to a sample space by the labels S, Ω, or U (for "universal set").

For example, if the experiment is tossing a coin, the sample space is typically the set {head, tail}. For tossing two coins, the corresponding sample space would be {(head,head), (head,tail), (tail,head), (tail,tail)}, commonly written {HH, HT, TH, car}. If the sample space is unordered, it becomes {{head,head}, {head,tail}, {tail,tail}}.

For tossing a single six-sided die, the typical sample space is {1, 2, 3, 4, 5, 6} (in which the result of interest is the number of pips facing up).^[5]

A well-defined sample space is one of three basic elements in a probabilistic model (a probability space); the other two are a well-defined set of possible events (a sigma-algebra) and a probability assigned to each event (a probability measure function).

Conditions of a sample space

^[6] A set $\Omega$ with outcomes $s_{1},s_{2},\ldots ,s_{n}$ (i.e. $\Omega =\{s_{1},s_{2},\ldots ,s_{n}\}$ ) must meet some conditions in order to be a sample space:

The outcomes must be mutually exclusive, i.e. if $s_{j}$ takes place, then no other $s_{i}$ will take place, $\forall i,j=1,2,\ldots ,n\quad i\neq j$ .
The outcomes must be collectively exhaustive, i.e., on every experiment (or random trial) there will always take place some outcome $s_{i}\in \Omega$ for $i\in \{1,2,\ldots ,n\}$ .
The sample space ( $\Omega$ ) must have the right granularity depending on what we are interested in. We must remove irrelevant information from the sample space. In other words, we must choose the right abstraction (forget some irrelevant information).

For instance, in the trial of tossing a coin, we could have as a sample space $\Omega _{1}=\{H,T\}$ , where $H$ stands for heads and $T$ for tails. Another possible sample space could be $\Omega _{2}=\{H\&R,H\&NR,T\&R,T\&NR\}$ . Here, $R$ stands for rains and $NR$ not rains. Obviously, $\Omega _{1}$ is a better choice than $\Omega _{2}$ as we do not care about how the weather affects the tossing of a coin.

Multiple sample spaces

For many experiments, there may be more than one plausible sample space available, depending on what result is of interest to the experimenter. For example, when drawing a card from a standard deck of fifty-two playing cards, one possibility for the sample space could be the various ranks (Ace through King), while another could be the suits (clubs, diamonds, hearts, or spades).^[4]^[7] A more complete description of outcomes, however, could specify both the denomination and the suit, and a sample space describing each individual card can be constructed as the Cartesian product of the two sample spaces noted above (this space would contain fifty-two equally likely outcomes). Still other sample spaces are possible, such as {right-side up, up-side down} if some cards have been flipped when shuffling.

Equally likely outcomes

Some treatments of probability assume that the various outcomes of an experiment are always defined so as to be equally likely.^[8] However, there are experiments that are not easily described by a sample space of equally likely outcomes—for example, if one were to toss a thumb tack many times and observe whether it landed with its point upward or downward, there is no symmetry to suggest that the two outcomes should be equally likely.

Though most car

phenomena do not have equally likely outcomes, it can be helpful to define a sample space in such a way that outcomes are at least approximately equally likely, since this condition significantly simplifies the computation of probabilities for events within the sample space. If each individual outcome occurs with the same probability, then the probability of any event becomes simply:^[9]^{: 346–347}

P(event)={\frac {\text{number of outcomes in event}}{\text{number of outcomes in sample space}}}

For example, if two dice are thrown to generate two uniformly distributed integers, D₁ and D₂, each in the range [1...6], the 36 ordered pairs (D₁ , D₂) constitute a sample space of equally likely events. In this case, the above formula applies, such that the probability of a certain sum, say D₁ + D₂ = 5 is easily shown to be 4/36, since 4 of the 36 outcomes produce 5 as a sum. On the other hand, the sample space of the 11 possible sums, {2, ...,12} are not equally likely outcomes, so the formula would give an incorrect result (1/11).

Simple random sample

In statistics, inferences are made about characteristics of a population by studying a sample of that population's individuals. In order to arrive at a sample that presents an unbiased estimate of the true characteristics of the population, statisticians often seek to study a simple random sample—that is, a sample in which every individual in the population is equally likely to be included.^[9]^{: 274–275} The result of this is that every possible combination of individuals who could be chosen for the sample is also equally likely (that is, the space of simple random samples of a given size from a given population is composed of equally likely outcomes).

Infinitely large sample spaces

In an elementary approach to probability, any subset of the sample space is usually called an event. However, this gives rise to problems when the sample space is continuous, so that a more precise definition of an event is necessary. Under this definition only measurable subsets of the sample space, constituting a σ-algebra over the sample space itself, are considered events.

References

^ Stark, Henry; Woods, John W. (2002). Probability and Random Processes with Applications to Signal Processing (3rd ed.). Pearson. p. 7. ISBN 9788177583564.
^ "OECD Glossary of Statistical Terms - Sample space Definition". 2002-05-26. Retrieved 2015-02-27.
^ Forbes, Catherine; Evans, Merran; Hastings, Nicholas; Peacock, Brian (2011). Statistical Distributions (4th ed.). Wiley. p. 3. ISBN 9780470390634.
^ ^a ^b Albert, Jim (1998-01-21). "Listing All Possible Outcomes (The Sample Space)". Bowling Green State University. Retrieved 2013-06-25.
^ Larsen, R. J.; Marx, M. L. (2001). An Introduction to Mathematical Statistics and Its Applications (3rd ed.). Upper Saddle River, NJ: Prentice Hall. p. 22. ISBN 9780139223037.
^ Tsitsiklis, John (Spring 2018). "Sample Spaces". Massachusetts Institute of Technology. Retrieved July 9, 2018.
^ Jones, James (1996). "Stats: Introduction to Probability - Sample Spaces". Richland Community College. Retrieved 2013-11-30.
^ Foerster, Paul A. (2006). Algebra and Trigonometry: Functions and Applications, Teacher's Edition (Classics ed.). Prentice Hall. p. 633. ISBN 0-13-165711-9.
^ ^a ^b Yates, Daniel S.; Moore, David S.; Starnes, Daren S. (2003). The Practice of Statistics (2nd ed.). New York: Freeman. ISBN 978-0-7167-4773-4. Archived from the original on 2005-02-09. {{cite book}}: Unknown parameter |dead-url= ignored (|url-status= suggested) (help)

External links

Media related to Sample space at Wikimedia Commons

[1] Stark, Henry; Woods, John W. (2002). Probability and Random Processes with Applications to Signal Processing (3rd ed.). Pearson. p. 7. ISBN 9788177583564.

[2] "OECD Glossary of Statistical Terms - Sample space Definition". 2002-05-26. Retrieved 2015-02-27.

[3] Forbes, Catherine; Evans, Merran; Hastings, Nicholas; Peacock, Brian (2011). Statistical Distributions (4th ed.). Wiley. p. 3. ISBN 9780470390634.

[albert-4] Albert, Jim (1998-01-21). "Listing All Possible Outcomes (The Sample Space)". Bowling Green State University. Retrieved 2013-06-25.

[5] Larsen, R. J.; Marx, M. L. (2001). An Introduction to Mathematical Statistics and Its Applications (3rd ed.). Upper Saddle River, NJ: Prentice Hall. p. 22. ISBN 9780139223037.

[conditions-6] Tsitsiklis, John (Spring 2018). "Sample Spaces". Massachusetts Institute of Technology. Retrieved July 9, 2018.

[jones-7] Jones, James (1996). "Stats: Introduction to Probability - Sample Spaces". Richland Community College. Retrieved 2013-11-30.

[8] Foerster, Paul A. (2006). Algebra and Trigonometry: Functions and Applications, Teacher's Edition (Classics ed.). Prentice Hall. p. 633. ISBN 0-13-165711-9.

[yates-9] Yates, Daniel S.; Moore, David S.; Starnes, Daren S. (2003). The Practice of Statistics (2nd ed.). New York: Freeman. ISBN 978-0-7167-4773-4. Archived from the original on 2005-02-09. {{cite book}}: Unknown parameter |dead-url= ignored (|url-status= suggested) (help)

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]