Campbell's theorem (probability)
In probability theory and statistics, Campbell's theorem or the Campbell-Hardy theorem can refer to a particular equation or set of results relating to the expectation of a function summed over a point process to an integral involving the mean measure of the point process, which allows for the calculation of expected value and variance of the random sum. One version of the theorem, also known as Campbell's formula,:28 entails an integral equation for the aforementioned sum over a general point process, and not necessarily a Poisson point process. There also exist equations involving moment measures and factorial moment measures that are considered versions of Campbell's formula. All these results are employed in probability and statistics with a particular importance in the theory of point processes and queueing theory as well as the related fields stochastic geometry, continuum percolation theory, and spatial statistics.
Another result by the name of Campbell's theorem is specifically for the Poisson point process and gives a method for calculating moments as well as the Laplace functional of a Poisson point process.
The name of both theorems stems from the work by Norman R. Campbell on thermionic noise, also known as shot noise, in vacuum tubes, which was partly inspired by the work of Ernest Rutherford and Hans Geiger on alpha particle detection, where the Poisson point process arose as a solution to a family of differential equations by Harry Bateman. In Campbell's work, he presents the moments and generating functions of the random sum of a Poisson process on the real line, but remarks that the main mathematical argument was due to G. H. Hardy, which has inspired the result to be sometimes called the Campbell-Hardy theorem.
- 1 Background
- 2 First definition: general point process
- 3 Applications: Random sums
- 4 Generalizations
- 5 Second definition: Poisson point process
- 6 Notes
- 7 References
where denotes the expectation and set notation is used such that is considered as a random set (see Point process notation). For a point process , Campbell's theorem relates the above expectation with the intensity measure Λ. In relation to a Borel set B the intensity measure of is defined as:
First definition: general point process
One version of Campbell's theorem is for a general (not necessarily simple) point process with intensity measure:
is known as Campbell's formula or Campbell's theorem, which gives a method for calculating expectations of sums of measurable functions with ranges on the real line. More specifically, for a point process and a measurable function , the sum of over the point process is given by the equation:
where if one side of the equation is finite, then so is the other side. This equation is essentially an application of Fubini's theorem and it holds for a wide class of point processes, simple or not. Depending on the integral notation,[b] this integral may also be written as:
If the intensity measure of a point process has a density , then Campbell's formula becomes:
Stationary point process
For a stationary point process with constant density , Campbell's theorem or formula reduces to a volume integral:
Applications: Random sums
Campbell's theorem for general point processes gives a method for calculating the expectation of a function of a point (of a point process) summed over all the points in the point process. These random sums over point processes have applications in many areas where they are used as mathematical models.
Campbell originally studied a problem of random sums motivated by understanding thermionic noise in valves, which is also known as shot-noise. Consequently, the study of random sums of functions over point processes is known as shot noise in probability and, particularly, point process theory.
Interference in wireless networks
In wireless network communication, when a transmitter is trying to send a signal to a receiver, all the other transmitters in the network can be considered as interference, which poses a similar problem as noise does in traditional wired telecommunication networks in terms of the ability to send data based on information theory. If the positioning of the interfering transmitters are assumed to form some point process, then shot noise can be used to model the sum of their interfering signals, which has led to stochastic geometry models of wireless networks.
For general point processes, other more general versions of Campbell's theorem exist depending on the nature of the random sum and in particular the function being summed over the point process.
Functions of multiple points
If the function is a function of more than one point of the point process, the moment measures or factorial moment measures of the point process are needed, which can be compared to moments and factorial of random variables. The type of measure needed depends on whether the points of the point process in the random sum are need to be distinct or may repeat.
Moment measures are used when points are allowed to repeat.
Factorial moment measures are used when points are not allowed to repeat, hence points are distinct.
Functions of points and the point process
For general point processes, Campbell's theorem is only for sums of functions of a single point of the point process. To calculate the sum of a function of a single point as well as the entire point process, then generalized Campbell's theorems are required using the Palm distribution of the point process, which is based on the branch of probability known as Palm theory or Palm calculus.
Second definition: Poisson point process
Another version of Campbell's theorem says that for a Poisson point process and a measurable function , the random sum
Provided that this integral is finite, then the theorem further asserts that for any complex value the equation
and if this integral converges, then
where denotes the variance of the random sum .
Application: Laplace functional
which for the homogeneous case is:
- It can be defined on a more general mathematical space than Euclidean space, but often this space is used for models.
- As discussed in Chapter 1 of Stoyan, Kendall and Mecke, which applies to all other integrals presented here and elsewhere due to varying integral notation.
- Kingman calls it a "characteristic functional" but Daley and Vere-Jones and others call it a "Laplace functional", reserving the term "characteristic functional" for when is imaginary.
- D. Stoyan, W. S. Kendall, J. Mecke, and L. Ruschendorf. Stochastic geometry and its applications, volume 2. Wiley Chichester, 1995.
- Baddeley, A.; Barany, I.; Schneider, R.; Weil, W. (2007). "Spatial Point Processes and their Applications". Stochastic Geometry. Lecture Notes in Mathematics. 1892. p. 1. ISBN 978-3-540-38174-7. doi:10.1007/978-3-540-38175-4_1.
- Daley, D. J.; Vere-Jones, D. (2003). "An Introduction to the Theory of Point Processes". Probability and its Applications. ISBN 0-387-95541-0. doi:10.1007/b97277.
- Brémaud, Pierre; Baccelli, François (2002). Elements of queueing theory: Palm Martingale calculus and stochastic recurrences. Springer Science & Business Media. p. 18,195. ISBN 978-3-642-08537-6.
- R. Meester and R. Roy. Continuum percolation, volume 119 of Cambridge tracts in mathematics, 1996.
- Moller, J.; Plenge Waagepetersen, R. (2003). "Statistical Inference and Simulation for Spatial Point Processes". C&H/CRC Monographs on Statistics & Applied Probability. 100. ISBN 978-1-58488-265-7. doi:10.1201/9780203496930.
- Kingman, John (1993). Poisson Processes. Oxford Science Publications. p. 28. ISBN 0-19-853693-3.
- Campbell, N. (1909). "The study of discontinuous phenomena". Proc. Cambr. Phil. Soc. 15: 117–136.
- Campbell, N. (1910). "Discontinuities in light emission". Proc. Cambr. Phil. Soc. 15: 310–328.
- Stirzaker, David (2000). "Advice to Hedgehogs, or, Constants Can Vary". The Mathematical Gazette. 197-210. 84 (500): 197–210. JSTOR 3621649.
- Grimmett G. and Stirzaker D. (2001). Probability and random processes. Oxford University Press. p. 290.
- Daley, D. J.; Vere-Jones, D. (2008). "An Introduction to the Theory of Point Processes". Probability and Its Applications. ISBN 978-0-387-21337-8. doi:10.1007/978-0-387-49835-5.
- P. Brémaud. Fourier Analysis of Stochastic Processes. Springer, 2014.
- A. Baddeley. A crash course in stochastic geometry. Stochastic Geometry: Likelihood and Computation Eds OE Barndorff-Nielsen, WS Kendall, HNN van Lieshout (London: Chapman and Hall) pp, pages 1--35, 1999.
- Baccelli, F. O. (2009). "Stochastic Geometry and Wireless Networks: Volume I Theory". Foundations and Trends in Networking. 3 (3–4): 249–449. doi:10.1561/1300000006.