Lutz–Kelker bias

The Lutz–Kelker bias is a supposed systematic bias that results from the assumption that the probability of a star being at distance $s$ increases with the square of the distance which is equivalent to the assumption that the distribution of stars in space is uniform. In particular, it causes measured parallaxes to stars to be larger than their actual values. The bias towards measuring larger parallaxes in turn results in an underestimate of distance and therefore an underestimate on the object's luminosity.

For a given parallax measurement with an accompanying uncertainty, both stars closer and farther may, because of uncertainty in measurement, appear at the given parallax. Assuming uniform stellar distribution in space, the probability density of the true parallax per unit range of parallax will be proportional to $1/p^{4}$ (where $p$ is the true parallax), and therefore, there will be more stars in the volume shells at farther distance. As a result of this dependence, more stars will have their true parallax smaller than the observed parallax. Thus, the measured parallax will be systematically biased towards a value larger than the true parallax. This causes inferred luminosities and distances to be too small, which poses an apparent problem to astronomers trying to measure distance. The existence (or otherwise) of this bias and the necessity of correcting for it has become relevant in astronomy with the precision parallax measurements made by the Hipparcos satellite and more recently with the high-precision data releases of the Gaia mission.

The correction method due to Lutz and Kelker placed a bound on the true parallax of stars. This is not valid because true parallax (as distinct from measured parallax) cannot be known. Integrating over all true parallaxes (all space) assumes that stars are equally visible at all distances, and leads to divergent integrals yielding an invalid calculation. Consequently, the Lutz-Kelker correction should not be used. In general, other corrections for systematic bias are required, depending on the selection criteria of the stars under consideration.

The scope of effects of the bias are also discussed in the context of the current higher-precision measurements and the choice of stellar sample where the original stellar distribution assumptions are not valid. These differences result in the original discussion of effects to be largely overestimated and highly dependent on the choice of stellar sample. It also remains possible that relations to other forms of statistical bias such as the Malmquist bias may have a counter-effect on the Lutz–Kelker bias for at least some samples.

Mathematical Description

Original Description

The Distribution Function

Mathematically, the Lutz-Kelker Bias originates from the dependence of the number density on the observed parallax that is translated into the conditional probability of parallax measurements. Assuming a Gaussian distribution of the observed parallax about the true parallax due to errors in measurement, we can write the conditional probability distribution function of measuring a parallax of $p_{o}$ given that the true parallax is $p$ as

$g(p_{o}|p)={\dfrac {1}{\sqrt {2\pi \sigma }}}\exp {{\Big (}{\dfrac {-(p_{o}-p)^{2}}{2\sigma ^{2}}}{\Big )}}$

since the estimation is of a true parallax based on the measured parallax, the conditional probability of the true parallax being $p$, given that the observed parallax is $p_{o}$ is of interest. In the original treatment of the phenomenon by Lutz & Kelker, this probability, using Bayes theorem, is given as

$g(p|p_{o})={\dfrac {g(p_{o}|p)\ g(p)}{g(p_{o})}}$

where $g(p)dp$ and $g(p_{o})dp_{o}$ are the prior probabilities of the true and observed parallaxes respectively.

Dependence on Distance

The probability density of finding a star with apparent magnitude $m$ at a distance $s$ can be similarly written as

$h(s|m)={\dfrac {h(m|s)\ h(s)}{h(m)}}$

where $h(m|s)$ is the probability density of finding a star with apparent magnitude m with a given distance $s$. Here, $h(m|s)$ will be dependent on the luminosity function of the star, which depends on its absolute magnitude. $h(m)$ is the probability density function of the apparent magnitude independent of distance. The probability of a star being at distance $s$ will be proportional to $s^{2}$ such that

$h(s)\propto n(s)\ s^{2}$

Assuming a uniform distribution of stars in space, the number density $n(s)$ becomes a constant and we can write

$g(p)\ dp=h(s|m)\ {\Bigg |}{\dfrac {\partial s}{\partial p}}{\Bigg |}_{m}\ dp\propto s^{2}{\Bigg |}{\dfrac {\partial s}{\partial p}}{\Bigg |}_{m}dp$, where $s=1/p$.

Since we deal with the probability distribution of the true parallax based on a fixed observed parallax, the probability density $g(p_{o})$ becomes irrelevant and we can conclude that the distribution will have the proportionality

$g(p|p_{o})\propto g(p|p_{o})\ p^{-4}$ and thus,

$g(p|p_{o})\propto {\dfrac {1}{p^{4}}}\exp {\Big (}{-{\dfrac {(p-p_{o})^{2}}{2\ \sigma ^{2}}}}{\Big )}$

Normalization

The conditional probability of the true parallax based on the observed parallax is divergent around zero for the true parallax. Therefore, it is not possible to normalize this probability. Following the original description of the bias, we can define a normalization by including the observed parallax as

$g(p|p_{o})\propto {\Big (}{\dfrac {p_{o}}{p}}{\Big )}^{4}\ \exp {\Big (}{-{\dfrac {(p-p_{o})^{2}}{2\ \sigma ^{2}}}}{\Big )}$

The inclusion of $p_{o}$ does not affect proportionality since it is a fixed constant. Moreover, in this defined "normalization", we will get a probability of 1 when the true parallax is equal to the observed parallax, regardless of the errors in measurement. Therefore, we can define a dimensionless parallax $Z:=p/p_{o}$ and get the dimensionless distribution of the true parallax as

$G(Z)\propto Z^{-4}\ \exp {\Big (}{-{\dfrac {(Z-1)^{2}}{2\ (\sigma /p_{o})^{2}}}}{\Big )}$

Here, $Z=1$ represents the point where the measurement in parallax is equal to its true value, where the probability distribution should be centered. However, this distribution, due to $Z^{-4}$ factor will deviate from the point $Z=1$ to smaller values. This presents the systematic Lutz-Kelker Bias. The value of this bias will be based on the value of $\sigma /p_{o}$, the marginal uncertainty in parallax measurement.

Scope of Effects

Original Treatment

In the original treatment of the Lutz–Kelker bias as it was first proposed the uncertainty in parallax measurement is considered to be the sole source of bias. As a result of the parallax dependence of stellar distributions, smaller uncertainty in the observed parallax will result in only a slight bias from the true parallax value. Larger uncertainties in contrast would yield higher systematic deviations of the observed parallax from its true value. Large errors in parallax measurement become apparent in luminosity calculations and are therefore easy to detect. Consequently, the original treatment of the phenomenon considered the bias to be effective when the uncertainty in the observed parallax, $\sigma$, is close to about 15% of the measured value, $p_{o}$. This was a very strong statement indicating that if the uncertainty in the parallax in about 15–20%, the bias is so effective that we lose most of the parallax and distance information. Several subsequent work on the phenomenon refuted this argument and it was shown that the scope is actually very sample based and may be dependent on other sources of bias. Therefore, more recently it is argued that the scope for most stellar samples is not as drastic as first proposed.

Subsequent Discussions

Following the original statement, the scope of the effects of the bias, as well as its existence and relative methods of correction have been discussed in many works in recent literature, including subsequent work of Lutz himself. Several subsequent work state that the assumption of uniform stellar distribution may not be applicable depending on the choice of stellar sample. Moreover, the effects of different distributions of stars in space as well as that of measurement errors would yield different forms of bias. This suggests the bias is largely dependent on the specific choice of sample and measurement error distributions, although the term Lutz–Kelker bias is commonly used generically for the phenomenon on all stellar samples. It is also questioned whether other sources of error and bias such as the Malmquist Bias actually counter-effect or even cancel the Lutz–Kelker bias, so that the effects are not as drastic as initially described by Lutz and Kelker. Overall, such differences are discussed to result in effects of the bias to be largely overestimated in the original treatment.

More recently, the effects of the Lutz–Kelker bias became relevant in the context of the high-precision measurements of Gaia mission. The scope of effects of Lutz–Kelker bias on certain samples is discussed in the recent Gaia data releases, including the original assumptions and the possibility of different distributions. It remains important to take bias effects with caution regarding sample selection as stellar distribution is expected to be non-uniform at large distance scales. As a result, it is questioned whether correction methods, including the Lutz-Kelker correction proposed in the original work, are applicable for a given stellar sample, since effects are expected to depend on the stellar distribution. Moreover, following the original description and the dependence of the bias on the measurement errors, the effects are expected to be lower due to the higher precision of current instruments such as Gaia.

History

The original description of the phenomenon was presented in a paper by Thomas E. Lutz and Douglas H. Kelker in the Publications of the Astronomical Society of the Pacific, Vol. 85, No. 507, p. 573 article entitled "On the Use of Trigonometric Parallaxes for the Calibration of Luminosity Systems: Theory." although it was known following the work of Trumpler & Weaver in 1953. The discussion on statistical bias on measurements in astronomy date back to as early as to Eddington in 1913.