Characterizations of the exponential function

From Wikipedia, the free encyclopedia
Jump to: navigation, search

In mathematics, the exponential function can be characterized in many ways. The following characterizations (definitions) are most common. This article discusses why each characterization makes sense, and why the characterizations are independent of and equivalent to each other. As a special case of these considerations, we will see that the three most common definitions given for the mathematical constant e are also equivalent to each other.

Characterizations[edit]

The five most common definitions of the exponential function exp(x) = ex for real x are:

1. Define ex by the limit
e^x = \lim_{n\to\infty} \left(1+\frac{x}{n}\right)^n.
2. Define ex as the value of the infinite series
e^x = \sum_{n=0}^\infty {x^n \over n!} = 1 + x + \frac{x^2}{2!} + \frac{x^3}{3!} + \frac{x^4}{4!} + \cdots
(Here n! denotes the factorial of n. One proof that e is irrational uses this representation.)
3. Define ex to be the unique number y > 0 such that
\int_{1}^{y} \frac{dt}{t} = x.
This is as the inverse of the natural logarithm function, which is defined by this integral.
4. Define ex to be the unique solution to the initial value problem
y'=y,\quad y(0)=1.
(Here, y′ denotes the derivative of y.)
5. The exponential function f(x) = ex is the unique Lebesgue-measurable function with f(1) = e that satisfies
f(x+y) = f(x) f(y)\text{ for all }x\text{ and }y \,
(Hewitt and Stromberg, 1965, exercise 18.46). Alternatively, it is the unique anywhere-continuous function with these properties (Rudin, 1976, chapter 8, exercise 6). The term "anywhere-continuous" means that there exists at least a single point x at which f(x) is continuous. As shown below, if f(x+y) = f(x) f(y) for all x and y and f(x) is continuous at any single point x then f(x) is necessarily continuous everywhere.
(As a counterexample, if one does not assume continuity or measurability, it is possible to prove the existence of an everywhere-discontinuous, non-measurable function with this property by using a Hamel basis for the real numbers over the rationals, as described in Hewitt and Stromberg.)
Because f(x) = ex is guaranteed for rational x by the above properties (see below), one could also use monotonicity or other properties to enforce the choice of ex for irrational x,[citation needed] but such alternatives appear to be uncommon.
One could also replace the conditions that f(1)=e and that f be Lebesgue-measurable or anywhere-continuous with the single condition that f'(0)=1. This condition, along with the condition f(x+y) = f(x) f(y) easily implies both conditions in characterization 4. Indeed, one gets the initial condition f(0) = 1 by dividing both sides of the equation
f(0) = f(0+0) = f(0) f(0)
by f(0), and the condition that f'(x)=f(x) follows from the condition that f'(0)=1 and the definition of the derivative as follows:

\begin{align}
f'(x) & = \lim_{h\to 0}\frac{f(x+h)-f(x)}{h}
\\ & = \lim_{h\to 0}\frac{f(x)f(h)-f(x)}{h}
\\ & = \lim_{h\to 0}f(x)\frac{f(h)-1}{h}
\\ & = f(x)\lim_{h\to 0}\frac{f(h)-1}{h}
\\ & = f(x)\lim_{h\to 0}\frac{f(0+h)-f(0)}{h}
\\ & = f(x)f'(0) = f(x).
\end{align}



Larger domains[edit]

One way of defining the exponential function for domains larger than the domain of real numbers is to first define it for the domain of real numbers using one of the above characterizations and then extend it to larger domains in a way which would work for any analytic function.

It is also possible to use the characterisations directly for the larger domain, though some problems may arise. (1), (2), and (4) all make sense for arbitrary Banach algebras. (3) presents a problem for complex numbers, because there are non-equivalent paths along which one could integrate, and (5) is not sufficient. For example, the function f defined (for x and y real) as

 f(x + iy) = e^x(\cos(2y) + i\sin(2y)) = e^{x + 2iy} \,

satisfies the conditions in (5) without being the exponential function of x + iy. To make (5) sufficient for the domain of complex numbers, one may either stipulate that there exists a point at which f is a conformal map or else stipulate that

 f(i) = \cos(1) + i\sin(1). \,

In particular, the alternate condition in (5) that f'(0)=1 is sufficient since it implicitly stipulates that f be conformal.

Why each characterization makes sense[edit]

Each characterization requires some justification to show that it makes sense. For instance, when the value of the function is defined by a sequence or series, the convergence of this sequence or series needs to be established.

Characterization 2[edit]

Since

\lim_{n\to\infty} \left|\frac{x^{n+1}/(n+1)!}{x^n/n!}\right|
   = \lim_{n\to\infty} \left|\frac{x}{n+1}\right|
   = 0 < 1 \mbox{.}

it follows from the ratio test that \sum_{n=0}^{\infty} \frac{x^n}{n!} converges for all x.

Characterization 3[edit]

Since the integrand is an integrable function of t, the integral expression makes sense. That every real number x corresponds to a unique y > 0 such that

\int_1^y \frac{dt}{t} = x

is equivalent to the statement that the integral is a bijection from the interval (0,+\infty) to (-\infty,+\infty), which follows if one can show that 1/t is positive for positive t (so the function is monotone increasing, hence one-to-one) and that the two integrals

\int_1^\infty \frac{dt}{t} = \infty
\int_1^0 \frac{dt}{t} = -\infty

hold, so it is onto.

The first statement is obvious – t>0 implies 1/t > 0 – and the two integrals follow from the integral test and the divergence of the harmonic series.

Equivalence of the characterizations[edit]

The following proof demonstrates the equivalence of the first three characterizations given for e above. The proof consists of two parts. First, the equivalence of characterizations 1 and 2 is established, and then the equivalence of characterizations 1 and 3 is established.

Equivalence of characterizations 1 and 2[edit]

The following argument is adapted from a proof in Rudin, theorem 3.31, p. 63–-5.

Let x\geq0 be a fixed non-negative real number. Define

s_n = \sum_{k=0}^n\frac{x^k}{k!},\ t_n=\left(1+\frac{x}{n}\right)^n.

By the binomial theorem,


\begin{align}
t_n & =\sum_{k=0}^n{n \choose k}\frac{x^k}{n^k}=1+x+\sum_{k=2}^n\frac{n(n-1)(n-2)\cdots(n-(k-1))x^k}{k!\,n^k} \\[8pt]
& = 1+x+\frac{x^2}{2!}\left(1-\frac{1}{n}\right)+\frac{x^3}{3!}\left(1-\frac{1}{n}\right)\left(1-\frac{2}{n}\right)+\cdots \\[8pt]
& {}\qquad \cdots +\frac{x^n}{n!}\left(1-\frac{1}{n}\right)\cdots\left(1-\frac{n-1}{n}\right)\le s_n
\end{align}

(using x ≥ 0 to obtain the final inequality) so that

\limsup_{n\to\infty}t_n \le \limsup_{n\to\infty}s_n = e^x

where ex is in the sense of definition 2. Here, we must use limsups, because we don't yet know that tn actually converges. Now, for the other direction, note that by the above expression of tn, if 2 ≤ mn, we have

1+x+\frac{x^2}{2!}\left(1-\frac{1}{n}\right)+\cdots+\frac{x^m}{m!}\left(1-\frac{1}{n}\right)\left(1-\frac{2}{n}\right)\cdots\left(1-\frac{m-1}{n}\right)\le t_n.

Fix m, and let n approach infinity. We get

s_m = 1+x+\frac{x^2}{2!}+\cdots+\frac{x^m}{m!} \le \liminf_{n\to\infty}t_n

(again, we must use liminf's because we don't yet know that tn converges). Now, take the above inequality, let m approach infinity, and put it together with the other inequality. This becomes

\limsup_{n\to\infty}t_n \le e^x \le \liminf_{n\to\infty}t_n \,

so that

\lim_{n\to\infty}t_n = e^x. \,

We can then extend this equivalence to the negative real numbers by noting \left(1-\frac{r}{n}\right)^n  \left(1+\frac{r}{n}\right)^n = \left(1-\frac{r^2}{n^2}\right)^n and taking the limit as n goes to infinity.

The error term of this limit-expression is described by

\left(1+\frac{x}{n}\right)^n=e^x \left(1-\frac{x^2}{2n}+\frac{x^3(8+3x)}{24n^2}+\cdots \right),

where the polynomial's degree (in x) in the term with denominator nk is 2k.

Equivalence of characterizations 1 and 3[edit]

Here, we define the natural logarithm function in terms of a definite integral as above. By the fundamental theorem of calculus,

\frac{d}{dx}\left( \ln x \right) = \frac{1}{x}.

Now, let x be any fixed real number, and let

y=\lim_{n\to\infty}\left(1+\frac{x}{n}\right)^n.

We will show that ln(y) = x, which implies that y = ex, where ex is in the sense of definition 3. We have

\ln y=\ln\lim_{n\to\infty}\left(1+\frac{x}{n}\right)^n=\lim_{n\to\infty}\ln\left(1+\frac{x}{n}\right)^n.

Here, we have used the continuity of ln(y), which follows from the continuity of 1/t:

\ln y=\lim_{n\to\infty}n\ln \left(1+\frac{x}{n}\right)=\lim_{n\to\infty}\frac{x\ln\left(1+(x/n)\right)}{(x/n)}.

Here, we have used the result lnan = nlna. This result can be established for n a natural number by induction, or using integration by substitution. (The extension to real powers must wait until ln and exp have been established as inverses of each other, so that ab can be defined for real b as eb lna.)

=x\cdot\lim_{h\to 0}\frac{\ln\left(1+h\right)}{h} \quad \mbox{ where }h=\frac{x}{n}
=x\cdot\frac{d}{dt}\left( \ln t\right) \quad \mbox{ at }t=1
=x\cdot\frac{1}{t} \quad \mbox{ at }t=1
\!\, = x.

Equivalence of characterizations 1 and 5[edit]

The following proof is a simplified version of the one in Hewitt and Stromberg, exercise 18.46. First, one proves that measurability (or here, Lebesgue-integrability) implies continuity for a non-zero function f(x) satisfying f(x+y)=f(x)f(y), and then one proves that continuity implies f(x) = e^{kx} for some k, and finally f(1)=e implies k=1.

First, we prove a few elementary properties from f(x) satisfying f(x+y)=f(x)f(y) and the assumption that f(x) is not identically zero:

  • If f(x) is nonzero anywhere (say at x=y), then it is non-zero everywhere. Proof: f(y) = f(x) f(y - x) \neq 0 implies f(x) \neq 0.
  • f(0)=1. Proof: f(x)= f(x+0) = f(x) f(0) and f(x) is non-zero.
  • f(-x)=1/f(x). Proof: 1 = f(0)= f(x-x) = f(x) f(-x).
  • If f(x) is continuous anywhere (say at x=y), then it is continuous everywhere. Proof: f(x+\delta)-f(x) = f(x-y) [ f(y+\delta) - f(y)] \rightarrow 0 as \delta\rightarrow 0 by continuity at y.

The second and third properties mean that it is sufficient to prove f(x)=e^x for positive x.

If f(x) is a Lebesgue-integrable function, then we can define

g(x) = \int_0^x f(x')\, dx'.

It then follows that

g(x+y)-g(x) = \int_x^{x+y} f(x')\, dx' = \int_0^y f(x+x')\, dx' = f(x)g(y).

Since f(x) is nonzero, we can choose some y such that g(y) \neq 0 and solve for f(x) in the above expression. Therefore:

f(x+\delta)-f(x) = \frac{[g(x+\delta+y)-g(x+\delta)]-[g(x+y)-g(x)]}{g(y)}
=\frac{[g(x+y+\delta)-g(x+y)]-[g(x+\delta)-g(x)]}{g(y)}
=\frac{f(x+y)g(\delta)-f(x)g(\delta)}{g(y)}=g(\delta)\frac{f(x+y)-f(x)}{g(y)}.

The final expression must go to zero as \delta\rightarrow 0 since g(0)=0 and g(x) is continuous. It follows that f(x) is continuous.

Now, we prove that f(q) = e^{kq}, for some k, for all positive rational numbers q. Let q=n/m for positive integers n and m. Then

f\left(\frac{n}{m}\right)=f\left(\frac{1}{m}+\cdots+\frac{1}{m}\right)=f\left(\frac{1}{m}\right)^{n}

by elementary induction on n. Therefore, f(1/m)^{m}=f(1) and thus

f\left(\frac{n}{m}\right)=f(1)^{n/m}=e^{k(n/m)}.

for k = \ln [f(1)]\,. Note that if we are restricting ourselves to real-valued f(x), then f(x) = f(x/2)^2 is everywhere positive and so k is real.

Finally, by continuity, since f(x) = e^{kx} for all rational x, it must be true for all real x since the closure of the rationals is the reals (that is, we can write any real x as the limit of a sequence of rationals). If f(1) = e then k = 1. This is equivalent to characterization 1 (or 2, or 3), depending on which equivalent definition of e one uses.

References[edit]

  • Walter Rudin, Principles of Mathematical Analysis, 3rd edition (McGraw–Hill, 1976), chapter 8.
  • Edwin Hewitt and Karl Stromberg, Real and Abstract Analysis (Springer, 1965).