Gradient theorem

The gradient theorem, also known as the fundamental theorem of calculus for line integrals, says that a line integral through a gradient field can be evaluated by evaluating the original scalar field at the endpoints of the curve.

Let $\varphi :U\subseteq \mathbb {R} ^{n}\to \mathbb {R}$ and $\gamma$ a curve from p to q. Then

\varphi \left(\mathbf {q} \right)-\varphi \left(\mathbf {p} \right)=\int _{\gamma [\mathbf {p} ,\,\mathbf {q} ]}\nabla \varphi (\mathbf {r} )\cdot d\mathbf {r} .

It is a generalization of the fundamental theorem of calculus to any curve in a plane or space (generally n-dimensional) rather than just the real line.

The gradient theorem implies that line integrals through gradient fields are path independent. In physics this theorem is one of the ways of defining a conservative force. By placing φ as potential, ∇φ is a conservative field. Work done by conservative forces does not depend on the path followed by the object, but only the end points, as the above equation shows.

The gradient theorem also has an interesting converse: any path-independent vector field can be expressed as the gradient of a scalar field. Just like the gradient theorem itself, this converse has many striking consequences and applications in both pure and applied mathematics.

Proof

If φ is a differentiable function from some open subset U (of Rⁿ) to R, and if r is a differentiable function from some closed interval [a,b] to U, then by the multivariate chain rule, the composite function φ ∘ r is differentiable on (a, b) and

{\frac {d}{dt}}(\varphi \circ \mathbf {r} )(t)=\nabla \varphi (\mathbf {r} (t))\cdot \mathbf {r} '(t)

for all t in (a, b). Here the ⋅ denotes the usual inner product.

Now suppose the domain U of φ contains the differentiable curve γ with endpoints p and q, (oriented in the direction from p to q). If r parametrizes γ for t in [a, b], then the above shows that ^[1]

{\begin{aligned}\int _{\gamma }\nabla \varphi (\mathbf {u} )\cdot d\mathbf {u} &=\int _{a}^{b}\nabla \varphi (\mathbf {r} (t))\cdot \mathbf {r} '(t)dt\\&=\int _{a}^{b}{\frac {d}{dt}}\varphi (\mathbf {r} (t))dt=\varphi (\mathbf {r} (b))-\varphi (\mathbf {r} (a))=\varphi \left(\mathbf {q} \right)-\varphi \left(\mathbf {p} \right)\end{aligned}}

where the definition of the line integral is used in the first equality, and the fundamental theorem of calculus is used in the third equality.

Examples

Example 1

Suppose γ ⊂ R² is the circular arc oriented counterclockwise from (5, 0) to (−4, 3). Using the definition of a line integral,

{\begin{aligned}\int _{\gamma }ydx+xdy&=\int _{0}^{\pi -\tan ^{-1}\left({\frac {3}{4}}\right)}((5\sin t)(-5\sin t)+(5\cos t)(5\cos t))dt\\&=\int _{0}^{\pi -\tan ^{-1}\left({\frac {3}{4}}\right)}25\left(-\sin ^{2}t+\cos ^{2}t\right)dt\\&=\int _{0}^{\pi -\tan ^{-1}\left({\frac {3}{4}}\right)}25\cos(2t)dt\\&=\left.{\frac {25}{2}}\sin(2t)\right|_{0}^{\pi -\tan ^{-1}\left({\frac {3}{4}}\right)}\\&={\frac {25}{2}}\sin \left(2\pi -2\tan ^{-1}\left({\frac {3}{4}}\right)\right)\\&=-{\frac {25}{2}}\sin \left(2\tan ^{-1}\left({\frac {3}{4}}\right)\right)\\&=-{\frac {25\left({\frac {3}{4}}\right)}{\left({\frac {3}{4}}\right)^{2}+1}}=-12.\end{aligned}}

Notice all of the painstaking computations involved in directly calculating the integral. Instead, since the function f(x, y) = xy is differentiable on all of R², we can simply use the gradient theorem to say

\int _{\gamma }ydx+xdy=\int _{\gamma }\nabla (xy)\cdot (dx,dy)=xy|_{(5,0)}^{(-4,3)}=-4\cdot 3-5\cdot 0=-12

.

Notice that either way gives the same answer, but using the latter method, most of the work is already done in the proof of the gradient theorem.

Example 2

For a more abstract example, suppose γ ⊂ Rⁿ has endpoints p, q, with orientation from p to q. For u in Rⁿ, let |u| denote the Euclidean norm of u. If α ≥ 1 is a real number, then

{\begin{aligned}\int _{\gamma }|\mathbf {x} |^{\alpha -1}\mathbf {x} \cdot d\mathbf {x} &={\frac {1}{\alpha +1}}\int _{\gamma }(\alpha +1)|\mathbf {x} |^{(\alpha +1)-2}\mathbf {x} \cdot d\mathbf {x} \\&={\frac {1}{\alpha +1}}\int _{\gamma }\nabla |\mathbf {x} |^{\alpha +1}\cdot d\mathbf {x} ={\frac {|\mathbf {q} |^{\alpha +1}-|\mathbf {p} |^{\alpha +1}}{\alpha +1}}\end{aligned}}

Here the final equality follows by the gradient theorem, since the function f(x) = |x|^{α + 1} is differentiable on Rⁿ if α ≥ 1.

If α < 1 then this equality will still hold in most cases, but caution must be taken if γ passes through or encloses the origin, because the integrand vector field |x|^α−1x will fail to be defined there. However, the case α = −1 is somewhat different; in this case, the integrand becomes |x|⁻²x = ∇(log|x|), so that the final equality becomes log|q| − log|p|.

Note that if n = 1, then this example is simply a slight variant of the familiar Power rule from single-variable calculus.

Example 3

Suppose there are n point charges arranged in three-dimensional space, and the i-th point charge has charge Q_i and is located at position p_i in R³. We would like to calculate the work done on a particle of charge q as it travels from a point a to a point b in R³. Using Coulomb's law, we can easily determine that the force on the particle at position r will be

\mathbf {F} (\mathbf {r} )=kq\sum _{i=1}^{n}{\frac {Q_{i}(\mathbf {r} -\mathbf {p} _{i})}{\left|\mathbf {r} -\mathbf {p} _{i}\right|^{3}}}

Here |u| denotes the Euclidean norm of the vector u in R³, and k = 1/(4πε₀), where ε₀ is the Vacuum permittivity.

Let γ ⊂ R³ − {p₁, …, p_n} be an arbitrary differentiable curve from a to b. Then the work done on the particle is

W=\int _{\gamma }\mathbf {F} (\mathbf {r} )\cdot d\mathbf {r} =\int _{\gamma }\left(kq\sum _{i=1}^{n}{\frac {Q_{i}(\mathbf {r} -\mathbf {p} _{i})}{\left|\mathbf {r} -\mathbf {p} _{i}\right|^{3}}}\right)\cdot d\mathbf {r} =kq\sum _{i=1}^{n}\left(Q_{i}\int _{\gamma }{\frac {\mathbf {r} -\mathbf {p} _{i}}{\left|\mathbf {r} -\mathbf {p} _{i}\right|^{3}}}\cdot d\mathbf {r} \right)

Now for each i, direct computation shows that

{\frac {\mathbf {r} -\mathbf {p} _{i}}{\left|\mathbf {r} -\mathbf {p} _{i}\right|^{3}}}=-\nabla {\frac {1}{\left|\mathbf {r} -\mathbf {p} _{i}\right|}}.

Thus, continuing from above and using the gradient theorem,

W=-kq\sum _{i=1}^{n}\left(Q_{i}\int _{\gamma }\nabla {\frac {1}{\left|\mathbf {r} -\mathbf {p} _{i}\right|}}\cdot d\mathbf {r} \right)=kq\sum _{i=1}^{n}Q_{i}\left({\frac {1}{\left|\mathbf {a} -\mathbf {p} _{i}\right|}}-{\frac {1}{\left|\mathbf {b} -\mathbf {p} _{i}\right|}}\right)

We are finished. Of course, we could have easily completed this calculation using the powerful language of electrostatic potential or electrostatic potential energy (with the familiar formulas W = −ΔU = −qΔV). However, we have not yet defined potential or potential energy, because the converse of the gradient theorem is required to prove that these are well-defined, differentiable functions and that these formulas hold (see below). Thus, we have solved this problem using only Coulomb's Law, the definition of work, and the gradient theorem.

Converse of the gradient theorem

The gradient theorem states that if the vector field F is the gradient of some scalar-valued function (i.e., if F is conservative), then F is a path-independent vector field (i.e., the integral of F over some piecewise-differentiable curve is dependent only on end points). This theorem has a powerful converse:

If F is a path-independent vector field, then F is the gradient of some scalar-valued function.^[2]

It is straightforward to show that a vector field is path-independent if and only if the integral of the vector field over every closed loop in its domain is zero. Thus the converse can alternatively be stated as follows: If the integral of F over every closed loop in the domain of F is zero, then F is the gradient of some scalar-valued function.

Proof of the converse

Suppose U is an open, path-connected subset of Rⁿ, and F : U → Rⁿ is a continuous and path-independent vector field. Fix some element a of U, and define f : U → R by

f(\mathbf {x} ):=\int _{\gamma [\mathbf {a} ,\mathbf {x} ]}\mathbf {F} (\mathbf {u} )\cdot d\mathbf {u}

Here γ[a, x] is any (differentiable) curve in U originating at a and terminating at x. We know that f is well-defined because F is path-independent.

Let v be any nonzero vector in Rⁿ. By the definition of the directional derivative,

{\begin{aligned}{\frac {\partial f}{\partial \mathbf {v} }}(\mathbf {x} )&=\lim _{t\to 0}{\frac {f(\mathbf {x} +t\mathbf {v} )-f(\mathbf {x} )}{t}}\\&=\lim _{t\to 0}{\frac {\int _{\gamma [\mathbf {a} ,\mathbf {x} +t\mathbf {v} ]}\mathbf {F} (\mathbf {u} )\cdot d\mathbf {u} -\int _{\gamma [\mathbf {a} ,\mathbf {x} ]}\mathbf {F} (\mathbf {u} )\cdot d\mathbf {u} }{t}}\\&=\lim _{t\to 0}{\frac {1}{t}}\int _{\gamma [\mathbf {x} ,\mathbf {x} +t\mathbf {v} ]}\mathbf {F} (\mathbf {u} )\cdot d\mathbf {u} \end{aligned}}

To calculate the integral within the final limit, we must parametrize γ[x, x+tv]. Since F is path-independent, U is open, and t is approaching zero, we may assume that this path is a straight line, and parametrize it as u(s) = x + sv for 0 < s < t. Now, since u'(s) = v, the limit becomes

\lim _{t\to 0}{\frac {1}{t}}\int _{0}^{t}\mathbf {F} (\mathbf {u} (s))\cdot \mathbf {u} '(s)\,ds={\frac {d}{dt}}\int _{0}^{t}\mathbf {F} (\mathbf {x} +s\mathbf {v} )\cdot \mathbf {v} \,ds{\bigg |}_{t=0}=\mathbf {F} (\mathbf {x} )\cdot \mathbf {v}

Thus we have a formula for ∂_vf, where v is arbitrary.. Let x = (x₁, x₂, ..., x_n) and let e_i denote the i-^th standard basis vector, so that

\nabla f(\mathbf {x} )={\bigg (}{\frac {\partial f(\mathbf {x} )}{\partial x_{1}}},{\frac {\partial f(\mathbf {x} )}{\partial x_{2}}},...,{\frac {\partial f(\mathbf {x} )}{\partial x_{n}}}{\bigg )}=(\mathbf {F} (\mathbf {x} )\cdot \mathbf {e} _{1},\mathbf {F} (\mathbf {x} )\cdot \mathbf {e} _{2},...,\mathbf {F} (\mathbf {x} )\cdot \mathbf {e} _{n})=\mathbf {F} (\mathbf {x} )

Thus we have found a scalar-valued function f whose gradient is the path-independent vector field F, as desired.^[2]

Example of the converse principle

To illustrate the power of this converse principle, we cite an example that has significant physical consequences. In classical electromagnetism, the electric force is a path-independent force ; i.e. the work done on a particle that has returned to its original position within an electric field is zero (assuming that no changing magnetic fields are present).

Therefore, the above theorem implies that the electric force field F_e : S → R³ is conservative (here S is some open, path-connected subset of R³ that contains a charge distribution). Following the ideas of the above proof, we can set some reference point a in S, and define a function U_e: S → R by

U_{e}(\mathbf {r} ):=-\int _{\gamma [\mathbf {a} ,\mathbf {r} ]}\mathbf {F} _{e}(\mathbf {u} )\cdot d\mathbf {u}

Using the above proof, we know U_e is well-defined and differentiable, and F_e = −∇U_e (from this formula we can use the gradient theorem to easily derive the well-known formula for calculating work done by conservative forces: W = −ΔU). This function U_e is often referred to as the electrostatic potential energy of the system of charges in S (with reference to the zero-of-potential a). In many cases, the domain S is assumed to be unbounded and the reference point a is taken to be "infinity," which can be made rigorous using limiting techniques. This function U_e is an indispensable tool used in the analysis of many physical systems.

Generalizations

Many of the critical theorems of vector calculus generalize elegantly to statements about the integration of differential forms on manifolds. In the language of differential forms and exterior derivatives, the gradient theorem states that

\int _{\partial \gamma }\phi =\int _{\gamma }d\phi

for any 0-form, ϕ, defined on some differentiable curve γ ⊂ Rⁿ (here the integral of ϕ over the boundary of the γ is understood to be the evaluation of ϕ at the endpoints of γ).

Notice the striking similarity between this statement and the generalized version of Stokes' theorem, which says that the integral of any compactly supported differential form ω over the boundary of some orientable manifold Ω is equal to the integral of its exterior derivative dω over the whole of Ω, i.e.,

\int _{\partial \Omega }\omega =\int _{\Omega }d\omega

This powerful statement is a generalization of the gradient theorem from 1-forms defined on one-dimensional manifolds to differential forms defined on manifolds of arbitrary dimension.

The converse statement of the gradient theorem also has a powerful generalization in terms of differential forms on manifolds. In particular, suppose ω is a form defined on a contractible domain, and the integral of ω over any closed manifold is zero. Then there exists a form ψ such that ω = dψ. Thus, on a contractible domain, every closed form is exact. This result is summarized by the Poincaré lemma.

References

^ Williamson, Richard and Trotter, Hale. (2004). Multivariable Mathematics, Fourth Edition, p. 374. Pearson Education, Inc.
^ ^a ^b "Williamson, Richard and Trotter, Hale. (2004). Multivariable Mathematics, Fourth Edition, p. 410. Pearson Education, Inc."

[1] Williamson, Richard and Trotter, Hale. (2004). Multivariable Mathematics, Fourth Edition, p. 374. Pearson Education, Inc.

[poop-2] "Williamson, Richard and Trotter, Hale. (2004). Multivariable Mathematics, Fourth Edition, p. 410. Pearson Education, Inc."

[1]

[2]