Proofs Chapter 2: Gradient Formulas

Linearity, Product Rule, Chain Rule, Quotient Rule, Representative Gradient Formulas

2. Gradient Formulas

This chapter rigorously proves the basic gradient identities (13)-(20) for scalar fields $f, g$ and vector fields $\mathbf{A}, \mathbf{B}$ by reducing each one to a component-wise application of the rules of single-variable differentiation. These formulas form the foundation of vector calculus and underlie the divergence and curl identities developed in later chapters.

2.1 Linearity

(13) Linearity of the Gradient (Sum)

Formula: $\displaystyle \nabla(f + g) = \nabla f + \nabla g$
Conditions: $f, g$ are differentiable scalar fields.
Proof

The $i$-th component of the gradient is $[\nabla f]_i = \partial f / \partial x_i$. By the linearity of the partial derivative (the single-variable sum rule applied to each $x_i$),

\begin{equation}[\nabla(f+g)]_i = \dfrac{\partial (f+g)}{\partial x_i} = \dfrac{\partial f}{\partial x_i} + \dfrac{\partial g}{\partial x_i} = [\nabla f]_i + [\nabla g]_i \label{eq:13-1}\end{equation}

Since every component agrees, $\nabla(f+g) = \nabla f + \nabla g$.

(14) Linearity of the Gradient (Constant Multiple)

Formula: $\displaystyle \nabla(cf) = c\,\nabla f$
Conditions: $c$ is a constant; $f$ is a differentiable scalar field.
Proof

A constant factor can be pulled out of a partial derivative, so for each component

\begin{equation}[\nabla(cf)]_i = \dfrac{\partial (cf)}{\partial x_i} = c\,\dfrac{\partial f}{\partial x_i} = c\,[\nabla f]_i \label{eq:14-1}\end{equation}

Hence $\nabla(cf) = c\,\nabla f$.

2.2 Product Rules

(15) Product of Two Scalar Fields

Formula: $\displaystyle \nabla(fg) = f\,\nabla g + g\,\nabla f$
Conditions: $f, g$ are differentiable scalar fields.
Proof

Apply the single-variable Leibniz rule to the partial derivative with respect to each $x_i$.

\begin{equation}[\nabla(fg)]_i = \dfrac{\partial (fg)}{\partial x_i} = f\,\dfrac{\partial g}{\partial x_i} + g\,\dfrac{\partial f}{\partial x_i} = [f\,\nabla g + g\,\nabla f]_i \label{eq:15-1}\end{equation}

Each component matches the corresponding component of $f\,\nabla g + g\,\nabla f$, which proves the formula.

(16) Gradient of a Dot Product

Formula: $\displaystyle \nabla(\mathbf{A} \cdot \mathbf{B}) = (\mathbf{B} \cdot \nabla)\mathbf{A} + (\mathbf{A} \cdot \nabla)\mathbf{B} + \mathbf{B} \times (\nabla \times \mathbf{A}) + \mathbf{A} \times (\nabla \times \mathbf{B})$
Conditions: $\mathbf{A}, \mathbf{B}$ are differentiable vector fields.
Proof

Expand the $i$-th component of the gradient of $\mathbf{A}\cdot\mathbf{B} = \sum_j A_j B_j$ using the Leibniz rule.

\begin{equation}[\nabla(\mathbf{A}\cdot\mathbf{B})]_i = \dfrac{\partial}{\partial x_i}\!\left(\displaystyle\sum_j A_j B_j\right) = \displaystyle\sum_j \left( B_j\,\dfrac{\partial A_j}{\partial x_i} + A_j\,\dfrac{\partial B_j}{\partial x_i} \right) \label{eq:16-1}\end{equation}

Rewrite the right-hand side using the curl $\nabla \times \mathbf{A}$ and the directional derivative $(\mathbf{B}\cdot\nabla)\mathbf{A}$. Applying the BAC-CAB rule ($\mathbf{a}\times(\mathbf{b}\times\mathbf{c}) = \mathbf{b}(\mathbf{a}\cdot\mathbf{c}) - \mathbf{c}(\mathbf{a}\cdot\mathbf{b})$) to $\mathbf{B} \times (\nabla \times \mathbf{A})$ in component form gives

\begin{equation}[\mathbf{B} \times (\nabla \times \mathbf{A})]_i = \displaystyle\sum_j B_j\,\dfrac{\partial A_j}{\partial x_i} - \displaystyle\sum_j B_j\,\dfrac{\partial A_i}{\partial x_j} \label{eq:16-2}\end{equation}

Swapping $\mathbf{A}$ and $\mathbf{B}$ similarly yields

\begin{equation}[\mathbf{A} \times (\nabla \times \mathbf{B})]_i = \displaystyle\sum_j A_j\,\dfrac{\partial B_j}{\partial x_i} - \displaystyle\sum_j A_j\,\dfrac{\partial B_i}{\partial x_j} \label{eq:16-3}\end{equation}

The second sum, $\sum_j B_j\,\partial A_i / \partial x_j$, is exactly the $i$-th component of $(\mathbf{B}\cdot\nabla)\mathbf{A}$. Solving $\eqref{eq:16-2}$ for the first sum,

\begin{equation}\displaystyle\sum_j B_j\,\dfrac{\partial A_j}{\partial x_i} = [\mathbf{B} \times (\nabla \times \mathbf{A})]_i + \displaystyle\sum_j B_j\,\dfrac{\partial A_i}{\partial x_j} = [\mathbf{B} \times (\nabla \times \mathbf{A}) + (\mathbf{B} \cdot \nabla)\mathbf{A}]_i \label{eq:16-4}\end{equation}

By the same argument,

\begin{equation}\displaystyle\sum_j A_j\,\dfrac{\partial B_j}{\partial x_i} = [\mathbf{A} \times (\nabla \times \mathbf{B}) + (\mathbf{A} \cdot \nabla)\mathbf{B}]_i \label{eq:16-5}\end{equation}

Substituting $\eqref{eq:16-4}$ and $\eqref{eq:16-5}$ into $\eqref{eq:16-1}$ shows that for every component

\begin{equation}[\nabla(\mathbf{A}\cdot\mathbf{B})]_i = [(\mathbf{B} \cdot \nabla)\mathbf{A} + (\mathbf{A} \cdot \nabla)\mathbf{B} + \mathbf{B} \times (\nabla \times \mathbf{A}) + \mathbf{A} \times (\nabla \times \mathbf{B})]_i \label{eq:16-6}\end{equation}

This establishes (16).

2.3 Chain Rule

(17) Composition with a Scalar Function

Formula: $\displaystyle \nabla f(g) = f'(g)\,\nabla g$
Conditions: $f$ is a differentiable function of one variable; $g$ is a differentiable scalar field.
Proof

Apply the single-variable chain rule to each partial derivative:

\begin{equation}[\nabla f(g)]_i = \dfrac{\partial f(g)}{\partial x_i} = f'(g)\,\dfrac{\partial g}{\partial x_i} = [f'(g)\,\nabla g]_i \label{eq:17-1}\end{equation}

Since this holds for every $i$, we obtain $\nabla f(g) = f'(g)\,\nabla g$.

(18) Gradient of a Power

Formula: $\displaystyle \nabla f^n = n\,f^{n-1}\,\nabla f$
Conditions: $f$ is a differentiable scalar field; $n$ is a real number (negative or fractional values are allowed provided $f \ne 0$).
Proof

Apply (17) with the single-variable function $f(g) = g^n$. The single-variable power rule gives $f'(g) = n\,g^{n-1}$, hence by (17)

\begin{equation}\nabla f^n = n\,f^{n-1}\,\nabla f \label{eq:18-1}\end{equation}

which is an immediate special case of (17).

2.4 Quotient Rule

(19) Gradient of a Quotient

Formula: $\displaystyle \nabla\!\left(\dfrac{f}{g}\right) = \dfrac{g\,\nabla f - f\,\nabla g}{g^2}$
Conditions: $f, g$ are differentiable scalar fields; $g \ne 0$.
Proof

First, compute the gradient of $1/g$. Applying (17) with $f(g) = 1/g$ and $f'(g) = -1/g^2$,

\begin{equation}\nabla\!\left(\dfrac{1}{g}\right) = -\dfrac{1}{g^2}\,\nabla g \label{eq:19-1}\end{equation}

Now write $f/g = f \cdot (1/g)$ and combine the product rule (15) with $\eqref{eq:19-1}$:

\begin{equation}\nabla\!\left(\dfrac{f}{g}\right) = \nabla\!\left(f \cdot \dfrac{1}{g}\right) = \dfrac{1}{g}\,\nabla f + f\,\nabla\!\left(\dfrac{1}{g}\right) = \dfrac{1}{g}\,\nabla f - \dfrac{f}{g^2}\,\nabla g \label{eq:19-2}\end{equation}

Putting everything over the common denominator $g^2$,

\begin{equation}\nabla\!\left(\dfrac{f}{g}\right) = \dfrac{g\,\nabla f - f\,\nabla g}{g^2} \label{eq:19-3}\end{equation}

which proves the quotient rule.

2.5 Representative Gradient Formulas

(20) Gradient of the Coulomb Kernel

Formula: $\displaystyle \nabla\!\left(\dfrac{1}{|\mathbf{r} - \mathbf{r}'|}\right) = -\dfrac{\mathbf{r} - \mathbf{r}'}{|\mathbf{r} - \mathbf{r}'|^3}$
Conditions: $\mathbf{r} \ne \mathbf{r}'$ (so that $|\mathbf{r}-\mathbf{r}'| > 0$). The gradient is taken with respect to $\mathbf{r}$.
Proof

Set $\mathbf{s} = \mathbf{r} - \mathbf{r}'$. Since $\mathbf{r}'$ is a fixed point, it is treated as a constant. The squared distance is

\begin{equation}\mathbf{s} = \mathbf{r} - \mathbf{r}', \qquad |\mathbf{s}|^2 = \displaystyle\sum_i (x_i - x'_i)^2 \label{eq:20-1}\end{equation}

Differentiating both sides with respect to $x_i$,

\begin{equation}2\,|\mathbf{s}|\,\dfrac{\partial |\mathbf{s}|}{\partial x_i} = 2(x_i - x'_i) \quad \Longrightarrow \quad \dfrac{\partial |\mathbf{s}|}{\partial x_i} = \dfrac{x_i - x'_i}{|\mathbf{s}|} \label{eq:20-2}\end{equation}

Rewriting in vector form,

\begin{equation}\nabla |\mathbf{s}| = \dfrac{\mathbf{s}}{|\mathbf{s}|} = \dfrac{\mathbf{r} - \mathbf{r}'}{|\mathbf{r} - \mathbf{r}'|} \label{eq:20-3}\end{equation}

Now apply (17) with $f(g) = 1/g$ and $g = |\mathbf{s}|$, so that $f'(g) = -1/g^2$:

\begin{equation}\nabla\!\left(\dfrac{1}{|\mathbf{s}|}\right) = -\dfrac{1}{|\mathbf{s}|^2}\,\nabla |\mathbf{s}| = -\dfrac{1}{|\mathbf{s}|^2} \cdot \dfrac{\mathbf{s}}{|\mathbf{s}|} = -\dfrac{\mathbf{s}}{|\mathbf{s}|^3} \label{eq:20-4}\end{equation}

Substituting back $\mathbf{s} = \mathbf{r} - \mathbf{r}'$,

\begin{equation}\nabla\!\left(\dfrac{1}{|\mathbf{r} - \mathbf{r}'|}\right) = -\dfrac{\mathbf{r} - \mathbf{r}'}{|\mathbf{r} - \mathbf{r}'|^3} \label{eq:20-5}\end{equation}

This is the central formula used to derive the electric field $\mathbf{E} = -\nabla\phi$ from the electrostatic potential $1/(4\pi\varepsilon_0 |\mathbf{r}-\mathbf{r}'|)$ and is the direct mathematical expression of Coulomb's law.

The gradient of 1/|r−r′| is perpendicular to the equipotential circles and points radially toward the center r′ (steepest ascent) r′ r s = r − r′ ∇(1/|s|) tangent equipotential 1/|s| = const Gradient ⊥ circles, inward toward r′. Magnitude 1/|s|², decays with distance.
Figure 1. Gradient of the Coulomb kernel $1/|\mathbf{r}-\mathbf{r}'|$. The equipotential lines are concentric circles centered at $\mathbf{r}'$; the gradient $\nabla(1/|\mathbf{s}|)=-\mathbf{s}/|\mathbf{s}|^3$ is perpendicular to their tangent and points radially toward $\mathbf{r}'$ (steepest ascent). Its magnitude decays as $1/|\mathbf{s}|^2$.

References

  • Griffiths, D. J. (2017). Introduction to Electrodynamics (4th ed.). Cambridge University Press.
  • Arfken, G. B., Weber, H. J., & Harris, F. E. (2013). Mathematical Methods for Physicists (7th ed.). Academic Press.
  • Vector calculus identities - Wikipedia

Frequently Asked Questions

What is the product rule (Leibniz rule) for the gradient?

For scalar fields: $\nabla(fg)=f\nabla g+g\nabla f$. For the dot product of vector fields: $\nabla(\mathbf{F}\cdot\mathbf{G})=(\mathbf{F}\cdot\nabla)\mathbf{G}+(\mathbf{G}\cdot\nabla)\mathbf{F}+\mathbf{F}\times(\nabla\times\mathbf{G})+\mathbf{G}\times(\nabla\times\mathbf{F})$, which extends the scalar Leibniz rule to vector operations.

How does the chain rule apply to gradients?

For a scalar composition $f(g(\mathbf{x}))$, the gradient is $\nabla f(g)=f'(g)\nabla g$. A classic example is $\nabla|\mathbf{r}|=\hat{\mathbf{r}}$ (unit radial vector). For vector-valued compositions, the Jacobian matrix generalizes the chain rule to multiple dimensions.

What is the directional derivative and how does it relate to the gradient?

The directional derivative in direction $\mathbf{v}$ (unit vector) is $D_{\mathbf{v}}f=\nabla f\cdot\mathbf{v}$. This shows the gradient points in the direction of steepest ascent, and $|\nabla f|$ gives the maximum rate of change. The Cauchy-Schwarz inequality proves $D_{\mathbf{v}}f\leq|\nabla f|$, with equality when $\mathbf{v}=\nabla f/|\nabla f|$.