Quote
The enormous usefulness of mathematics in the natural sciences is something bordering on the mysterious.
— Eugene Wigner (1960)
Motivation
This chapter collects the mathematical machinery used throughout electrodynamics: vector calculus in Cartesian and curvilinear coordinates, index notation, integral theorems, delta functions, Fourier analysis, and the Helmholtz decomposition. None of this is new — but having it condensed and cross-referenced saves constant trips back to math references.
Coordinate Systems and Differential Operators
Cartesian Coordinates
Volume element and operators:
Spherical Coordinates
Cylindrical Coordinates
Curl in General Orthogonal Coordinates
In an orthogonal coordinate system with scale factors , the curl is the determinant:
The are the metric coefficients (not Christoffel symbols, though related). For spherical: , , . For cylindrical: , , .
Einstein Summation Convention
Repeated indices are summed over:
This makes vector identities into index algebra. The key objects are and .
Kronecker Delta and Levi-Civita Symbol
Essential Identities
| Identity | Formula |
|---|---|
| Dot product of basis vectors | |
| Trace | |
| Selector | |
| Partial derivative of position | |
| Cross product | |
| Curl | |
| Contraction to zero | |
| Full contraction |
Additional 3D Identities
Fourier representation:
Surface delta function — for a surface defined by :
Second derivative identity:
Why the Delta Term in the Second Derivative
The traceless tensor integrates to zero over any sphere centered at the origin — but must be consistent with . Taking the trace (, summing) of the left side must give , which forces the contact term. This becomes important in the theory of dipole fields.
TODO: Add link to dipole theory.
The Master Identity
The single most useful identity in all of vector calculus via indices:
Almost every vector identity can be derived from this by choosing appropriate indices and contracting.
Proof of the - Identity
Starting from , the product sums over . Since is nonzero only for distinct and distinct : the index is fixed once are chosen, leaving two possible matchings of to . This gives exactly .
Generalization: No Repeated Indices
When there are no repeated indices to sum:
Determinant via Levi-Civita
For a matrix :
A related identity used in the tensor section:
Vector Identities
Cartesian Only
Index-based proofs of vector identities work only in Cartesian coordinates. The strategy: derive the identity in Cartesian indices, then pull the result back into a coordinate-invariant expression. The final identity then holds in any coordinate system.
This is also why it’s often useful to choose along a special direction (e.g., a dipole moment or external field), work out the algebra, and then re-express the answer in coordinate-free form.
Useful Identities
Product rules:
Double cross products:
Deriving by Indices
Using :
Expanding by product rule and reassembling into vector form gives the result.
Mixed dot/cross products:
Decomposing a Vector Along an Arbitrary Direction
For any vector and unit vector :
The first term is the component parallel to ; the second is the perpendicular part. This is used constantly in boundary condition problems.
Functions of
Let with . Then:
Primed ↔ Unprimed Swap
Since and depends on :
This is used constantly when flipping between source coordinates () and field point coordinates (). Convention: primed coordinates refer to sources, unprimed to the point where we evaluate fields/potentials.
The Convective Derivative
Let be a scalar function of space and time. An observer at a fixed point records . An observer moving along a trajectory with velocity records:
For a vector function :
What This Actually Means
Calling a “partial” and a “total” derivative is standard but misleading. What’s really going on:
- is the rate of change at a fixed point in space — the field evolves around you.
- is the change you pick up by moving through a spatially varying field — even if it’s static.
- is the rate of change along a worldline .
The parameter plays a dual role: it parameterizes both the system’s evolution (through ) and the observer’s trajectory (through ). The convective derivative combines both.
Multidimensional Taylor Expansion
Differentials in the Exponent
The notation is formal — it means “apply the differential operator repeatedly.” This is not exponentiation of a number; it’s the operator Taylor series. But it’s extremely useful as a bookkeeping device: translation in space is generated by the gradient operator, just as translation in time is generated by .
The Jacobian
The determinant of the Jacobian matrix relates volume elements when changing variables:
Spherical Coordinates
, , gives , recovering .
Integral Theorems
The Divergence (Gauss’) Theorem
For a vector function defined in a volume enclosed by a surface with outward normal :
Intuition
The divergence at a point measures the net “source strength” — how much more flux leaves a tiny volume than enters it. Summing over all such volumes, interior faces cancel (flux leaving one cell enters the neighbor), and only the flux through the outer boundary survives.
Variants from and (with an arbitrary constant vector):
Examples: Two Surface Integrals
Let bound a volume .
(a)
Set in the gradient variant: . Since , the result follows.
(b)
Apply the divergence theorem to : . Since , we get .
Green’s Identities
Choose in the divergence theorem → Green’s first identity:
Exchange and subtract → Green’s second identity:
Where These Are Used
Green’s identities are the backbone of potential theory. The first identity proves uniqueness of solutions to Laplace’s equation. The second identity is the basis for Green function methods. The vector analogues appear in radiation theory.
Vector analogues: Choose and use :
Exchange and subtract:
Stokes’ Theorem
For a vector function on an open surface bounded by a closed curve :
is traversed in the direction given by the right-hand rule with the thumb along .
Intuition
The curl at a point measures the local circulation density. Summing over all tiny loops tiling , adjacent edges cancel (shared edges are traversed in opposite directions), leaving only the boundary .
Variants from and :
The Delta Function
Not a Function
is a distribution (generalized function) — it is defined only by what it does under an integral sign. It cannot be evaluated pointwise.
One Dimension
Defining property:
Other properties:
Proof of
For : substitute , :
For : the substitution reverses the limits, picking up an extra minus sign, giving .
Integral Representation
Proof via Regularization
Define . For any smooth :
The assertion follows if . Trick:
(Exchanging integration order, then using .)
Connection to Plemelj's Formula
The regularized representation of the step function
is intimately connected to the Sokhotski–Plemelj formula:
where denotes the Cauchy principal value. The delta function picks out the pole contribution; the principal value gives the “regular” part.
Step Function and Sign Function
Three Dimensions
In curvilinear coordinates, the delta function must integrate to unity over all space so:
Half-Space Integral
, not . The delta function is defined by what it does to test functions, and the standard convention (consistent with ) requires the full weight at .
An Important Identity For Electrostatics
Proof
For : direct computation gives (using with ).
At : integrate over a sphere of radius centered at the origin:
A function that vanishes everywhere except at the origin and integrates to is .
Fourier Analysis
Fourier Series
Every periodic function has a Fourier series:
Fourier Transform
For non-periodic functions, the sum becomes an integral:
**Full spacetime (note sign flip convention in temporal direction):
For real : .
Discrete → Continuous
The Fourier series has discrete modes because periodicity imposes a cutoff: the longest wavelength is , so . For a non-periodic function, , the spacing , and the sum becomes an integral. The factor in becomes .
Time-Averaging Theorem
Let and where are complex-valued. Then:
Tensors (Brief)
A tensor of rank is an object whose components transform under rotation by acquiring one factor of per index:
| Rank | Object | Transformation |
|---|---|---|
| 0 | Scalar | |
| 1 | Vector | |
| 2 | Dyadic |
A vector is characterized by preservation of its length under orthogonal transformations: (using ).
A dyadic is a rank-2 tensor composed of juxtaposed (not multiplied) vectors:
The unit dyadic has , so , and .
Pseudovectors
The cross product transforms as:
Under proper rotations (), this is identical to a vector. Under reflections or inversions (), an extra minus sign appears. Such objects are called pseudovectors (or axial vectors).
| Polar × Polar | Axial × Polar | Axial × Axial | |
|---|---|---|---|
| Result | Axial | Polar | Axial |
Example: is a Pseudovector
is polar → is polar → is polar. The gradient transforms like , so it’s polar. From : the curl of is polar, so must be axial (polar × axial = polar).
The Helmholtz Theorem
Statement
An arbitrary vector field that vanishes faster than as can be uniquely decomposed as:
with
This holds for both static and time-dependent fields.
Physical Intuition
- extracts the longitudinal (irrotational) part: determines , and reconstructs the curl-free piece.
- extracts the transverse (solenoidal) part: determines , and reconstructs the divergence-free piece.
In other words, sources and vortices determine the field.
For a scalar field, knowing determines (up to a constant).
Proof: Existence
Start from . Use :
Apply the double-curl identity to split this into two terms and plop since it’s constant with respect to .
Use to turn derivatives into those over :
(and similarly for curl). This generates four terms. The two “total derivative” terms convert to surface integrals at infinity via the divergence theorem:
Both vanish if decays faster than . The remaining two terms give .
Proof: Uniqueness
Suppose and . Let . Then and , so the double-curl identity gives .
Apply Green’s first identity with (any Cartesian component):
The surface integral vanishes as (since decays). Therefore everywhere, and since at infinity, , i.e., .
Helmholtz Variants
Variant I: Scalar Field in a Finite Volume
For a scalar field in a volume bounded by :
Proof trick: Pull one outside the integrand in the Helmholtz starting expression, then integrate by parts — the volume piece gives and the surface piece gives on , which is exactly the second term.
Source: D.A. Woodside, Journal of Mathematical Physics 40, 4911 (1999).
Variant II: Divergence-Free and Curl-Free in a Finite Volume
If and everywhere in a simply connected volume bounded by , then can be found everywhere in from its values on alone:
Proof trick: Start from the finite-volume Helmholtz decomposition (which has both volume and surface integrals). The two volume integrals involve and , which both vanish by assumption — only the surface terms survive.
Lagrange Multipliers
To extremize subject to the constraint , extremize the unconstrained function:
How This Actually Works
Treat itself as a variable. Then and give , while recovers the constraint (if the constraint is , just redefine ). You’ve traded a constrained problem in 2 variables for an unconstrained problem in 3, where the extra variable’s equation of motion is the constraint.
Geometrically: At a constrained extremum, must be parallel to — otherwise there’s a component of along the constraint surface, meaning you could slide along and still increase . The multiplier is exactly the proportionality constant.
When Becomes a Function
In many physics problems, the constraint must hold at every point in space — e.g., requiring a charge distribution to produce a given potential everywhere on a surface. Then is promoted to a function , and the “unconstrained” functional becomes:
The variation now gives a local equation at each point. The simplest example: finding the charge distribution on a conductor that minimizes electrostatic energy subject to on the surface — this is Thomson’s theorem (Ch. 7).
Problems
Foundations
1.7 — A Representation of the Delta Function
Show that is a representation of by proving .
Solution Sketch
Change variables , so and . As , , leaving .
Evaluating the Dirichlet integral Trick: Write (for ), exchange integration order, compute the Laplace transform of :
1.12 — Unit Vector Practice
Express the derivatives of spherical unit vectors , , , , , in terms of .
Solution Sketch
Direct calculation using and similarly for . Differentiate component by component and re-express in the spherical basis:
Intuition for a few entries:
- : increasing tilts toward the equator — that’s the direction.
- : has no -dependence — it lives in the -plane regardless of polar angle.
- : rotating in swings inward, with components toward both the radial direction and the pole.
1.13 — Compute the Normal Vector
Given a surface (an ellipsoid), compute the outward unit normal .
Solution Sketch
Check: When , this reduces to , as expected for a sphere.
Delta Function and Fourier
1.16 — Densities of States
Prove the delta function identity and use it to compute densities of states.
Solution Sketch
Near each zero where , Taylor expand: . Then locally , using . Summing over all zeros gives the identity. In physics, is typically an energy-momentum relation , and the sum over zeros gives the density of states.
Vector Calculus Identities
1.3 — Divergence and Curl Identities
Prove: (a) (b) (c)
Solution Sketch
All follow from the master identity .
(a): .
(b): .
(c): Let . Then by the BAC-CAB rule.
1.4 — Levi-Civita Proofs
(a) Show . (b) Prove .
Solution Sketch
(a): For : . Any even permutation gives , odd gives , repeated index gives (since ).
(b): by definition of the cross product in index notation. Attach to get the vector.
1.11 — Integral Identities
Assume and vanish faster than as . (a) If and , show . (b) If and , show . (c) Prove .
Solution Sketch
(a): Integrate by parts: . Surface term vanishes (decay); volume term vanishes ().
(b): Use . Since : .
(c): Consider and apply the divergence theorem. The product rule gives , so . Integrate over and convert the first term to a surface integral.
Physical Significance of (c)
The integral of a polarization over a volume can be rewritten in terms of (bound charge) and the surface term (bound surface charge), weighted by position .