Coupled linear differential equation systems, state-space representations, and dynamic modal solutions.
What it is
A first-order system of ordinary differential equations is a coupled set of n dynamic equations governing n state variables x(t)=(x1(t),x2(t),…,xn(t))T:
dtdx=f(t,x)
Any n-th order scalar ODE y(n)=F(t,y,y′,…,y(n−1)) canonically reduces to an n-dimensional first-order system by defining state variables x1=y,x2=y′,…,xn=y(n−1).
For homogeneous linear systems with constant coefficients:
dtdx=Ax,A∈Rn×n
The general solution is built from the eigenvaluesλi and eigenvectorsvi satisfying Avi=λivi:
When A possesses n linearly independent eigenvectors:
x(t)=∑i=1ncieλitvi
Subject to Cauchy initial data x(0)=x0, the unique trajectory is generated via the matrix exponential:
x(t)=eAtx0,eAt=∑k=0∞k!(At)k=PeDtP−1
where P is the modal transformation matrix whose columns are eigenvectors, and D=diag(λ1,…,λn).
Why it appears in physics
Nature operates through coupled multi-degree-of-freedom interactions:
Coupled harmonic oscillators: Masses joined by elastic springs exchange vibrational energy (m1x¨1=−k1x1+k12(x2−x1)). Diagonalization decouples the system into independent normal modes, each oscillating at a pure eigenfrequency.
Multiloop electrical networks: Multi-mesh circuits governed by Kirchhoff's current and voltage laws.
Bateman radioactive decay cascades: Sequential decay series (A→B→C), where daughter populations track parent decay rates.
Hamiltonian mechanics: Classical physics expresses Newton's law as a canonical first-order symplectic system of 2n equations:
q˙i=∂pi∂H,p˙i=−∂qi∂H
Visual or geometric intuition
The state vector x(t) traces a continuous path in n-dimensional state space (phase space).
At every coordinate point x, matrix A assigns a local tangent velocity vector v=Ax.
Eigenvectors define invariant rays: along an eigenspace direction vi, the vector field points along the line itself. A state initiated on an eigenvector line never leaves it, expanding (eλt,λ>0) or decaying (eλt,λ<0) rectilinearly.
All other trajectories are curved superpositions of these modal directions.
Minimal symbolic language
Fundamental matrix Φ(t): An n×n matrix whose columns are n linearly independent solution vectors x(1)(t),…,x(n)(t):
dtdΦ=AΦ(t),W(t)=detΦ(t)=0
Liouville-Jacobi formula for matrix Wronskians:
W(t)=W(0)exp(tr(A)t)
where tr(A)=∑λi measures phase volume expansion rate (Liouville's theorem).
Duhamel convolution formula for forced systems:
x′=Ax+g(t)⟹x(t)=eAtx0+∫0teA(t−s)g(s)ds
What the result means
Modal decoupling: Transforming to modal coordinates y=P−1x splits the coupled dynamics into n uncoupled scalar ODEs y˙i=λiyi.
Volume preservation and dissipation: If tr(A)=0 (Hamiltonian conservative systems), the phase flow strictly preserves volume. If tr(A)<0, phase volume contracts toward attractors.
Complex eigenvalues: A pair λ=α±iω generates rotational rotation with frequency ω modulated by radial envelope eαt.
When not to use it
Defective matrices (non-diagonalizable): When algebraic multiplicity exceeds geometric multiplicity, generalized eigenvectors and Jordan forms are mandatory.
Far-from-equilibrium non-linear systems: Local Jacobian linearization x′=Jx fails beyond small perturbations, missing limit cycles and chaos.
Time-varying non-commuting matrices A(t): If A(t)A(s)=A(s)A(t), the exponential solution fails; Magnus expansions or Dyson series are required.
Operational summary
Express the system in canonical form x′=Ax.
Solve det(A−λI)=0 for eigenvalues λi.
Compute eigenvectors from (A−λiI)vi=0.
For complex roots λ=α±iω, extract real and imaginary components of e(α+iω)tv.
Assemble the fundamental matrix Φ(t) and apply initial data x0 via Φ(0)c=x0.
Procedure: Solving Linear Systems of ODEs
Before calculating
Define the state vector: Explicitly write x(t)=(x1,x2,…)T with physical dimensions.
Build matrix A: Check that equations are arranged consistently.
Compute trace and determinant: tr(A)=a11+a22 and det(A)=a11a22−a12a21. Characteristic polynomial: λ2−tr(A)λ+det(A)=0.
Step 1: Identify the mathematical object
Write the system matrix:
A=(a11a21a12a22)
Confirm whether the system is homogeneous.
Step 2: Choose the operation
Solve the characteristic equation:
det(A−λI)=0⟹λ2−tr(A)λ+det(A)=0
Determine eigenvectors for each root:
(A−λkI)vk=0
Pure imaginary α=0⟹ closed elliptic orbits (conservative center).
Opposite real signs ⟹ saddle point (unstable).
Self-check checklist
Does λ1+λ2=tr(A)?
Does λ1λ2=det(A)?
Did I verify (A−λI)v=0?
Did I eliminate all imaginary units i from the physical solution vector?
Does x(0) match initial condition vector x0?
Worked Examples: Systems of Differential Equations
Step-by-step guided example
Problem
Two interconnected brine tanks contain V1=100L and V2=100L respectively.
Fluid is pumped from Tank 1 to Tank 2 at rate r=4L/min, and from Tank 2 to Tank 1 at identical rate r=4L/min, maintaining constant liquid volumes.
At t=0, Tank 1 holds x1(0)=20kg of dissolved salt while Tank 2 holds pure fresh water x2(0)=0kg.
Formulate the matrix system of ODEs for salt masses x1(t) and x2(t).
Calculate eigenvalues and eigenvectors.
Solve analytically for x1(t) and x2(t).
Determine the asymptotic equilibrium state as t→∞.
Detailed solution
Step 1: Matrix system formulation
Salt rate of change in each tank equals inflow rate minus outflow rate:
dtdx1=−1004x1+1004x2=−0.04x1+0.04x2dtdx2=1004x1−1004x2=0.04x1−0.04x2
Matrix format:
dtd(x1x2)=(−0.040.040.04−0.04)(x1x2)
Step 2: Eigenvalue and eigenvector computation
Characteristic polynomial:
det(A−λI)=λ2+0.08λ=0⟹λ1=0,λ2=−0.08min−1
For λ1=0:
(−0.040.040.04−0.04)(v11v12)=0⟹v11=v12⟹v1=(11)
For λ2=−0.08:
(0.040.040.040.04)(v21v22)=0⟹v21=−v22⟹v2=(1−1)
Step 3: General solution and initial condition fittingx(t)=c1(11)+c2e−0.08t(1−1)
At t=0: x(0)=(200):
{c1+c2=20c1−c2=0⟹c1=10,c2=10
Yielding:
x1(t)=10+10e−0.08tkgx2(t)=10−10e−0.08tkg
Step 4: Asymptotic equilibrium
Total dissolved salt: x1(t)+x2(t)=20kg (conserved).
As t→∞, the transient mode vanishes:
x1(∞)=10kg,x2(∞)=10kg
Both reach a uniform concentration of 0.1kg/L.
Inverse example
Problem
Two neural signals recorded by microelectrodes evolve as:
x1(t)=2e−tcos(3t)−e−tsin(3t)x2(t)=e−tcos(3t)+2e−tsin(3t)
Reconstruct the governing matrix A∈R2×2 such that x˙=Ax.
Detailed solution
Step 1: Differentiating state variablesx˙1=e−t(−5cos3t−5sin3t)x˙2=e−t(5cos3t−5sin3t)
Step 2: Sampling at t=0x(0)=(21),x˙(0)=(−55)⟹A(21)=(−55)
Step 3: Sampling at t=π/6x(π/6)=e−π/6(−12),x˙(π/6)=e−π/6(−5−5)⟹A(−12)=(−5−5)
Correction: Matrix exponentials require power series or modal similarity transformations PeDtP−1.
Error 5: Dropping cross-coupling flux terms
In conservation balance models, omitting reciprocal exchange rates between nodes.
Quick control rule
Always verify the trace and determinant identities: λ1+λ2=tr(A) and λ1λ2=det(A). If violated, an algebraic error occurred.
Physical Applications: Systems of Differential Equations
1. Molecular normal modes and vibrational spectroscopy
In polyatomic molecules (such as H2O or CO2), nuclear displacements satisfy:
Mx¨+Kx=0
Diagonalizing mass tensor M alongside stiffness matrix K yields molecular normal modes (symmetric/asymmetric stretching and bending). These eigenfrequencies match absorption lines in infrared (FTIR) and Raman spectroscopy, enabling chemical identification in astrophysics and pharmacology.
2. Power grid transient stability and smart grids
Transient angular stability across high-voltage transmission networks couples synchronous generators through swing equations:
Miδ¨i+Diδ˙i=Pm,i−∑j=1NViVjYijsin(δi−δj)
Linearizing around steady operation reveals system eigenvalues, preventing cascading blackouts under fault conditions.
3. Ecological population dynamics (Lotka-Volterra)
Two-species competition and predator-prey dynamics obey:
dtdN1=N1(r1−a11N1−a12N2)dtdN2=N2(r2−a21N1−a22N2)
Matrix linearization at coexistence fixed points establishes competitive exclusion vs. stable ecological equilibrium.
4. Multi-stream heat exchangers
Counterflow shell-and-tube heat exchangers track hot (Th) and cold (Tc) stream profiles via:
m˙hcp,hdxdTh=−UP(Th−Tc),−m˙ccp,cdxdTc=UP(Th−Tc)
Solving this linear system derives the Logarithmic Mean Temperature Difference (LMTD) critical for boiler and nuclear steam generator engineering.
5. Orbital rendezvous and Clohessy-Wiltshire relative dynamics
Relative proximity operations between two spacecraft approaching the International Space Station are governed by the Clohessy-Wiltshire (Hill's) equations:
x¨−2ωy˙−3ω2x=Fx/my¨+2ωx˙=Fy/mz¨+ω2z=Fz/m
Formulating this as a 6D first-order state system enables real-time Kalman filtering and automated docking thruster guidance.
Interdisciplinary connection
Systems of ODEs underpin Dynamic Stochastic General Equilibrium (DSGE) macroeconomic models, biochemical signal cascade networks, and multi-link robotic manipulator inverse kinematics.
Guided Practice: Systems of Differential Equations
Exercise 1: Normal modes of undamped coupled oscillators
Two identical unit masses m=1kg slide along a frictionless horizontal track. Mass 1 is anchored to a rigid wall by a spring of stiffness k=3N/m, the two masses are coupled by an intermediate spring kc=2N/m, and mass 2 has a free open end.
Write Newton's equations and assemble the matrix system for displacement vector x=(x1,x2)T.
Determine squared eigenfrequencies ω2 and normal mode eigenvectors.
Interpret the physical motion of each normal mode.
Solution
Dynamic equations:
x¨1=−5x1+2x2,x¨2=2x1−2x2
Matrix form x¨=Kx:
(x¨1x¨2)=(−522−2)(x1x2)
Mode 1: Masses oscillate in phase in the same direction, with mass 2 moving twice as far as mass 1.
Mode 2: Masses move in anti-phase (opposite directions), heavily compressing the coupling spring.
Exercise 2: Bateman radioactive decay chain
Parent nuclide A decays with rate constant λ1=0.5h−1 into unstable daughter B, which decays with λ2=0.1h−1 into stable isotope C:
N˙A=−λ1NA,N˙B=λ1NA−λ2NB
Initial inventory: NA(0)=N0,NB(0)=0.