Mathematics / Pure Mathematics Differential Equations I 100% Free Open Access
Chapter 1 • Theory & Derivations

Foundations, Classifications & Geometric Theory of Differential Equations

Comprehensive mathematical foundations of ordinary differential equations: classification criteria (order, degree, linearity), elimination of arbitrary constants, general versus singular solutions, initial and boundary value formulations, Picard-Lindelöf existence and uniqueness theorem, Picard iteration convergence, direction fields, isoclines, and autonomous phase line stability.

§1.1Classification of Differential Equations: Order, Degree & Linearity

1. Fundamental Definitions & Terminology

A differential equation (DE) is any mathematical equation involving an unknown function $y = \phi(x)$ and one or more of its derivatives with respect to one or more independent variables. If the unknown function depends on only one independent variable, the equation is called an Ordinary Differential Equation (ODE). If the unknown function depends on two or more independent variables, the equation involves partial derivatives and is designated a Partial Differential Equation (PDE).

The general implicit representation of an $n$-th order ODE in a single dependent variable $y$ and independent variable $x$ is expressed as:

$$F\left(x, y, \frac{dy}{dx}, \frac{d^2y}{dx^2}, \dots, \frac{d^ny}{dx^n}\right) = 0, \quad \text{or explicitly as } \frac{d^ny}{dx^n} = f\left(x, y, y', \dots, y^{(n-1)}\right)$$

2. Order and Degree of an Ordinary Differential Equation

Two foundational topological and algebraic integers characterize any ODE:

  • Order: The order of a differential equation is the order of the highest derivative appearing in the equation. For instance, $\frac{d^2y}{dx^2} + 5\left(\frac{dy}{dx}\right)^3 + y = 0$ is of order 2.
  • Degree: The degree of a differential equation is the power (algebraic exponent) to which the highest derivative is raised, after the equation has been rationalized and cleared of all fractional powers and radicals with respect to the derivatives. For example, in $\left[1 + \left(\frac{dy}{dx}\right)^2\right]^{3/2} = k \frac{d^2y}{dx^2}$, squaring both sides yields $\left[1 + (y')^2\right]^3 = k^2 (y'')^2$, confirming that the equation has order 2 and degree 2.

3. The Criterion of Linearity

An $n$-th order ordinary differential equation is classified as linear if it can be written in the form:

$$a_n(x) \frac{d^ny}{dx^n} + a_{n-1}(x) \frac{d^{n-1}y}{dx^{n-1}} + \dots + a_1(x) \frac{dy}{dx} + a_0(x) y = g(x)$$

Linearly characterized equations must strictly satisfy two defining properties:

  1. The dependent variable $y$ and all its derivatives $y', y'', \dots, y^{(n)}$ appear strictly to the first power (no terms like $y^2, (y')^3, \sqrt{y'}$).
  2. No products of the dependent variable and its derivatives appear (no terms like $y \cdot y'$ or $y' \cdot y''$).
  3. Coefficients $a_k(x)$ and the forcing term $g(x)$ depend solely on the independent variable $x$.

If any of these conditions are violated, the equation is non-linear (e.g., $y'' + \sin(y) = 0$ is non-linear due to the transcendental term in $y$; $y y' + x = 0$ is non-linear due to the product $y y'$).

§1.2Formation of ODEs, Solution Concepts & Initial vs Boundary Value Problems

1. Formation of Differential Equations by Eliminating Arbitrary Constants

In physical modeling and analytical geometry, a family of curves is defined by an algebraic equation containing $n$ arbitrary parameters (constants) $C_1, C_2, \dots, C_n$:

$$\Phi(x, y, C_1, C_2, \dots, C_n) = 0$$

To eliminate these $n$ arbitrary constants, we differentiate the relation successively $n$ times with respect to $x$, yielding a system of $n + 1$ equations involving $x, y, y', y'', \dots, y^{(n)}$ and $C_1, \dots, C_n$. Eliminating the $n$ constants among these $n+1$ relations produces an ODE of order $n$.

Fundamental Theorem: The elimination of $n$ independent arbitrary constants from a relation yields a differential equation of order exactly $n$.

2. Taxonomies of Solutions: General, Particular & Singular

  • General Solution: An explicit or implicit relation $\phi(x, y, C_1, \dots, C_n) = 0$ that satisfies the $n$-th order ODE and contains exactly $n$ essential arbitrary constants.
  • Particular Solution: Any solution obtained directly from the general solution by assigning specific numerical values to one or more of the arbitrary constants $C_k$, typically dictated by initial or boundary constraints.
  • Singular Solution: A solution that cannot be obtained from the general solution by any choice of the arbitrary constants. Geometrically, singular solutions represent envelopes of the family of curves represented by the general solution.

3. Initial Value Problems (IVPs) versus Boundary Value Problems (BVPs)

An Initial Value Problem (IVP) prescribes conditions on the unknown function and its derivatives at a single value of the independent variable $x_0$:

$$y^{(n)} = f(x, y, y', \dots, y^{(n-1)}), \quad y(x_0) = y_0, \quad y'(x_0) = y_1, \quad \dots, \quad y^{(n-1)}(x_0) = y_{n-1}$$

A Boundary Value Problem (BVP), by contrast, prescribes conditions at two or more distinct points (e.g., $y(a) = \alpha$, $y(b) = \beta$). While IVPs generally possess unique solutions under Lipschitz conditions, BVPs can have a unique solution, infinitely many solutions, or no solution at all.

§1.3The Picard-Lindelöf Existence & Uniqueness Theorem and Picard Iterations

1. Statement of the Picard-Lindelöf Theorem

$$\mathbf{\text{Theorem (Picard-Lindelöf): Let } R = \{(x, y) \in \mathbb{R}^2 : |x - x_0| \le a, |y - y_0| \le b\} \text{ be a closed rectangle.}}$$

If $f(x, y)$ is continuous on $R$ and satisfies a Lipschitz condition with respect to $y$ in $R$, that is, there exists a constant $L > 0$ such that:

$$|f(x, y_1) - f(x, y_2)| \le L |y_1 - y_2| \quad \forall (x, y_1), (x, y_2) \in R$$

then there exists a unique solution $y = \phi(x)$ to the initial value problem $y' = f(x, y), y(x_0) = y_0$, defined on an interval $|x - x_0| \le h$, where $h = \min\left(a, \frac{b}{M}\right)$ and $M = \max_{(x,y) \in R} |f(x, y)|$.

2. Picard's Method of Successive Approximations

Integrating $y' = f(t, y(t))$ from $x_0$ to $x$ converts the differential initial value problem into an equivalent Volterra integral equation:

$$y(x) = y_0 + \int_{x_0}^x f(t, y(t)) dt$$

Picard's iterative algorithm constructs a sequence of continuous approximations $\{\phi_k(x)\}_{k=0}^\infty$ defined recursively by:

$$\phi_0(x) = y_0, \qquad \phi_{k+1}(x) = y_0 + \int_{x_0}^x f(t, \phi_k(t)) dt \quad (k = 0, 1, 2, \dots)$$

By Banach's fixed-point theorem on the complete metric space $C([x_0-h, x_0+h])$, this sequence converges uniformly to the unique continuous solution $\phi(x) = \lim_{k\to\infty} \phi_k(x)$.

3. Step-by-Step Analytical Example

Consider the IVP: $y' = 2x(1 + y)$ with $y(0) = 0$. Here $x_0 = 0, y_0 = 0$, and $f(x, y) = 2x(1 + y)$:

$$\begin{aligned} \phi_0(x) &= 0 \\ \phi_1(x) &= 0 + \int_0^x 2t(1 + \phi_0(t)) dt = \int_0^x 2t dt = x^2 \\ \phi_2(x) &= \int_0^x 2t(1 + t^2) dt = \left[ t^2 + \frac{t^4}{2} \right]_0^x = x^2 + \frac{x^4}{2!} \\ \phi_3(x) &= \int_0^x 2t\left(1 + t^2 + \frac{t^4}{2}\right) dt = x^2 + \frac{x^4}{2!} + \frac{x^6}{3!} \\ \dots \\ \phi_n(x) &= \sum_{k=1}^n \frac{(x^2)^k}{k!} \implies \lim_{n\to\infty} \phi_n(x) = \sum_{k=1}^\infty \frac{(x^2)^k}{k!} = e^{x^2} - 1 \end{aligned}$$

Direct differentiation confirms: $\phi'(x) = 2x e^{x^2} = 2x(1 + (e^{x^2}-1)) = 2x(1 + y)$ with $\phi(0) = e^0 - 1 = 0$, yielding the exact closed-form solution!

§1.4Direction Fields, Isoclines & Autonomous Phase Line Dynamics

1. Direction Fields (Slope Fields) & Geometric Interpretation

Even when a first-order ODE $y' = f(x, y)$ cannot be solved by elementary analytical integration, the equation provides immediate geometric insight: at every point $(x, y)$ in the plane where $f(x, y)$ is defined, the derivative $y'$ represents the slope of the tangent line to the integral curve passing through that point. A direction field is a graphical grid of small line segments possessing slope $f(x, y)$.

2. The Method of Isoclines

An isocline is a curve along which the slopes of the integral curves are constant. Setting $f(x, y) = c$, where $c$ is a constant parameter, yields the family of isoclines. Integral curves cross each isocline $f(x, y) = c$ with precisely the slope $c$. Sketching several isoclines provides an exact scaffolding for tracing solution trajectories.

3. Autonomous Equations & Phase Line Stability

An ODE is called autonomous if the independent variable $x$ (often time $t$) does not appear explicitly:

$$\frac{dy}{dt} = f(y)$$

The zeros of $f(y)$, where $f(c) = 0$, are called equilibrium points (or critical points). The constant functions $y(t) \equiv c$ are equilibrium solutions. The qualitative behavior of all non-equilibrium solutions is classified on the one-dimensional phase line:

  • Asymptotically Stable (Attractor / Sink): If $f'(c) < 0$, trajectories on both sides move toward $c$ as $t \to \infty$.
  • Unstable (Repeller / Source): If $f'(c) > 0$, trajectories on both sides move away from $c$ as $t \to \infty$.
  • Semi-stable (Shunt): Trajectories approach $c$ from one side and diverge on the other (occurs when $f(y)$ does not change sign across $c$, such as when $f(y)$ has a double root).
TIERED UNIVERSITY HONORS PROBLEMS

Step-by-Step Solved Examination Problems

Comprehensive analytical derivations, multi-tier solutions (Foundational, Intermediate Exam, and Honors/Proof Challenge) with complete line-by-line verification.

Tier 1 • Foundational Picard Successive Iteration for a Linear IVP
Apply Picard's method of successive approximations to compute the first three iterative approximations $\phi_1(x), \phi_2(x), \phi_3(x)$ for the initial value problem:
$$\frac{dy}{dx} = x + y, \quad y(0) = 1$$
Verify the induction pattern and compare with the exact solution.
Tier 2 • Analytical University Exam Elimination of Arbitrary Constants & Differential Family of Circles
Find the differential equation of the family of all circles in the $xy$-plane having their centers on the $x$-axis. Determine its order, degree, and linearity.
Tier 3 • Honors Challenge Lipschitz Domain & Local Uniqueness Breakdown Analysis
Investigate the existence and uniqueness of solutions for the initial value problem:
$$\frac{dy}{dx} = 3 y^{2/3}, \quad y(0) = 0$$
Prove that the Lipschitz condition is violated on any interval containing $y = 0$, construct infinitely many distinct solutions, and interpret geometrically.