- ODE redirects here. For the real-time physics engine, see open dynamics engine.
In mathematics, and particularly in analysis, an ordinary differential equation (or ODE) is a relation that contains functions of only one independent variable, and one or more of its derivatives with respect to that variable. See differential calculus and integral calculus for basic calculus background.
Many scientific theories can be expressed clearly and concisely in terms of ordinary differential equations. For instance, the law for radioactive decay of a single isotope of an element, states that its rate of loss of mass is proportional to its mass. If t represents time and u(t) represents the mass of the isotope at time t, then the law for decay states that
-
where is a constant that depends upon the particular isotope.
Another example of an ordinary differential equation is Newton's second law of motion of a single particle, which states that F = ma, where F is an applied force, m is the mass of the particle, and a is the acceleration of the particle due to the force. If motion is constrained to a straight line, the coordinate t measures the time elapsed and the unknown function x(t) specifies the position of the particle along the line, then the velocity of the particle v is given by the first derivative of x with respect to t:
- .
Similarly, the acceleration of the particle a is given by the second derivative of x:
- .
Thus Newton's second law implies the differential equation
- .
In general, the force depends upon the position of the particle, and thus the unknown variable x appears on both sides of the differential equation, as is indicated in the notation f(x).
Important theorems in the field of ODEs include broad existence and uniqueness theorems and for ODEs in the plane, the Poincaré-Bendixson theorem.
Definition
Let
y represent an unknown function of
x, and let
-
denote the derivatives
-
An ordinary differential equation (ODE) is an equation involving
-
The order of a differential equation is the order n of the highest derivative that appears. If the highest derivative appears only in integer powers, then the degree of the equation is the highest power of the highest derivative.
A solution of an ODE is a function y(x) whose derivatives satisfy the equation. Such a function is not guaranteed to exist and, if it does exist, is usually not unique. A general solution of an nth-order equation is a solution containing arbitrary variables, corresponding to n constants of integration. A particular solution is derived from the general solution by setting the constants to particular values. A singular solution is a solution that can't be derived from the general solution.
When a differential equation of order n has the form
-
it is called an
implicit differential equation whereas the form
-
is called an
explicit differential equation.
A differential equation not depending on x is called autonomous, and one with no terms depending only on x is called homogeneous.
General application
An important special case is when the equations do not involve
. These differential equations may be represented as
vector fields. This type of differential equation has the property that space can be divided into
equivalence classes based on whether two points lie on the same solution
curve. Since the laws of physics are believed not to change with time,
the physical world is governed by such differential equations. (See also
symplectic topology for abstract discussion.)
In the case where the equations are linear, the original equation can be solved by breaking it down into
smaller equations, solving those, and then adding the results back together. Unfortunately, many of the interesting differential equations are non-linear, which
means that they cannot be broken down in this way. There are also a number of techniques for solving differential equations using a computer (see numerical ordinary differential equations).
Ordinary differential equations are to be distinguished from partial differential equations where is a function of several variables, and the differential equation involves partial derivatives.
Existence and nature of solutions
The problem of solving a differential equation is to find the function
whose derivatives satisfy the equation. For example, the differential equation
-
has the general solution
- ,
where A, B are constants determined from boundary conditions.
In general, an n-th order equation allows both and to be fixed, as well as all the lower order derivatives of ; the remaining equation can be solved (at least conceptionally) for . If the equation has finite degree , then we now have a polynomial equation in with at most roots. Therefore there can be as many as possible values for at any given point and for any possible values of the lower order derivatives, though there may be ranges of these points and values where there are fewer solutions (or none at all). A Lipschitz condition must also be satisfied for a solution to exist.
Thus, in the previous example, a second-order, first-degree equation, any point on the plane and any slope through that point can be selected and yield a unique solution (since the single root of exists for any value of ). Note in particular that there are an infinity of solutions through any given point; this is a general characteristic of equations of order higher than one.
Consider now
-
with general solution
-
This is a first-order, second-degree equation, thus any point can have at most two solutions passing through it, corresponding to the two roots of in the quadratic equation that would result after fixing and . Studying the quadratic equation's discriminant () leads to the conclusion that only a single solution exists along the parabola (where the discriminant is zero) and that no solution exists below this parabola (where both roots are complex).
The parabola in this problem is an example of a cusp locus; a curve along which two or more roots of the differential equation are identical. Along such a locus it is possible to move from one general solution to another while still obeying the differential equation; thus the presence of cusp loci introduce the possibility of singular solutions. In this example, the parabola is such a singular solution; it satisfies the original differential equation, and a full set of solutions must include such possibilities as the hybrid solution:
where the cusp locus has been used to connect two particular solutions; note that the first derivative (the only derivative to appear in the differential equation) is continuous at the transitions.
(Johnson, Chapter 5)
Types of differential equations with some history
The influence of geometry, physics, and astronomy,
starting with
Newton and
Leibniz, and further manifested through the
Bernoullis,
Riccati, and
Clairaut, but chiefly through
d'Alembert and
Euler, has been very marked, and especially on the theory of linear partial differential equations with constant coefficients.
Homogeneous linear ODEs with constant coefficients
The first method of integrating linear ordinary differential
equations with constant coefficients is due to
Euler, who realized that solutions have the form
, for possibly-complex values of
. Thus
-
has the form
-
so dividing by
gives the
nth-order polynomial
-
In short the terms
-
of the original differential equation are replaced by
zk.
Solving the polynomial gives
n values of
z,
. Plugging those values into
gives a
basis for the solution; any
linear combination of these basis functions will satisfy the differential equation.
This equation F(z) = 0, is the "characteristic"
equation considered later by Monge and Cauchy.
If z is a (possibly not real) zero of F(z) of multiplicity m and then is a solution of the ODE. These functions make up a basis of the ODE's solutions.
If the Ai are real then real-valued solutions are preferable. Since the non-real z values will come in conjugate pairs, so will their corresponding ys; replace each pair with their linear combinations Re(y) and Im(y).
A case that involves complex roots can be solved with the aid of Euler's formula.
- Example: Given . The characteristic equation is which has zeroes 2+i and 2−i. Thus the solution basis is . Now y'' is a solution iff for .
Because the coefficients are real,
- we are likely not interested in the complex solutions
- our basis elements are mutual conjugates
The linear combinations
- and
-
will give us a real basis in
.
Linear ODEs with constant coefficients
Suppose instead we face
-
For later convenience, define the characteristic polynomial
-
We find the solution basis
as in the homogeneous (
f=0) case. We now seek a
particular solution yp by the
variation of parameters method. Let the coefficients of the linear combination be functions of
x:
-
Using the "operator" notation
and a broad-minded use of notation, the ODE in question is
; so
-
With the constraints
-
-
- …
-
the parameters commute out, with a little "dirt":
-
But
, therefore
-
This, with the constraints, gives a linear system in the
. This much can always be solved; in fact, combining
Cramer's rule with the
Wronskian,
-
The rest is a matter of integrating
The particular solution is not unique; also satisfies the ODE for any set of constants cj.
See also variation of parameters.
Example: Suppose . We take the solution basis found above .
- {|
|
|
|
|
|
|
|
|
|
- {|
|
|
|
|
|
|
- {|
|
|
|
|
|
|
Using the list of integrals of exponential functions
- {|
|
|
|
|
|
|
- {|
|
|
|
|
|
|
And so
- {|
|
| | +\frac{i}{2(3-4i+k^2)}\left((i-2)\sin(kx)-k\cos(kx)\right)
|
|
|
(Notice that u1 and u2 had factors that canceled y1 and y2; that is typical.)
For interest's sake, this ODE has a physical interpretation as a driven damped harmonic oscillator; yp represents the steady state, and is the transient.
Linear ODEs with variable coefficient
Method of undetermined coefficients
The method of undetermined coefficients (MoUC), is useful in finding solution for . Given the ODE , find another differential operator such that . This operator is called the annihilator, and thus the method of undetermined coefficients is also known as the annihilator method. Applying to both sides of the ODE gives an homogeneous ODE for which we find a solution basis as before. Then the original nonhomogeneous ODE is used to construct a system of equations restricting the coefficients of the linear combinations to satisfy the ODE.
Undetermined coefficients is not as general as variation of parameters in the sense that an annihilator does not always exist.
Example: Given , .
The simplest annihilator of is . The zeros of are , so the solution basis of is
Setting we find
- {|
|
|
|
|
|
|
|
|
|
|
|
|
|
| | +c_4(-k^2+4ik+5)(\cos(kx)-i\sin(kx))
giving the system
-
-
which has solutions
- ,
giving the solution set
- {|
|
|
|
|
| | {(k^2+4ik-5)(k^2-4ik-5)}
|
| | +\frac{4k\cos(kx)+(5-k^2)\sin(kx)}{k^4+6k^2+25}.
Method of variation of parameters
- .
As explained above, the general solution to a non-homogeneous, linear differential equation can be expressed as the sum of the general solution to the corresponding homogenous, linear differential equation and any one solution to .
Like the method of undetermined coefficients, described above, the method of variation of parameters is a method for finding one solution to , having already found the general solution to . Unlike the method of undetermined coefficients, which fails except with certain specific forms of g(x), the method of variation of parameters will always work; however, it is significantly more difficult to use.
For a second-order equation, the method of variation of parameters makes use of the following fact:
= Fact
=
Let p(x), q(x), and g(x) be functions, and let and be solutions to the homogeneous, linear differential equation . Further, let u(x) and v(x) be functions such that and for all x, and define . Then is a solution to the non-homogeneous, linear differential equation (x) + p(x) y'(x) + q(x) y(x) = g(x).
= Proof
=
|
|
|
|
|
|
|
|
|
|
|
|
= Usage
=
To solve the second-order, non-homogeneous, linear differential equation using the method of variation of parameters, use the following steps:
- Find the general solution to the corresponding homogeneous equation . Specifically, find two linearly independent solutions and .
- Since and are linearly independent solutions, their Wronskian is nonzero, so we can compute and . If the former is equal to u'(x) and the latter to v'(x), then u and v satisfy the two constraints given above: that and that . We can tell this after multiplying by the denominator and comparing coefficients.
- Integrate and to obtain u(x) and v(x), respectively. (Note that we only need one choice of u and v, so there is no need for constants of integration.)
- Compute . The function is one solution of .
- The general solution is , where and are arbitrary constants.
= Higher-order equations
=
The method of variation of parameters can also be used with higher-order equations. For example, if , , and are linearly independent solutions to , then there exist functions u(x), v(x), and w(x) such that , , and (x) + v'(x) y_2(x) + w'(x) y_3(x) = g(x). Having found such functions (by solving algebraically for u'(x), v'(x), and w'(x), then integrating each), we have , one solution to the equation .
= Example
=
Solve the previous example,
Recall . From technique learned from 3.1, LHS has root of that yield , (so , ) and its derivatives
{\dot u = \frac{W} = \frac = \tan x} \\
{\dot v = \frac{W} = \frac = 1} \\
\end{matrix}} \right.
where the Wronskian
{\cos x} & {\sin x} \\
{ - \sin x} & {\cos x} \\
\end{matrix}} \right| = 1
were computed in order to seek solution to its derivatives.
Upon integration,
u = - \int {\tan xdx = - \ln \left| {\sec x} \right| + C} \\
v = \int {1dx = x + C} \\
\end{matrix} \right.
Computing and :
y_p = f = uy_1 + vy_2 = \cos x\ln \left| {\cos x} \right| + x\sin x \\
y_G = y_c + y_p = C_1 \cos x + C_2 \sin x + x\sin x + \cos x\ln \left( {\cos x} \right) \\
\end{matrix}
General solution method for first-order linear ODEs
For a first-order linear ODE, with coefficients that may or may not vary with t:
Then,
-
where is the constant of integration, and
Proof
This proof comes from Jean Bernoulli. Let
-
Suppose for some unknown functions u(t) and v(t) that x = uv.
Then
-
Substituting into the differential equation,
-
Now, the most important step: Since the differential equation is linear we can split this into two independent equations and write
-
-
Since v is not zero, the top equation becomes
-
The solution of this is
-
Substituting into the second equation
-
Since x = uv, for arbitrary constant C
-
First order differential equation with constant coefficients
As an illustrative example, consider a first order differential equation with constant coefficients:
-
This equation is particularly relevant to first order systems such as RC circuits, mass-damper systems.
After nondimensionalization, the equation becomes
-
In this case, p(t) = r(t) = 1.
Hence its solution by inspection is
-
Singular solutions
The theory of singular solutions of ordinary and partial
differential equations was a subject of research from the time
of Leibniz, but only since the middle of the nineteenth century did it
receive special attention. A valuable but little-known work on the
subject is that of Houtain (1854). Darboux (starting in 1873) was a
leader in the theory, and in the geometric interpretation of these
solutions he opened a field which was worked by various
writers, notably Casorati and Cayley. To the latter is due (1872)
the theory of singular solutions of differential equations of the
first order as accepted circa 1900.
Reduction to quadratures
The primitive attempt in dealing with differential equations had in
view a reduction to quadratures. As it had been the hope of
eighteenth-century algebraists to find a method for solving the
general equation of the th degree, so it was the hope of analysts
to find a general method for integrating any differential
equation. Gauss (1799) showed, however, that the differential
equation meets its limitations very soon unless complex numbers are
introduced. Hence analysts began to substitute the study of
functions, thus opening a new and fertile field. Cauchy was the
first to appreciate the importance of this view. Thereafter the real question
was to be, not whether a solution is possible by means of known
functions or their integrals, but whether a given differential
equation suffices for the definition of a function of the
independent variable or variables, and if so, what are the
characteristic properties of this function.
The Fuchsian theory
Two memoirs by Fuchs (Crelle, 1866, 1868), inspired a novel approach, subsequently elaborated by Thomé and Frobenius. Collet was a prominent contributor beginning in 1869, although his method for integrating a
non-linear system was communicated to Bertrand in 1868. Clebsch (1873) attacked
the theory along lines parallel to those followed in his theory of
Abelian integrals. As the latter can be classified according to the
properties of the fundamental curve which remains unchanged under a
rational transformation, so Clebsch proposed to classify the
transcendent functions defined by the differential equations
according to the invariant properties of the corresponding surfaces
f = 0 under rational one-to-one transformations.
Lie's theory
From 1870 Lie's work put the theory of differential equations
on a more satisfactory foundation. He showed that the integration
theories of the older mathematicians can, by the introduction of what are now called Lie groups, be referred to a common source; and that
ordinary differential equations which admit the same infinitesimal transformations present comparable difficulties of integration. He
also emphasized the subject of transformations of contact
(Berührungstransformationen).
See also
Bibliography
- A. D. Polyanin and V. F. Zaitsev, ''Handbook of Exact Solutions for Ordinary Differential Equations (2nd edition)", Chapman & Hall/CRC Press, Boca Raton, 2003. ISBN 1-58488-297-2
- A. D. Polyanin, V. F. Zaitsev, and A. Moussiaux, Handbook of First Order Partial Differential Equations'', Taylor & Francis, London, 2002. ISBN 0-415-27267-X
- D. Zwillinger, Handbook of Differential Equations (3rd edition), Academic Press, Boston, 1997.
- Hartman, Philip, Ordinary Differential Equations, 2nd Ed., Society for Industrial & Applied Math, 2002. ISBN 0898715105.
- W. Johnson, A Treatise on Ordinary and Partial Differential Equations, John Wiley and Sons, 1913, in University of Michigan Historical Math Collection
External links
Differential calculus | Ordinary differential equations
Equació diferencial ordinària | Gewöhnliche Differentialgleichung | Equazione differenziale ordinaria | 常微分方程式 | Równanie różniczkowe zwyczajne | Equação diferencial ordinária | Ecuaţie diferenţială ordinară | Обыкновенные дифференциальные уравнения | Ordinär differentialekvation | 常微分方程