HOME

TheInfoList



OR:

In
mathematics Mathematics is an area of knowledge that includes the topics of numbers, formulas and related structures, shapes and the spaces in which they are contained, and quantities and their changes. These topics are represented in modern mathematics ...
 – specifically, in
differential equation In mathematics, a differential equation is an equation that relates one or more unknown functions and their derivatives. In applications, the functions generally represent physical quantities, the derivatives represent their rates of change, an ...
s – the Picard–Lindelöf theorem gives a set of conditions under which an
initial value problem In multivariable calculus, an initial value problem (IVP) is an ordinary differential equation together with an initial condition which specifies the value of the unknown function at a given point in the domain. Modeling a system in physics or ...
has a unique solution. It is also known as Picard's existence theorem, the Cauchy–Lipschitz theorem, or the existence and
uniqueness Uniqueness is a state or condition wherein someone or something is unlike anything else in comparison, or is remarkable, or unusual. When used in relation to humans, it is often in relation to a person's personality, or some specific characterist ...
theorem. The theorem is named after
Émile Picard Charles Émile Picard (; 24 July 1856 – 11 December 1941) was a French mathematician. He was elected the fifteenth member to occupy seat 1 of the Académie française in 1924. Life He was born in Paris on 24 July 1856 and educated there at t ...
,
Ernst Lindelöf Ernst is both a surname and a given name, the German, Dutch, and Scandinavian form of Ernest. Notable people with the name include: Surname * Adolf Ernst (1832–1899) German botanist known by the author abbreviation "Ernst" * Anton Ernst (1975- ...
,
Rudolf Lipschitz Rudolf Otto Sigismund Lipschitz (14 May 1832 – 7 October 1903) was a German mathematician who made contributions to mathematical analysis (where he gave his name to the Lipschitz continuity condition) and differential geometry, as well as numbe ...
and Augustin-Louis Cauchy.


Theorem

Let D \subseteq \R \times \R^nbe a closed rectangle with (t_0, y_0) \in D. Let f: D \to \R^n be a function that is
continuous Continuity or continuous may refer to: Mathematics * Continuity (mathematics), the opposing concept to discreteness; common examples include ** Continuous probability distribution or random variable in probability and statistics ** Continuous ...
in t and
Lipschitz continuous In mathematical analysis, Lipschitz continuity, named after German mathematician Rudolf Lipschitz, is a strong form of uniform continuity for functions. Intuitively, a Lipschitz continuous function is limited in how fast it can change: there e ...
in y. Then, there exists some such that the initial value problem y'(t)=f(t,y(t)),\qquad y(t_0)=y_0. has a unique solution y(t) on the interval _0-\varepsilon, t_0+\varepsilon/math>. Note that D is often instead required to be open but even under such an assumption, the proof only uses a closed rectangle within D.


Proof sketch

The proof relies on transforming the differential equation, and applying Banach fixed-point theorem. By integrating both sides, any
function Function or functionality may refer to: Computing * Function key, a type of key on computer keyboards * Function model, a structured representation of processes in a system * Function object or functor or functionoid, a concept of object-oriente ...
satisfying the differential equation must also satisfy the
integral equation In mathematics, integral equations are equations in which an unknown Function (mathematics), function appears under an integral sign. In mathematical notation, integral equations may thus be expressed as being of the form: f(x_1,x_2,x_3,...,x_n ; ...
:y(t) - y(t_0) = \int_^t f(s,y(s)) \, ds. A simple proof of existence of the solution is obtained by successive approximations. In this context, the method is known as
Picard iteration In numerical analysis, fixed-point iteration is a method of computing fixed point (mathematics), fixed points of a function. More specifically, given a function f defined on the real numbers with real values and given a point x_0 in the domain of ...
. Set :\varphi_0(t)=y_0 and :\varphi_(t)=y_0+\int_^t f(s,\varphi_k(s))\,ds. It can then be shown, by using the
Banach fixed-point theorem In mathematics, the Banach fixed-point theorem (also known as the contraction mapping theorem or contractive mapping theorem) is an important tool in the theory of metric spaces; it guarantees the existence and uniqueness of fixed points of certa ...
, that the sequence of "Picard iterates" is convergent and that the
limit Limit or Limits may refer to: Arts and media * ''Limit'' (manga), a manga by Keiko Suenobu * ''Limit'' (film), a South Korean film * Limit (music), a way to characterize harmony * "Limit" (song), a 2016 single by Luna Sea * "Limits", a 2019 ...
is a solution to the problem. An application of Grönwall's lemma to , where and are two solutions, shows that , thus proving the global uniqueness (the local uniqueness is a consequence of the uniqueness of the Banach fixed point). See
Newton's method In numerical analysis, Newton's method, also known as the Newton–Raphson method, named after Isaac Newton and Joseph Raphson, is a root-finding algorithm which produces successively better approximations to the roots (or zeroes) of a real-valu ...
of successive approximation for instruction.


Example of Picard iteration

Let y(t)=\tan(t), the solution to the equation y'(t)=1+y(t)^2 with initial condition y(t_0)=y_0=0,t_0=0. Starting with \varphi_0(t)=0, we iterate :\varphi_(t)=\int_0^t (1+(\varphi_k(s))^2)\,ds so that \varphi_n(t) \to y(t): :\varphi_1(t)=\int_0^t (1+0^2)\,ds = t :\varphi_2(t)=\int_0^t (1+s^2)\,ds = t + \frac :\varphi_3(t)=\int_0^t \left(1+\left(s + \frac\right)^2\right)\,ds = t + \frac + \frac + \frac and so on. Evidently, the functions are computing the Taylor series expansion of our known solution y=\tan(t). Since \tan has poles at \pm\tfrac, this converges toward a local solution only for , t, <\tfrac, not on all of \R.


Example of non-uniqueness

To understand uniqueness of solutions, consider the following examples. A differential equation can possess a stationary point. For example, for the equation (a<0), the stationary solution is , which is obtained for the initial condition . Beginning with another initial condition , the solution ''y''(''t'') tends toward the stationary point, but reaches it only at the limit of infinite time, so the uniqueness of solutions (over all finite times) is guaranteed. However, for an equation in which the stationary solution is reached after a ''finite'' time, the uniqueness fails. This happens for example for the equation , which has at least two solutions corresponding to the initial condition such as: or :y(t)=\begin \left (\tfrac \right )^ & t<0\\ \ \ \ \ 0 & t \ge 0, \end so the previous state of the system is not uniquely determined by its state after ''t'' = 0. The uniqueness theorem does not apply because the function has an infinite slope at and therefore is not Lipschitz continuous, violating the hypothesis of the theorem.


Detailed proof

Let :C_=\overline\times\overline where: :\begin \overline&= _0-a,t_0+a\\ \overline&= _0-b,y_0+b \end This is the compact cylinder where    is defined. Let :M = \sup_\, f\, , this is, the
supremum In mathematics, the infimum (abbreviated inf; plural infima) of a subset S of a partially ordered set P is a greatest element in P that is less than or equal to each element of S, if such an element exists. Consequently, the term ''greatest l ...
of (the
absolute value In mathematics, the absolute value or modulus of a real number x, is the non-negative value without regard to its sign. Namely, , x, =x if is a positive number, and , x, =-x if x is negative (in which case negating x makes -x positive), an ...
s of) the slopes of the function. Finally, let ''L'' be the Lipschitz constant of with respect to the second variable. We will proceed to apply the
Banach fixed-point theorem In mathematics, the Banach fixed-point theorem (also known as the contraction mapping theorem or contractive mapping theorem) is an important tool in the theory of metric spaces; it guarantees the existence and uniqueness of fixed points of certa ...
using the
metric Metric or metrical may refer to: * Metric system, an internationally adopted decimal system of measurement * An adjective indicating relation to measurement in general, or a noun describing a specific type of measurement Mathematics In mathem ...
on \mathcal(I_(t_0),B_b(y_0)) induced by the
uniform norm In mathematical analysis, the uniform norm (or ) assigns to real- or complex-valued bounded functions defined on a set the non-negative number :\, f\, _\infty = \, f\, _ = \sup\left\. This norm is also called the , the , the , or, when th ...
:\, \varphi \, _\infty = \sup_ , \varphi(t), . We define an operator between two function spaces of continuous functions, Picard's operator, as follows: :\Gamma:\mathcal(I_(t_0),B_b(y_0)) \longrightarrow \mathcal(I_(t_0),B_b(y_0)) defined by: :\Gamma \varphi(t) = y_0 + \int_^ f(s,\varphi(s)) \, ds. We must show that this operator maps a complete non-empty
metric space In mathematics, a metric space is a set together with a notion of ''distance'' between its elements, usually called points. The distance is measured by a function called a metric or distance function. Metric spaces are the most general settin ...
''X'' into itself and also is a
contraction mapping In mathematics, a contraction mapping, or contraction or contractor, on a metric space (''M'', ''d'') is a function ''f'' from ''M'' to itself, with the property that there is some real number 0 \leq k < 1 such that for all ''x'' and ...
. We first show that, given certain restrictions on a, \Gamma takes \overline into itself in the space of continuous functions with the uniform norm. Here, \overline is a closed ball in the space of continuous (and bounded) functions "centered" at the constant function y_0. Hence we need to show that :\, \varphi -y_0 \, _\infty \le b implies :\left\, \Gamma\varphi(t)-y_0 \right\, = \left\, \int_^t f(s,\varphi(s))\, ds \right\, \leq \int_^ \left\, f(s,\varphi(s))\right\, ds \leq \int_^ M\, ds = M \left, t'-t_0 \ \leq M a \leq b where t' is some number in _0-a, t_0 +a/math> where the maximum is achieved. The last inequality in the chain is true if we impose the requirement a < \frac. Now let's prove that this operator is a contraction mapping. Given two functions \varphi_1,\varphi_2\in\mathcal(I_(t_0),B_b(y_0)), in order to apply the
Banach fixed-point theorem In mathematics, the Banach fixed-point theorem (also known as the contraction mapping theorem or contractive mapping theorem) is an important tool in the theory of metric spaces; it guarantees the existence and uniqueness of fixed points of certa ...
we require : \left \, \Gamma \varphi_1 - \Gamma \varphi_2 \right\, _\infty \le q \left\, \varphi_1 - \varphi_2 \right\, _\infty, for some 0 \leq q < 1. So let t be such that :\, \Gamma \varphi_1 - \Gamma \varphi_2 \, _\infty = \left\, \left(\Gamma\varphi_1 - \Gamma\varphi_2 \right)(t) \right\, . Then using the definition of \Gamma, :\begin \left\, \left(\Gamma\varphi_1 - \Gamma\varphi_2 \right)(t) \right\, &= \left\, \int_^t \left( f(s,\varphi_1(s))-f(s,\varphi_2(s)) \right)ds \right\, \\ &\leq \int_^t \left\, f \left(s,\varphi_1(s)\right)-f\left(s,\varphi_2(s) \right) \right\, ds \\ &\leq L \int_^t \left\, \varphi_1(s)-\varphi_2(s) \right\, ds && \text f \text \\ &\leq L \int_^t \left\, \varphi_1-\varphi_2 \right\, _\infty \,ds \\ &\leq La \left\, \varphi_1-\varphi_2 \right\, _\infty \end This is a contraction if a < \tfrac. We have established that the Picard's operator is a contraction on the
Banach space In mathematics, more specifically in functional analysis, a Banach space (pronounced ) is a complete normed vector space. Thus, a Banach space is a vector space with a metric that allows the computation of vector length and distance between vector ...
s with the metric induced by the uniform norm. This allows us to apply the Banach fixed-point theorem to conclude that the operator has a unique fixed point. In particular, there is a unique function :\varphi\in \mathcal(I_a (t_0),B_b(y_0)) such that . This function is the unique solution of the initial value problem, valid on the interval ''Ia'' where ''a'' satisfies the condition :a < \min \left \.


Optimization of the solution's interval

Nevertheless, there is a corollary of the Banach fixed-point theorem: if an operator ''T'' ''n'' is a contraction for some ''n'' in N, then ''T'' has a unique fixed point. Before applying this theorem to the Picard operator, recall the following: ''Proof.''
Induction Induction, Inducible or Inductive may refer to: Biology and medicine * Labor induction (birth/pregnancy) * Induction chemotherapy, in medicine * Induced stem cells, stem cells derived from somatic, reproductive, pluripotent or other cell t ...
on ''m''. For the base of the induction () we have already seen this, so suppose the inequality holds for , then we have: \begin \left \, \Gamma^m \varphi_1(t) - \Gamma^m\varphi_2(t) \right \, &= \left \, \Gamma\Gamma^ \varphi_1(t) - \Gamma\Gamma^\varphi_2(t) \right \, \\ &\leq \left, \int_^t \left \, f \left (s,\Gamma^\varphi_1(s) \right )-f \left (s,\Gamma^\varphi_2(s) \right )\right \, ds \ \\ &\leq L \left, \int_^t \left \, \Gamma^\varphi_1(s)-\Gamma^\varphi_2(s)\right \, ds\ \\ &\leq L \left, \int_^t \frac \left \, \varphi_1-\varphi_2\right \, ds\ \\ &\leq \frac \left \, \varphi_1 - \varphi_2 \right \, . \end By taking a supremum over t \in _0 - \alpha, t_0 + \alpha we see that \left \, \Gamma^m \varphi_1 - \Gamma^m\varphi_2 \right \, \leq \frac\left \, \varphi_1-\varphi_2\right \, . This inequality assures that for some large ''m'', \frac<1, and hence Γ''m'' will be a contraction. So by the previous corollary Γ will have a unique fixed point. Finally, we have been able to optimize the interval of the solution by taking . In the end, this result shows the interval of definition of the solution does not depend on the Lipschitz constant of the field, but only on the interval of definition of the field and its maximum absolute value.


Other existence theorems

The Picard–Lindelöf theorem shows that the solution exists and that it is unique. The
Peano existence theorem In mathematics, specifically in the study of ordinary differential equations, the Peano existence theorem, Peano theorem or Cauchy–Peano theorem, named after Giuseppe Peano and Augustin-Louis Cauchy, is a fundamental theorem which guarantees t ...
shows only existence, not uniqueness, but it assumes only that is continuous in , instead of
Lipschitz continuous In mathematical analysis, Lipschitz continuity, named after German mathematician Rudolf Lipschitz, is a strong form of uniform continuity for functions. Intuitively, a Lipschitz continuous function is limited in how fast it can change: there e ...
. For example, the right-hand side of the equation with initial condition is continuous but not Lipschitz continuous. Indeed, rather than being unique, this equation has three solutions: :y(t) = 0, \qquad y(t) = \pm\left (\tfrac23 t\right)^. Even more general is
Carathéodory's existence theorem In mathematics, Carathéodory's existence theorem says that an ordinary differential equation has a solution under relatively mild conditions. It is a generalization of Peano's existence theorem. Peano's theorem requires that the right-hand sid ...
, which proves existence (in a more general sense) under weaker conditions on . Although these conditions are only sufficient, there also exist necessary and sufficient conditions for the solution of an initial value problem to be unique, such as
Okamura Okamura (written: 岡村 lit. "hill village") is a Japanese surname. Notable people with the surname include: * , Japanese voice actor * , Japanese photographer * Allison Okamura, American roboticist * Arthur Okamura, American silk screen artist ...
's theorem.


See also

*
Frobenius theorem (differential topology) In mathematics, Frobenius' theorem gives necessary and sufficient conditions for finding a maximal set of independent solutions of an overdetermined system of first-order homogeneous linear partial differential equations. In modern geometric te ...
*
Integrability conditions for differential systems In mathematics, certain systems of partial differential equations are usefully formulated, from the point of view of their underlying geometric and algebraic structure, in terms of a system of differential forms. The idea is to take advantage of the ...
*
Newton's method In numerical analysis, Newton's method, also known as the Newton–Raphson method, named after Isaac Newton and Joseph Raphson, is a root-finding algorithm which produces successively better approximations to the roots (or zeroes) of a real-valu ...
*
Euler method In mathematics and computational science, the Euler method (also called forward Euler method) is a first-order numerical procedure for solving ordinary differential equations (ODEs) with a given initial value. It is the most basic explicit m ...
*
Trapezoidal rule In calculus, the trapezoidal rule (also known as the trapezoid rule or trapezium rule; see Trapezoid for more information on terminology) is a technique for approximating the definite integral. \int_a^b f(x) \, dx. The trapezoidal rule works b ...


Notes


References

* * (In that article Lindelöf discusses a generalization of an earlier approach by Picard.) *


External links

*
Fixed Points and the Picard Algorithm
recovered from http://www.krellinst.org/UCES/archive/classes/CNA/dir2.6/uces2.6.html. * {{DEFAULTSORT:Picard-Lindelof theorem Augustin-Louis Cauchy Lipschitz maps Ordinary differential equations Theorems in analysis Uniqueness theorems