The
mathematical
Mathematics is an area of knowledge that includes the topics of numbers, formulas and related structures, shapes and the spaces in which they are contained, and quantities and their changes. These topics are represented in modern mathematics ...
term well-posed problem stems from a definition given by 20th-century French mathematician
Jacques Hadamard
Jacques Salomon Hadamard (; 8 December 1865 – 17 October 1963) was a French mathematician who made major contributions in number theory, complex analysis, differential geometry and partial differential equations.
Biography
The son of a tea ...
. He believed that
mathematical model
A mathematical model is a description of a system using mathematical concepts and language. The process of developing a mathematical model is termed mathematical modeling. Mathematical models are used in the natural sciences (such as physics, ...
s of
physical phenomena should have the properties that:
# a
solution exists,
# the solution is
unique,
# the solution's behaviour changes
continuously with the
initial conditions.
Examples of
archetypal
The concept of an archetype (; ) appears in areas relating to behavior, historical psychology, and literary analysis.
An archetype can be any of the following:
# a statement, pattern of behavior, prototype, "first" form, or a main model that o ...
well-posed problems include the
Dirichlet problem for Laplace's equation, and the
heat equation with specified initial conditions. These might be regarded as 'natural' problems in that there are physical processes modelled by these problems.
Problems that are not well-posed in the sense of Hadamard are termed ill-posed.
Inverse problem
An inverse problem in science is the process of calculating from a set of observations the causal factors that produced them: for example, calculating an image in X-ray computed tomography, source reconstruction in acoustics, or calculating th ...
s are often ill-posed. For example, the inverse heat equation, deducing a previous distribution of temperature from final data, is not well-posed in that the solution is highly sensitive to changes in the final data.
Continuum models must often be
discretized
In applied mathematics, discretization is the process of transferring continuous functions, models, variables, and equations into discrete counterparts. This process is usually carried out as a first step toward making them suitable for numerical ...
in order to obtain a numerical solution. While solutions may be continuous with respect to the initial conditions, they may suffer from
numerical instability when solved with finite
precision, or with
error
An error (from the Latin ''error'', meaning "wandering") is an action which is inaccurate or incorrect. In some usages, an error is synonymous with a mistake. The etymology derives from the Latin term 'errare', meaning 'to stray'.
In statistic ...
s in the data. Even if a problem is well-posed, it may still be ill-conditioned, meaning that a small error in the initial data can result in much larger errors in the answers. Problems in nonlinear
complex systems (so-called
chaotic
Chaotic was originally a Danish trading card game. It expanded to an online game in America which then became a television program based on the game. The program was able to be seen on 4Kids TV (Fox affiliates, nationwide), Jetix, The CW4Kids ...
systems) provide well-known examples of instability. An ill-conditioned problem is indicated by a large
condition number
In numerical analysis, the condition number of a function measures how much the output value of the function can change for a small change in the input argument. This is used to measure how sensitive a function is to changes or errors in the inpu ...
.
If the problem is well-posed, then it stands a good chance of solution on a computer using a
stable algorithm. If it is not well-posed, it needs to be re-formulated for numerical treatment. Typically this involves including additional assumptions, such as smoothness of solution. This process is known as ''
regularization''.
Tikhonov regularization
Ridge regression is a method of estimating the coefficients of multiple- regression models in scenarios where the independent variables are highly correlated. It has been used in many fields including econometrics, chemistry, and engineering. Als ...
is one of the most commonly used for regularization of linear ill-posed problems.
Energy method
A method to determine the well-posedness of a problem is the energy method. The method is based upon deriving an energy estimate for a given problem.
Example:
Consider the linear advection equation with homogeneous
Dirichlet boundary conditions and suitable initial data
.
Then carrying out the energy method for this problem, one would multiply the equation by
and integrate in space over the given interval.
Then one would integrate in time and one would obtain the energy estimate
(
p-norm)
From this energy estimate one can conclude that the problem is well-posed.
See also
*
Total absorption spectroscopy – an example of an inverse problem or ill-posed problem in a real-life situation that is solved by means of the
expectation–maximization algorithm
References
*
*
*
{{Authority control
Numerical analysis
Partial differential equations