In
probability theory
Probability theory or probability calculus is the branch of mathematics concerned with probability. Although there are several different probability interpretations, probability theory treats the concept in a rigorous mathematical manner by expre ...
and
statistics
Statistics (from German language, German: ', "description of a State (polity), state, a country") is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a s ...
, diffusion processes are a class of continuous-time
Markov process
In probability theory and statistics, a Markov chain or Markov process is a stochastic process describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. Informally, ...
with
almost surely
In probability theory, an event is said to happen almost surely (sometimes abbreviated as a.s.) if it happens with probability 1 (with respect to the probability measure). In other words, the set of outcomes on which the event does not occur ha ...
continuous sample paths. Diffusion process is
stochastic Stochastic (; ) is the property of being well-described by a random probability distribution. ''Stochasticity'' and ''randomness'' are technically distinct concepts: the former refers to a modeling approach, while the latter describes phenomena; i ...
in nature and hence is used to model many real-life stochastic systems.
Brownian motion
Brownian motion is the random motion of particles suspended in a medium (a liquid or a gas). The traditional mathematical formulation of Brownian motion is that of the Wiener process, which is often called Brownian motion, even in mathematical ...
,
reflected Brownian motion and
Ornstein–Uhlenbeck processes are examples of diffusion processes. It is used heavily in
statistical physics
In physics, statistical mechanics is a mathematical framework that applies statistical methods and probability theory to large assemblies of microscopic entities. Sometimes called statistical physics or statistical thermodynamics, its applicati ...
,
statistical analysis
Statistical inference is the process of using data analysis to infer properties of an underlying probability distribution.Upton, G., Cook, I. (2008) ''Oxford Dictionary of Statistics'', OUP. . Inferential statistical analysis infers properties of ...
,
information theory
Information theory is the mathematical study of the quantification (science), quantification, Data storage, storage, and telecommunications, communication of information. The field was established and formalized by Claude Shannon in the 1940s, ...
,
data science
Data science is an interdisciplinary academic field that uses statistics, scientific computing, scientific methods, processing, scientific visualization, algorithms and systems to extract or extrapolate knowledge from potentially noisy, stru ...
,
neural networks
A neural network is a group of interconnected units called neurons that send signals to one another. Neurons can be either Cell (biology), biological cells or signal pathways. While individual neurons are simple, many of them together in a netwo ...
,
finance
Finance refers to monetary resources and to the study and Academic discipline, discipline of money, currency, assets and Liability (financial accounting), liabilities. As a subject of study, is a field of Business administration, Business Admin ...
and
marketing
Marketing is the act of acquiring, satisfying and retaining customers. It is one of the primary components of Business administration, business management and commerce.
Marketing is usually conducted by the seller, typically a retailer or ma ...
.
A sample path of a diffusion process models the trajectory of a particle embedded in a flowing fluid and subjected to random displacements due to collisions with other particles, which is called
Brownian motion
Brownian motion is the random motion of particles suspended in a medium (a liquid or a gas). The traditional mathematical formulation of Brownian motion is that of the Wiener process, which is often called Brownian motion, even in mathematical ...
. The position of the particle is then random; its
probability density function
In probability theory, a probability density function (PDF), density function, or density of an absolutely continuous random variable, is a Function (mathematics), function whose value at any given sample (or point) in the sample space (the s ...
as a
function of space and time Functions of space and time
Time is the continuous progression of existence that occurs in an apparently irreversible process, irreversible succession from the past, through the present, and into the future. It is a component quantity of vari ...
is governed by a
convection–diffusion equation.
Mathematical definition
A ''diffusion process'' is a
Markov process
In probability theory and statistics, a Markov chain or Markov process is a stochastic process describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. Informally, ...
with
continuous sample paths for which the
Kolmogorov forward equation is the
Fokker–Planck equation
In statistical mechanics and information theory, the Fokker–Planck equation is a partial differential equation that describes the time evolution of the probability density function of the velocity of a particle under the influence of drag (physi ...
.
A diffusion process is defined by the following properties.
Let
be uniformly continuous coefficients and
be bounded, Borel measurable drift terms. There is a unique family of probability measures
(for
,
) on the canonical space
, with its Borel
-algebra, such that:
1. (Initial Condition) The process starts at
at time
:
2. (Local Martingale Property) For every
, the process
is a local martingale under
for
, with
for
.
This family
is called the
-diffusion.
SDE Construction and Infinitesimal Generator
It is clear that if we have an
-diffusion, i.e.
on
, then
satisfies the SDE
. In contrast, one can construct this diffusion from that SDE if
and
,
are Lipschitz continuous.
To see this, let
solve the SDE starting at
. For
, apply Itô's formula:
Rearranging gives
whose right‐hand side is a local martingale, matching the local‐martingale property in the diffusion definition. The law of
defines
on
with the correct initial condition and local martingale property. Uniqueness follows from the Lipschitz continuity of
. In fact,
coincides with the infinitesimal generator
of this process. If
solves the SDE, then for
, the generator
is
See also
* Stochastic differential equation
* Itô calculus
*
Fokker–Planck equation
In statistical mechanics and information theory, the Fokker–Planck equation is a partial differential equation that describes the time evolution of the probability density function of the velocity of a particle under the influence of drag (physi ...
*
Markov process
In probability theory and statistics, a Markov chain or Markov process is a stochastic process describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. Informally, ...
*
Diffusion
Diffusion is the net movement of anything (for example, atoms, ions, molecules, energy) generally from a region of higher concentration to a region of lower concentration. Diffusion is driven by a gradient in Gibbs free energy or chemical p ...
*
Itô diffusion
*
Jump diffusion
Jump diffusion is a stochastic process that involves jump process, jumps and diffusion process, diffusion. It has important applications in magnetic reconnection, coronal mass ejections, condensed matter physics, and pattern theory and computationa ...
*
Sample-continuous process
References
Markov processes
{{probability-stub