applied mathematics
Applied mathematics is the application of mathematical methods by different fields such as physics, engineering, medicine, biology, finance, business, computer science, and industry. Thus, applied mathematics is a combination of mathemat ...
, discretization is the process of transferring continuous functions, models, variables, and equations into
discrete
Discrete may refer to:
*Discrete particle or quantum in physics, for example in quantum theory
*Discrete device, an electronic component with just one circuit element, either passive or active, other than an integrated circuit
*Discrete group, a ...
counterparts. This process is usually carried out as a first step toward making them suitable for numerical evaluation and implementation on digital computers. Dichotomization is the special case of discretization in which the number of discrete classes is 2, which can approximate a continuous variable as a
binary variable
Binary data is data whose unit can take on only two possible states. These are often labelled as 0 and 1 in accordance with the binary numeral system and Boolean algebra.
Binary data occurs in many different technical and scientific fields, wher ...
binary classification
Binary classification is the task of classifying the elements of a set into two groups (each called ''class'') on the basis of a classification rule. Typical binary classification problems include:
* Medical testing to determine if a patient ha ...
).
Discretization is also related to
discrete mathematics
Discrete mathematics is the study of mathematical structures that can be considered "discrete" (in a way analogous to discrete variables, having a bijection with the set of natural numbers) rather than "continuous" (analogously to continu ...
, and is an important component of granular computing. In this context, ''discretization'' may also refer to modification of variable or category ''granularity'', as when multiple discrete variables are aggregated or multiple discrete categories fused.
Whenever continuous data is discretized, there is always some amount of discretization error. The goal is to reduce the amount to a level considered
negligible
{{Short pages monitor (Specifically, the two terms share a
semantic field
In linguistics, a semantic field is a lexical set of words grouped semantically (by meaning) that refers to a specific subject.Howard Jackson, Etienne Zé Amvela, ''Words, Meaning, and Vocabulary'', Continuum, 2000, p14. The term is also used in ...
quantization error
Quantization, in mathematics and digital signal processing, is the process of mapping input values from a large set (often a continuous set) to output values in a (countable) smaller set, often with a finite number of elements. Rounding and ...
Discretization is also concerned with the transformation of continuous
differential equation
In mathematics, a differential equation is an equation that relates one or more unknown functions and their derivatives. In applications, the functions generally represent physical quantities, the derivatives represent their rates of change, a ...
s into discrete
difference equations
In mathematics, a recurrence relation is an equation according to which the nth term of a sequence of numbers is equal to some combination of the previous terms. Often, only k previous terms of the sequence appear in the equation, for a parameter ...
white noise
In signal processing, white noise is a random signal having equal intensity at different frequencies, giving it a constant power spectral density. The term is used, with this or similar meanings, in many scientific and technical disciplines, ...
sources with power spectral densities
:
:
can be discretized, assuming zero-order hold for the input ''u'' and continuous integration for the noise ''v'', to
:''d'' and ''B''''d'' in one step is by utilizing the following property:
:e^ = \begin \mathbf & \mathbf \\
\mathbf & \mathbf \end
Where \mathbf A_dand \mathbf B_dare the discretized state-space matrices.
Discretization of process noise
Numerical evaluation of \mathbf_d is a bit trickier due to the matrix exponential integral. It can, however, be computed by first constructing a matrix, and computing the exponential of itCharles Van Loan: ''Computing integrals involving the matrix exponential'', IEEE Transactions on Automatic Control. 23 (3): 395–404, 1978
: \mathbf =
\begin -\mathbf & \mathbf \\
\mathbf & \mathbf^\top \end T
: \mathbf = e^\mathbf =
\begin \dots & \mathbf_d^\mathbf_d \\
\mathbf & \mathbf_d^\top \end.
The discretized process noise is then evaluated by multiplying the transpose of the lower-right partition of G with the upper-right partition of G:
:\mathbf_d = (\mathbf_d^\top)^\top (\mathbf_d^\mathbf_d) = \mathbf_d (\mathbf_d^\mathbf_d).
Derivation
Starting with the continuous model
:\mathbf(t) = \mathbf A\mathbf x(t) + \mathbf B \mathbf u(t)
we know that the
matrix exponential
In mathematics, the matrix exponential is a matrix function on square matrices analogous to the ordinary exponential function. It is used to solve systems of linear differential equations. In the theory of Lie groups, the matrix exponential giv ...
is
:\frace^ = \mathbf A e^ = e^ \mathbf A
and by premultiplying the model we get
:e^ \mathbf(t) = e^ \mathbf A\mathbf x(t) + e^ \mathbf B\mathbf u(t)
which we recognize as
:\frac(e^\mathbf x(t)) = e^ \mathbf B\mathbf u(t)
and by integrating..
:e^\mathbf x(t) - e^0\mathbf x(0) = \int_0^t e^\mathbf B\mathbf u(\tau) d\tau
:\mathbf x(t) = e^\mathbf x(0) + \int_0^t e^ \mathbf B\mathbf u(\tau) d \tau
which is an analytical solution to the continuous model.
Now we want to discretise the above expression. We assume that u is constant during each timestep.
:\mathbf x \ \stackrel\ \mathbf x(kT)
:\mathbf x = e^\mathbf x(0) + \int_0^ e^ \mathbf B\mathbf u(\tau) d \tau
:\mathbf x +1= e^\mathbf x(0) + \int_0^ e^ \mathbf B\mathbf u(\tau) d \tau
:\mathbf x +1= e^ \left e^\mathbf x(0) + \int_0^ e^ \mathbf B\mathbf u(\tau) d \tau \right \int_^ e^ \mathbf B\mathbf u(\tau) d \tau
We recognize the bracketed expression as \mathbf x /math>, and the second term can be simplified by substituting with the function v(\tau) = kT + T - \tau. Note that d\tau=-dv. We also assume that \mathbf u is constant during the
integral
In mathematics, an integral assigns numbers to functions in a way that describes displacement, area, volume, and other concepts that arise by combining infinitesimal data. The process of finding integrals is called integration. Along with ...
, which in turn yields
: \begin \mathbf x +1=& e^\mathbf x - \left( \int_^ e^ dv \right) \mathbf B\mathbf u \\
&=& e^\mathbf x - \left( \int_T^0 e^ dv \right) \mathbf B\mathbf u \\
&=& e^\mathbf x + \left( \int_0^T e^ dv \right) \mathbf B\mathbf u \\
&=&e^\mathbf x + \mathbf A^\left(e^-\mathbf I \right) \mathbf B\mathbf u \end
which is an exact solution to the discretization problem.
When \mathbf is singular, the latter expression can still be used by replacing e^ by its
Taylor expansion
In mathematics, the Taylor series or Taylor expansion of a function is an infinite sum of terms that are expressed in terms of the function's derivatives at a single point. For most common functions, the function and the sum of its Taylor se ...
,
: e^ = \sum_^ \frac (T)^k .
This yields
: \begin \mathbf x +1=& e^\mathbf x + \left( \int_0^T e^ dv \right) \mathbf B\mathbf u \\
&=&\left(\sum_^ \frac (T)^k\right) \mathbf x + \left(\sum_^ \frac ^ T^k\right) \mathbf B\mathbf u \end
which is the form used in practice.
Approximations
Exact discretization may sometimes be intractable due to the heavy matrix exponential and integral operations involved. It is much easier to calculate an approximate discrete model, based on that for small timesteps e^ \approx \mathbf I + \mathbf A T. The approximate solution then becomes:
:\mathbf x +1\approx (\mathbf I + \mathbf AT) \mathbf x + T\mathbf B \mathbf u
This is also known as the Euler method, which is also known as the forward Euler method. Other possible approximations are e^ \approx \left( \mathbf I - \mathbf A T \right)^, otherwise known as the backward Euler method and e^ \approx \left( \mathbf I +\frac \mathbf A T \right) \left( \mathbf I - \frac \mathbf A T \right)^, which is known as the
bilinear transform
The bilinear transform (also known as Tustin's method, after Arnold Tustin) is used in digital signal processing and discrete-time control theory to transform continuous-time system representations to discrete-time and vice versa.
The bilinear t ...
, or Tustin transform. Each of these approximations has different stability properties. The bilinear transform preserves the instability of the continuous-time system.
Discretization of continuous features
In statistics and machine learning, discretization refers to the process of converting continuous features or variables to discretized or nominal features. This can be useful when creating probability mass functions.
Discretization of smooth functions
In
generalized function
In mathematics, generalized functions are objects extending the notion of functions. There is more than one recognized theory, for example the theory of distributions. Generalized functions are especially useful in making discontinuous functio ...
s theory, discretization
arises as a particular case of the Convolution Theorem
on tempered distributions
: \mathcal\ = \mathcal\ \cdot \operatorname
: \mathcal\= \mathcal\*\operatorname
where \operatorname is the Dirac comb,
\cdot \operatorname is discretization, * \operatorname is
periodization
In historiography, periodization is the process or study of categorizing the past into discrete, quantified, and named blocks of time for the purpose of study or analysis.Adam Rabinowitz. It's about time: historical periodization and Linked Ancie ...
band-limited
Bandlimiting is the limiting of a signal's frequency domain representation or spectral density to zero above a certain finite frequency.
A band-limited signal is one whose Fourier transform or spectral density has bounded support (mathematics) ...
function)
and \mathcal is the (unitary, ordinary frequency)
Fourier transform
A Fourier transform (FT) is a mathematical transform that decomposes functions into frequency components, which are represented by the output of the transform as a function of frequency. Most commonly functions of time or space are transformed, ...
.
Functions \alpha which are not smooth can be made smooth using a mollifier prior to discretization.
As an example, discretization of the function that is constantly 1 yields the
sequence
In mathematics, a sequence is an enumerated collection of objects in which repetitions are allowed and order matters. Like a set, it contains members (also called ''elements'', or ''terms''). The number of elements (possibly infinite) is called ...
Discrete event simulation
A discrete-event simulation (DES) models the operation of a system as a ( discrete) sequence of events in time. Each event occurs at a particular instant in time and marks a change of state in the system. Between consecutive events, no change in ...
*
Discrete space
In topology, a discrete space is a particularly simple example of a topological space or similar structure, one in which the points form a , meaning they are ''isolated'' from each other in a certain sense. The discrete topology is the finest top ...