In
mathematics
Mathematics is a field of study that discovers and organizes methods, Mathematical theory, theories and theorems that are developed and Mathematical proof, proved for the needs of empirical sciences and mathematics itself. There are many ar ...
, an operator is generally a
mapping or
function that acts on elements of a
space
Space is a three-dimensional continuum containing positions and directions. In classical physics, physical space is often conceived in three linear dimensions. Modern physicists usually consider it, with time, to be part of a boundless ...
to produce elements of another space (possibly and sometimes required to be the same space). There is no general definition of an ''operator'', but the term is often used in place of ''function'' when the
domain is a set of functions or other structured objects. Also, the domain of an operator is often difficult to characterize explicitly (for example in the case of an
integral operator), and may be extended so as to act on related objects (an operator that acts on functions may act also on
differential equations whose solutions are functions that satisfy the equation). (see
Operator (physics) for other examples)
The most basic operators are
linear map
In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping V \to W between two vector spaces that p ...
s, which act on
vector space
In mathematics and physics, a vector space (also called a linear space) is a set (mathematics), set whose elements, often called vector (mathematics and physics), ''vectors'', can be added together and multiplied ("scaled") by numbers called sc ...
s. Linear operators refer to linear maps whose domain and range are the same space, for example from
to
.
[
][
]
Such operators often preserve properties, such as
continuity. For example,
differentiation and
indefinite integration are linear operators; operators that are built from them are called
differential operators,
integral operators or integro-differential operators.
Operator is also used for denoting the symbol of a
mathematical operation. This is related with the meaning of "operator" in
computer programming
Computer programming or coding is the composition of sequences of instructions, called computer program, programs, that computers can follow to perform tasks. It involves designing and implementing algorithms, step-by-step specifications of proc ...
(see
Operator (computer programming)
In computer programming, an operator is a programming language construct that provides functionality that may not be possible to define as a user-defined function (i.e. sizeof in C) or has syntax different than a function (i.e. infix addit ...
).
Linear operators
The most common kind of operators encountered are ''linear operators''. Let and be
vector space
In mathematics and physics, a vector space (also called a linear space) is a set (mathematics), set whose elements, often called vector (mathematics and physics), ''vectors'', can be added together and multiplied ("scaled") by numbers called sc ...
s over some
field . A
''mapping'' is
''linear'' if
for all and in , and for all in .
This means that a linear operator preserves vector space operations, in the sense that it does not matter whether you apply the linear operator before or after the operations of addition and scalar multiplication. In more technical words, linear operators are
morphisms between vector spaces.
In the finite-dimensional case linear operators can be represented by
matrices in the following way. Let be a field, and
and be finite-dimensional vector spaces over . Let us select a basis
in and
in . Then let
be an arbitrary vector in
(assuming
Einstein convention), and
be a linear operator. Then
Then
, with all
, is the matrix form of the operator
in the fixed basis
. The tensor
does not depend on the choice of
, and
if
. Thus in fixed bases -by- matrices are in
bijective correspondence to linear operators from
to
.
The important concepts directly related to operators between finite-dimensional vector spaces are the ones of
rank,
determinant
In mathematics, the determinant is a Scalar (mathematics), scalar-valued function (mathematics), function of the entries of a square matrix. The determinant of a matrix is commonly denoted , , or . Its value characterizes some properties of the ...
,
inverse operator, and
eigenspace.
Linear operators also play a great role in the infinite-dimensional case. The concepts of rank and determinant cannot be extended to infinite-dimensional matrices. This is why very different techniques are employed when studying linear operators (and operators in general) in the infinite-dimensional case. The study of linear operators in the infinite-dimensional case is known as
functional analysis
Functional analysis is a branch of mathematical analysis, the core of which is formed by the study of vector spaces endowed with some kind of limit-related structure (for example, Inner product space#Definition, inner product, Norm (mathematics ...
(so called because various classes of functions form interesting examples of infinite-dimensional vector spaces).
The space of
sequence
In mathematics, a sequence is an enumerated collection of objects in which repetitions are allowed and order matters. Like a set, it contains members (also called ''elements'', or ''terms''). The number of elements (possibly infinite) is cal ...
s of real numbers, or more generally sequences of vectors in any vector space, themselves form an infinite-dimensional vector space. The most important cases are sequences of real or complex numbers, and these spaces, together with linear subspaces, are known as
sequence spaces. Operators on these spaces are known as
sequence transformations.
Bounded linear operators over a
Banach space
In mathematics, more specifically in functional analysis, a Banach space (, ) is a complete normed vector space. Thus, a Banach space is a vector space with a metric that allows the computation of vector length and distance between vectors and ...
form a
Banach algebra in respect to the standard operator norm. The theory of Banach algebras develops a very general concept of
spectra that elegantly generalizes the theory of eigenspaces.
Bounded operators
Let and be two vector spaces over the same
ordered field (for example;
), and they are equipped with
norms. Then a linear operator from to is called bounded if there exists such that
for every in .
Bounded operators form a vector space. On this vector space we can introduce a norm that is compatible with the norms of and :
In case of operators from to itself it can be shown that
:
.
Any unital
normed algebra with this property is called a
Banach algebra. It is possible to generalize
spectral theory to such algebras.
C*-algebras, which are
Banach algebras with some additional structure, play an important role in
quantum mechanics
Quantum mechanics is the fundamental physical Scientific theory, theory that describes the behavior of matter and of light; its unusual characteristics typically occur at and below the scale of atoms. Reprinted, Addison-Wesley, 1989, It is ...
.
Examples
Analysis (calculus)
From the point of view of
functional analysis
Functional analysis is a branch of mathematical analysis, the core of which is formed by the study of vector spaces endowed with some kind of limit-related structure (for example, Inner product space#Definition, inner product, Norm (mathematics ...
,
calculus
Calculus is the mathematics, mathematical study of continuous change, in the same way that geometry is the study of shape, and algebra is the study of generalizations of arithmetic operations.
Originally called infinitesimal calculus or "the ...
is the study of two linear operators: the
differential operator , and the ''
Volterra operator''
.
Fundamental analysis operators on scalar and vector fields
Three operators are key to
vector calculus:
* Grad (
gradient), (with operator symbol
) assigns a vector at every point in a scalar field that points in the direction of greatest rate of change of that field and whose norm measures the absolute value of that greatest rate of change.
* Div (
divergence
In vector calculus, divergence is a vector operator that operates on a vector field, producing a scalar field giving the rate that the vector field alters the volume in an infinitesimal neighborhood of each point. (In 2D this "volume" refers to ...
), (with operator symbol
) is a vector operator that measures a vector field's divergence from or convergence towards a given point.
*
Curl, (with operator symbol
) is a vector operator that measures a vector field's curling (winding around, rotating around) trend about a given point.
As an extension of vector calculus operators to physics, engineering and tensor spaces, grad, div and curl operators also are often associated with
tensor calculus as well as vector calculus.
Geometry
In
geometry
Geometry (; ) is a branch of mathematics concerned with properties of space such as the distance, shape, size, and relative position of figures. Geometry is, along with arithmetic, one of the oldest branches of mathematics. A mathematician w ...
, additional structures on
vector space
In mathematics and physics, a vector space (also called a linear space) is a set (mathematics), set whose elements, often called vector (mathematics and physics), ''vectors'', can be added together and multiplied ("scaled") by numbers called sc ...
s are sometimes studied. Operators that map such vector spaces to themselves
bijectively are very useful in these studies, they naturally form
groups by composition.
For example, bijective operators preserving the structure of a vector space are precisely the
invertible linear operators. They form the
general linear group
In mathematics, the general linear group of degree n is the set of n\times n invertible matrices, together with the operation of ordinary matrix multiplication. This forms a group, because the product of two invertible matrices is again inve ...
under composition. However, they ''do not'' form a vector space under operator addition; since, for example, both the identity and −identity are
invertible (bijective), but their sum, 0, is not.
Operators preserving the
Euclidean metric on such a space form the
isometry group, and those that fix the origin form a subgroup known as the
orthogonal group. Operators in the orthogonal group that also preserve the orientation of vector tuples form the
special orthogonal group, or the group of rotations.
Probability theory
Operators are also involved in probability theory, such as
expectation,
variance
In probability theory and statistics, variance is the expected value of the squared deviation from the mean of a random variable. The standard deviation (SD) is obtained as the square root of the variance. Variance is a measure of dispersion ...
, and
covariance, which are used to name both number statistics and the operators which produce them. Indeed, every covariance is basically a
dot product
In mathematics, the dot product or scalar productThe term ''scalar product'' means literally "product with a Scalar (mathematics), scalar as a result". It is also used for other symmetric bilinear forms, for example in a pseudo-Euclidean space. N ...
: Every variance is a dot product of a vector with itself, and thus is a
quadratic norm; every standard deviation is a norm (square root of the quadratic norm); the corresponding cosine to this dot product is the
Pearson correlation coefficient; expected value is basically an integral operator (used to measure weighted shapes in the space).
Fourier series and Fourier transform
The Fourier transform is useful in applied mathematics, particularly physics and signal processing. It is another integral operator; it is useful mainly because it converts a function on one (temporal) domain to a function on another (frequency) domain, in a way effectively
invertible. No information is lost, as there is an inverse transform operator. In the simple case of
periodic function
A periodic function, also called a periodic waveform (or simply periodic wave), is a function that repeats its values at regular intervals or periods. The repeatable part of the function or waveform is called a ''cycle''. For example, the t ...
s, this result is based on the theorem that any continuous periodic function can be represented as the sum of a series of
sine waves and cosine waves:
The tuple is in fact an element of an infinite-dimensional vector space
, and thus Fourier series is a linear operator.
When dealing with general function
, the transform takes on an
integral
In mathematics, an integral is the continuous analog of a Summation, sum, which is used to calculate area, areas, volume, volumes, and their generalizations. Integration, the process of computing an integral, is one of the two fundamental oper ...
form:
:
Laplace transform
The ''Laplace transform'' is another integral operator and is involved in simplifying the process of solving differential equations.
Given , it is defined by:
Footnotes
See also
*
Function
*
Operator algebra
*
List of operators
References
{{reflist, 25em
Algebra
Functional analysis
Mathematical notation