In
mathematics
Mathematics is an area of knowledge that includes the topics of numbers, formulas and related structures, shapes and the spaces in which they are contained, and quantities and their changes. These topics are represented in modern mathematics ...
, an operator is generally a
mapping or
function
Function or functionality may refer to:
Computing
* Function key, a type of key on computer keyboards
* Function model, a structured representation of processes in a system
* Function object or functor or functionoid, a concept of object-oriente ...
that acts on elements of a
space
Space is the boundless three-dimensional extent in which objects and events have relative position and direction. In classical physics, physical space is often conceived in three linear dimensions, although modern physicists usually consider ...
to produce elements of another space (possibly and sometimes required to be the same space). There is no general definition of an ''operator'', but the term is often used in place of ''function'' when the
domain
Domain may refer to:
Mathematics
*Domain of a function, the set of input values for which the (total) function is defined
**Domain of definition of a partial function
**Natural domain of a partial function
**Domain of holomorphy of a function
* Do ...
is a set of functions or other structured objects. Also, the domain of an operator is often difficult to be explicitly characterized (for example in the case of an
integral operator
An integral operator is an operator that involves integration. Special instances are:
* The operator of integration itself, denoted by the integral symbol
* Integral linear operators, which are linear operators induced by bilinear forms invol ...
), and may be extended to related objects (an operator that acts on functions may act also on
differential equation
In mathematics, a differential equation is an equation that relates one or more unknown functions and their derivatives. In applications, the functions generally represent physical quantities, the derivatives represent their rates of change, an ...
s whose solutions are functions that satisfy the equation). See
Operator (physics)
In physics, an operator is a function over a space of physical states onto another space of physical states. The simplest example of the utility of operators is the study of symmetry (which makes the concept of a group useful in this context). Bec ...
for other examples.
The most basic operators are
linear map
In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a Map (mathematics), mapping V \to W between two vect ...
s, which act on
vector space
In mathematics and physics, a vector space (also called a linear space) is a set whose elements, often called ''vectors'', may be added together and multiplied ("scaled") by numbers called '' scalars''. Scalars are often real numbers, but can ...
s. Linear operators refer to linear maps whose domain and range are the same space, for example
to
.
[
]
Such operators often preserve properties, such as
continuity. For example,
differentiation and
indefinite integration
In calculus, an antiderivative, inverse derivative, primitive function, primitive integral or indefinite integral of a function is a differentiable function whose derivative is equal to the original function . This can be stated symbolically ...
are linear operators; operators that are built from them are called
differential operator
In mathematics, a differential operator is an operator defined as a function of the differentiation operator. It is helpful, as a matter of notation first, to consider differentiation as an abstract operation that accepts a function and return ...
s,
integral operator
An integral operator is an operator that involves integration. Special instances are:
* The operator of integration itself, denoted by the integral symbol
* Integral linear operators, which are linear operators induced by bilinear forms invol ...
s or
integro-differential operators.
Operator is also used for denoting the symbol of a
mathematical operation
In mathematics, an operation is a Function (mathematics), function which takes zero or more input values (also called "''operands''" or "arguments") to a well-defined output value. The number of operands is the arity of the operation.
The most c ...
. This is related with the meaning of "operator" in
computer programming
Computer programming is the process of performing a particular computation (or more generally, accomplishing a specific computing result), usually by designing and building an executable computer program. Programming involves tasks such as ana ...
, see
operator (computer programming)
In computer programming, operators are constructs defined within programming languages which behave generally like functions, but which differ syntactically or semantically.
Common simple examples include arithmetic (e.g. addition with ), c ...
.
Linear operators
The most common kind of operator encountered are ''linear operators''. Let ''U'' and ''V'' be vector spaces over a
field
Field may refer to:
Expanses of open ground
* Field (agriculture), an area of land used for agricultural purposes
* Airfield, an aerodrome that lacks the infrastructure of an airport
* Battlefield
* Lawn, an area of mowed grass
* Meadow, a grass ...
''K''. A
mapping ''A'': ''U'' → ''V'' is linear if
for all x, y in ''U'' and for all ''α'', ''β'' in ''K''.
This means that a linear operator preserves vector space operations, in the sense that it does not matter whether you apply the linear operator before or after the operations of addition and scalar multiplication. In more technical words, linear operators are
morphism
In mathematics, particularly in category theory, a morphism is a structure-preserving map from one mathematical structure to another one of the same type. The notion of morphism recurs in much of contemporary mathematics. In set theory, morphisms a ...
s between vector spaces.
In the finite-dimensional case linear operators can be represented by
matrices
Matrix most commonly refers to:
* ''The Matrix'' (franchise), an American media franchise
** ''The Matrix'', a 1999 science-fiction action film
** "The Matrix", a fictional setting, a virtual reality environment, within ''The Matrix'' (franchis ...
in the following way. Let
be a field, and
and
be finite-dimensional vector spaces over
. Let us select a basis
in
and
in
. Then let
be an arbitrary vector in
(assuming
Einstein convention
In mathematics, especially the usage of linear algebra in Mathematical physics, Einstein notation (also known as the Einstein summation convention or Einstein summation notation) is a notational convention that implies summation over a set of ...
), and
be a linear operator. Then
Then
is the matrix of the operator
in fixed bases.
does not depend on the choice of
, and
if
. Thus in fixed bases n-by-m matrices are in bijective correspondence to linear operators from
to
.
The important concepts directly related to operators between finite-dimensional vector spaces are the ones of
rank
Rank is the relative position, value, worth, complexity, power, importance, authority, level, etc. of a person or object within a ranking, such as:
Level or position in a hierarchical organization
* Academic rank
* Diplomatic rank
* Hierarchy
* H ...
,
determinant
In mathematics, the determinant is a scalar value that is a function of the entries of a square matrix. It characterizes some properties of the matrix and the linear map represented by the matrix. In particular, the determinant is nonzero if and ...
,
inverse operator
In mathematics, the inverse function of a function (also called the inverse of ) is a function that undoes the operation of . The inverse of exists if and only if is bijective, and if it exists, is denoted by f^ .
For a function f\colon X ...
, and
eigenspace
In linear algebra, an eigenvector () or characteristic vector of a linear transformation is a nonzero vector that changes at most by a scalar factor when that linear transformation is applied to it. The corresponding eigenvalue, often denoted b ...
.
Linear operators also play a great role in the infinite-dimensional case. The concepts of rank and determinant cannot be extended to infinite-dimensional matrices. This is why very different techniques are employed when studying linear operators (and operators in general) in the infinite-dimensional case. The study of linear operators in the infinite-dimensional case is known as
functional analysis
Functional analysis is a branch of mathematical analysis, the core of which is formed by the study of vector spaces endowed with some kind of limit-related structure (e.g. Inner product space#Definition, inner product, Norm (mathematics)#Defini ...
(so called because various classes of functions form interesting examples of infinite-dimensional vector spaces).
The space of
sequence
In mathematics, a sequence is an enumerated collection of objects in which repetitions are allowed and order matters. Like a set, it contains members (also called ''elements'', or ''terms''). The number of elements (possibly infinite) is calle ...
s of real numbers, or more generally sequences of vectors in any vector space, themselves form an infinite-dimensional vector space. The most important cases are sequences of real or complex numbers, and these spaces, together with linear subspaces, are known as
sequence space
In functional analysis and related areas of mathematics, a sequence space is a vector space whose elements are infinite sequences of real or complex numbers. Equivalently, it is a function space whose elements are functions from the natural num ...
s. Operators on these spaces are known as
sequence transformation
In mathematics, a sequence transformation is an operator acting on a given space of sequences (a sequence space). Sequence transformations include linear mappings such as convolution with another sequence, and resummation of a sequence and, more ...
s.
Bounded linear operators over
Banach space
In mathematics, more specifically in functional analysis, a Banach space (pronounced ) is a complete normed vector space. Thus, a Banach space is a vector space with a metric that allows the computation of vector length and distance between vector ...
form a
Banach algebra
In mathematics, especially functional analysis, a Banach algebra, named after Stefan Banach, is an associative algebra A over the real or complex numbers (or over a non-Archimedean complete normed field) that at the same time is also a Banach spa ...
in respect to the standard operator norm. The theory of Banach algebras develops a very general concept of
spectra that elegantly generalizes the theory of eigenspaces.
Bounded operators
Let ''U'' and ''V'' be two vector spaces over the same
ordered field
In mathematics, an ordered field is a field together with a total ordering of its elements that is compatible with the field operations. The basic example of an ordered field is the field of real numbers, and every Dedekind-complete ordered field ...
(for example,
), and they are equipped with
norm
Naturally occurring radioactive materials (NORM) and technologically enhanced naturally occurring radioactive materials (TENORM) consist of materials, usually industrial wastes or by-products enriched with radioactive elements found in the envir ...
s. Then a linear operator from ''U'' to ''V'' is called bounded if there exists ''C'' > 0 such that
for all x in ''U''.
Bounded operators form a vector space. On this vector space we can introduce a norm that is compatible with the norms of ''U'' and ''V'':
In case of operators from ''U'' to itself it can be shown that
Any unital
normed algebra In mathematics, a normed algebra ''A'' is an algebra over a field which has a sub-multiplicative norm:
: \forall x,y\in A\qquad \, xy\, \le\, x\, \, y\, .
Some authors require it to have a multiplicative identity 1 such that ║1║ = 1.
See als ...
with this property is called a
Banach algebra
In mathematics, especially functional analysis, a Banach algebra, named after Stefan Banach, is an associative algebra A over the real or complex numbers (or over a non-Archimedean complete normed field) that at the same time is also a Banach spa ...
. It is possible to generalize
spectral theory In mathematics, spectral theory is an inclusive term for theories extending the eigenvector and eigenvalue theory of a single square matrix to a much broader theory of the structure of operators in a variety of mathematical spaces. It is a result ...
to such algebras.
C*-algebra
In mathematics, specifically in functional analysis, a C∗-algebra (pronounced "C-star") is a Banach algebra together with an involution satisfying the properties of the adjoint. A particular case is that of a complex algebra ''A'' of continuous ...
s, which are
Banach algebras
In mathematics, especially functional analysis, a Banach algebra, named after Stefan Banach, is an associative algebra A over the real or complex numbers (or over a non-Archimedean complete normed field) that at the same time is also a Banach ...
with some additional structure, play an important role in
quantum mechanics
Quantum mechanics is a fundamental theory in physics that provides a description of the physical properties of nature at the scale of atoms and subatomic particles. It is the foundation of all quantum physics including quantum chemistry, ...
.
Examples
Geometry
In
geometry
Geometry (; ) is, with arithmetic, one of the oldest branches of mathematics. It is concerned with properties of space such as the distance, shape, size, and relative position of figures. A mathematician who works in the field of geometry is c ...
, additional structures on
vector space
In mathematics and physics, a vector space (also called a linear space) is a set whose elements, often called ''vectors'', may be added together and multiplied ("scaled") by numbers called '' scalars''. Scalars are often real numbers, but can ...
s are sometimes studied. Operators that map such vector spaces to themselves bijectively are very useful in these studies, they naturally form
group
A group is a number of persons or things that are located, gathered, or classed together.
Groups of people
* Cultural group, a group whose members share the same cultural identity
* Ethnic group, a group whose members share the same ethnic ide ...
s by composition.
For example, bijective operators preserving the structure of a vector space are precisely the
invertible
In mathematics, the concept of an inverse element generalises the concepts of opposite () and reciprocal () of numbers.
Given an operation denoted here , and an identity element denoted , if , one says that is a left inverse of , and that is ...
linear operator
In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping V \to W between two vector spaces that pre ...
s. They form the
general linear group
In mathematics, the general linear group of degree ''n'' is the set of invertible matrices, together with the operation of ordinary matrix multiplication. This forms a group, because the product of two invertible matrices is again invertible, ...
under composition. They ''do not'' form a vector space under the addition of operators, e.g. both id and −id are invertible (bijective), but their sum, 0, is not.
Operators preserving the Euclidean metric on such a space form the
isometry group In mathematics, the isometry group of a metric space is the set of all bijective isometries (i.e. bijective, distance-preserving maps) from the metric space onto itself, with the function composition as group operation. Its identity element is the ...
, and those that fix the origin form a subgroup known as the
orthogonal group
In mathematics, the orthogonal group in dimension , denoted , is the Group (mathematics), group of isometry, distance-preserving transformations of a Euclidean space of dimension that preserve a fixed point, where the group operation is given by ...
. Operators in the orthogonal group that also preserve the orientation of vector tuples form the
special orthogonal group
In mathematics, the orthogonal group in dimension , denoted , is the group of distance-preserving transformations of a Euclidean space of dimension that preserve a fixed point, where the group operation is given by composing transformations. T ...
, or the group of rotations.
Probability theory
Operators are also involved in probability theory, such as
expectation,
variance
In probability theory and statistics, variance is the expectation of the squared deviation of a random variable from its population mean or sample mean. Variance is a measure of dispersion, meaning it is a measure of how far a set of numbers ...
, and
covariance
In probability theory and statistics, covariance is a measure of the joint variability of two random variables. If the greater values of one variable mainly correspond with the greater values of the other variable, and the same holds for the les ...
. Indeed, every covariance is basically a dot product; every variance is a dot product of a vector with itself, and thus is a quadratic norm; every standard deviation is a norm (square root of the quadratic norm); the corresponding cosine to this dot product is the
Pearson correlation coefficient
In statistics, the Pearson correlation coefficient (PCC, pronounced ) ― also known as Pearson's ''r'', the Pearson product-moment correlation coefficient (PPMCC), the bivariate correlation, or colloquially simply as the correlation coefficient ...
; expected value is basically an integral operator (used to measure weighted shapes in the space).
Calculus
From the point of view of
functional analysis
Functional analysis is a branch of mathematical analysis, the core of which is formed by the study of vector spaces endowed with some kind of limit-related structure (e.g. Inner product space#Definition, inner product, Norm (mathematics)#Defini ...
,
calculus
Calculus, originally called infinitesimal calculus or "the calculus of infinitesimals", is the mathematical study of continuous change, in the same way that geometry is the study of shape, and algebra is the study of generalizations of arithm ...
is the study of two linear operators: the
differential operator
In mathematics, a differential operator is an operator defined as a function of the differentiation operator. It is helpful, as a matter of notation first, to consider differentiation as an abstract operation that accepts a function and return ...
, and the
Volterra operator
In mathematics, in the area of functional analysis and operator theory, the Volterra operator, named after Vito Volterra, is a bounded linear operator on the space ''L''2 ,1of complex-valued square-integrable functions on the interval ,1 On the su ...
.
Fourier series and Fourier transform
The Fourier transform is useful in applied mathematics, particularly physics and signal processing. It is another integral operator; it is useful mainly because it converts a function on one (temporal) domain to a function on another (frequency) domain, in a way effectively
invertible
In mathematics, the concept of an inverse element generalises the concepts of opposite () and reciprocal () of numbers.
Given an operation denoted here , and an identity element denoted , if , one says that is a left inverse of , and that is ...
. No information is lost, as there is an inverse transform operator. In the simple case of
periodic function
A periodic function is a function that repeats its values at regular intervals. For example, the trigonometric functions, which repeat at intervals of 2\pi radians, are periodic functions. Periodic functions are used throughout science to desc ...
s, this result is based on the theorem that any continuous periodic function can be represented as the sum of a series of
sine wave
A sine wave, sinusoidal wave, or just sinusoid is a curve, mathematical curve defined in terms of the ''sine'' trigonometric function, of which it is the graph of a function, graph. It is a type of continuous wave and also a Smoothness, smooth p ...
s and cosine waves:
The tuple (''a''
0, ''a''
1, ''b''
1, ''a''
2, ''b''
2, …) is in fact an element of an infinite-dimensional vector space
''ℓ'', and thus Fourier series is a linear operator.
When dealing with general function
, the transform takes on an
integral
In mathematics
Mathematics is an area of knowledge that includes the topics of numbers, formulas and related structures, shapes and the spaces in which they are contained, and quantities and their changes. These topics are represented i ...
form:
Laplace transform
The ''Laplace transform'' is another integral operator and is involved in simplifying the process of solving differential equations.
Given ''f'' = ''f''(''s''), it is defined by:
Fundamental operators on scalar and vector fields
Three operators are key to
vector calculus
Vector calculus, or vector analysis, is concerned with differentiation and integration of vector fields, primarily in 3-dimensional Euclidean space \mathbb^3. The term "vector calculus" is sometimes used as a synonym for the broader subject ...
:
* Grad (
gradient
In vector calculus, the gradient of a scalar-valued differentiable function of several variables is the vector field (or vector-valued function) \nabla f whose value at a point p is the "direction and rate of fastest increase". If the gradi ...
), (with operator symbol
) assigns a vector at every point in a scalar field that points in the direction of greatest rate of change of that field and whose norm measures the absolute value of that greatest rate of change.
* Div (
divergence
In vector calculus, divergence is a vector operator that operates on a vector field, producing a scalar field giving the quantity of the vector field's source at each point. More technically, the divergence represents the volume density of the ...
), (with operator symbol
) is a vector operator that measures a vector field's divergence from or convergence towards a given point.
*
Curl
cURL (pronounced like "curl", UK: , US: ) is a computer software project providing a library (libcurl) and command-line tool (curl) for transferring data using various network protocols. The name stands for "Client URL".
History
cURL was fi ...
, (with operator symbol
) is a vector operator that measures a vector field's curling (winding around, rotating around) trend about a given point.
As an extension of vector calculus operators to physics, engineering and tensor spaces, grad, div and curl operators also are often associated with
tensor calculus
In mathematics, tensor calculus, tensor analysis, or Ricci calculus is an extension of vector calculus to tensor fields (tensors that may vary over a manifold, e.g. in spacetime).
Developed by Gregorio Ricci-Curbastro and his student Tullio Levi ...
as well as vector calculus.
See also
*
Function
Function or functionality may refer to:
Computing
* Function key, a type of key on computer keyboards
* Function model, a structured representation of processes in a system
* Function object or functor or functionoid, a concept of object-oriente ...
*
Operator algebra
In functional analysis, a branch of mathematics, an operator algebra is an algebra of continuous linear operators on a topological vector space, with the multiplication given by the composition of mappings.
The results obtained in the study of ...
*
List of operators
References
{{reflist
Algebra
Functional analysis
Mathematical notation