In
mathematics
Mathematics is a field of study that discovers and organizes methods, Mathematical theory, theories and theorems that are developed and Mathematical proof, proved for the needs of empirical sciences and mathematics itself. There are many ar ...
, the modern
component-free approach to the theory of a tensor views a tensor as an
abstract object
In philosophy and the arts, a fundamental distinction exists between abstract and concrete entities. While there is no universally accepted definition, common examples illustrate the difference: numbers, sets, and ideas are typically classif ...
, expressing some definite type of
multilinear concept. Their properties can be derived from their definitions, as
linear map
In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping V \to W between two vector spaces that p ...
s or more generally; and the rules for manipulations of tensors arise as an extension of
linear algebra to
multilinear algebra.
In
differential geometry
Differential geometry is a Mathematics, mathematical discipline that studies the geometry of smooth shapes and smooth spaces, otherwise known as smooth manifolds. It uses the techniques of Calculus, single variable calculus, vector calculus, lin ...
, an intrinsic geometric statement may be described by a
tensor field
In mathematics and physics, a tensor field is a function assigning a tensor to each point of a region of a mathematical space (typically a Euclidean space or manifold) or of the physical space. Tensor fields are used in differential geometry, ...
on a
manifold
In mathematics, a manifold is a topological space that locally resembles Euclidean space near each point. More precisely, an n-dimensional manifold, or ''n-manifold'' for short, is a topological space with the property that each point has a N ...
, and then doesn't need to make reference to coordinates at all. The same is true in
general relativity
General relativity, also known as the general theory of relativity, and as Einstein's theory of gravity, is the differential geometry, geometric theory of gravitation published by Albert Einstein in 1915 and is the current description of grav ...
, of tensor fields describing a
physical property
A physical property is any property of a physical system that is measurable. The changes in the physical properties of a system can be used to describe its changes between momentary states. A quantifiable physical property is called ''physical ...
. The component-free approach is also used extensively in
abstract algebra
In mathematics, more specifically algebra, abstract algebra or modern algebra is the study of algebraic structures, which are set (mathematics), sets with specific operation (mathematics), operations acting on their elements. Algebraic structur ...
and
homological algebra
Homological algebra is the branch of mathematics that studies homology (mathematics), homology in a general algebraic setting. It is a relatively young discipline, whose origins can be traced to investigations in combinatorial topology (a precurs ...
, where tensors arise naturally.
Definition via tensor products of vector spaces
Given a finite set of
vector space
In mathematics and physics, a vector space (also called a linear space) is a set (mathematics), set whose elements, often called vector (mathematics and physics), ''vectors'', can be added together and multiplied ("scaled") by numbers called sc ...
s over a common
field , one may form their
tensor product
In mathematics, the tensor product V \otimes W of two vector spaces V and W (over the same field) is a vector space to which is associated a bilinear map V\times W \rightarrow V\otimes W that maps a pair (v,w),\ v\in V, w\in W to an element of ...
, an element of which is termed a tensor.
A tensor on the vector space is then defined to be an element of (i.e., a vector in) a vector space of the form:
where is the
dual space
In mathematics, any vector space ''V'' has a corresponding dual vector space (or just dual space for short) consisting of all linear forms on ''V,'' together with the vector space structure of pointwise addition and scalar multiplication by cons ...
of .
If there are copies of and copies of in our product, the tensor is said to be of and
contravariant of order and covariant of order and of total
order
Order, ORDER or Orders may refer to:
* A socio-political or established or existing order, e.g. World order, Ancien Regime, Pax Britannica
* Categorization, the process in which ideas and objects are recognized, differentiated, and understood
...
. The tensors of order zero are just the scalars (elements of the field ), those of contravariant order 1 are the vectors in , and those of covariant order 1 are the
one-forms in (for this reason, the elements of the last two spaces are often called the contravariant and covariant vectors). The space of all tensors of type is denoted
Example 1. The space of type tensors,
is
isomorphic
In mathematics, an isomorphism is a structure-preserving mapping or morphism between two structures of the same type that can be reversed by an inverse mapping. Two mathematical structures are isomorphic if an isomorphism exists between the ...
in a natural way to the space of
linear transformations
In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping V \to W between two vector spaces that pr ...
from to .
Example 2. A
bilinear form
In mathematics, a bilinear form is a bilinear map on a vector space (the elements of which are called '' vectors'') over a field ''K'' (the elements of which are called '' scalars''). In other words, a bilinear form is a function that is linea ...
on a real vector space ,
corresponds in a natural way to a type tensor in
An example of such a bilinear form may be defined, termed the associated ''
metric tensor
In the mathematical field of differential geometry, a metric tensor (or simply metric) is an additional structure on a manifold (such as a surface) that allows defining distances and angles, just as the inner product on a Euclidean space allows ...
'', and is usually denoted .
Tensor rank
A simple tensor (also called a tensor of rank one, elementary tensor or decomposable tensor) is a tensor that can be written as a product of tensors of the form
where are nonzero and in or – that is, if the tensor is nonzero and completely
factorizable. Every tensor can be expressed as a sum of simple tensors. The rank of a tensor is the minimum number of simple tensors that sum to .
The
zero tensor
In mathematics, a zero element is one of several generalizations of the number zero to other algebraic structures. These alternate meanings may or may not reduce to the same thing, depending on the context.
Additive identities
An ''additive ide ...
has rank zero. A nonzero order 0 or 1 tensor always has rank 1. The rank of a non-zero order 2 or higher tensor is less than or equal to the product of the dimensions of all but the highest-dimensioned vectors in (a sum of products of) which the tensor can be expressed, which is when each product is of vectors from a finite-dimensional vector space of dimension .
The term ''rank of a tensor'' extends the notion of the
rank of a matrix
In linear algebra, the rank of a matrix is the dimension of the vector space generated (or spanned) by its columns. p. 48, § 1.16 This corresponds to the maximal number of linearly independent columns of . This, in turn, is identical to the dime ...
in linear algebra, although the term is also often used to mean the order (or degree) of a tensor. The rank of a matrix is the minimum number of column vectors needed to span the
range of the matrix. A matrix thus has rank one if it can be written as an
outer product
In linear algebra, the outer product of two coordinate vectors is the matrix whose entries are all products of an element in the first vector with an element in the second vector. If the two coordinate vectors have dimensions ''n'' and ''m'', the ...
of two nonzero vectors:
The rank of a matrix is the smallest number of such outer products that can be summed to produce it:
In indices, a tensor of rank 1 is a tensor of the form
The rank of a tensor of order 2 agrees with the rank when the tensor is regarded as a
matrix
Matrix (: matrices or matrixes) or MATRIX may refer to:
Science and mathematics
* Matrix (mathematics), a rectangular array of numbers, symbols or expressions
* Matrix (logic), part of a formula in prenex normal form
* Matrix (biology), the m ...
, and can be determined from
Gaussian elimination
In mathematics, Gaussian elimination, also known as row reduction, is an algorithm for solving systems of linear equations. It consists of a sequence of row-wise operations performed on the corresponding matrix of coefficients. This method can a ...
for instance. The rank of an order 3 or higher tensor is however often to determine, and low rank decompositions of tensors are sometimes of great practical interest. In fact, the problem of finding the rank of an order 3 tensor over any
finite field
In mathematics, a finite field or Galois field (so-named in honor of Évariste Galois) is a field (mathematics), field that contains a finite number of Element (mathematics), elements. As with any field, a finite field is a Set (mathematics), s ...
is
NP-Complete
In computational complexity theory, NP-complete problems are the hardest of the problems to which ''solutions'' can be verified ''quickly''.
Somewhat more precisely, a problem is NP-complete when:
# It is a decision problem, meaning that for any ...
, and over the rationals, is
NP-Hard
In computational complexity theory, a computational problem ''H'' is called NP-hard if, for every problem ''L'' which can be solved in non-deterministic polynomial-time, there is a polynomial-time reduction from ''L'' to ''H''. That is, assumi ...
. Computational tasks such as the efficient multiplication of matrices and the efficient evaluation of
polynomial
In mathematics, a polynomial is a Expression (mathematics), mathematical expression consisting of indeterminate (variable), indeterminates (also called variable (mathematics), variables) and coefficients, that involves only the operations of addit ...
s can be recast as the problem of simultaneously evaluating a set of
bilinear form
In mathematics, a bilinear form is a bilinear map on a vector space (the elements of which are called '' vectors'') over a field ''K'' (the elements of which are called '' scalars''). In other words, a bilinear form is a function that is linea ...
s
for given inputs and . If a low-rank decomposition of the tensor is known, then an efficient
evaluation strategy
In a programming language, an evaluation strategy is a set of rules for evaluating expressions. The term is often used to refer to the more specific notion of a ''parameter-passing strategy'' that defines the kind of value that is passed to the ...
is known.
Universal property
The space
can be characterized by a
universal property
In mathematics, more specifically in category theory, a universal property is a property that characterizes up to an isomorphism the result of some constructions. Thus, universal properties can be used for defining some objects independently fro ...
in terms of
multilinear map
Multilinear may refer to:
* Multilinear form, a type of mathematical function from a vector space to the underlying field
* Multilinear map, a type of mathematical function between vector spaces
* Multilinear algebra, a field of mathematics ...
pings. Amongst the advantages of this approach are that it gives a way to show that many linear mappings are "natural" or "geometric" (in other words are independent of any choice of basis). Explicit computational information can then be written down using bases, and this order of priorities can be more convenient than proving a formula gives rise to a natural mapping. Another aspect is that tensor products are not used only for
free module
In mathematics, a free module is a module that has a ''basis'', that is, a generating set that is linearly independent. Every vector space is a free module, but, if the ring of the coefficients is not a division ring (not a field in the commu ...
s, and the "universal" approach carries over more easily to more general situations.
A scalar-valued function on a
Cartesian product
In mathematics, specifically set theory, the Cartesian product of two sets and , denoted , is the set of all ordered pairs where is an element of and is an element of . In terms of set-builder notation, that is
A\times B = \.
A table c ...
(or
direct sum
The direct sum is an operation between structures in abstract algebra, a branch of mathematics. It is defined differently but analogously for different kinds of structures. As an example, the direct sum of two abelian groups A and B is anothe ...
) of vector spaces
is multilinear if it is linear in each argument. The space of all multilinear mappings from to is denoted . When , a multilinear mapping is just an ordinary linear mapping, and the space of all linear mappings from to is denoted .
The
universal characterization of the tensor product implies that, for each multilinear function
(where can represent the field of scalars, a vector space, or a tensor space) there exists a unique linear function
such that
for all in and in .
Using the universal property, it follows, when is
finite dimensional, that the space of -tensors admits a
natural isomorphism
In category theory, a branch of mathematics, a natural transformation provides a way of transforming one functor into another while respecting the internal structure (i.e., the composition of morphisms) of the categories involved. Hence, a natura ...
Each in the definition of the tensor corresponds to a inside the argument of the linear maps, and vice versa. (Note that in the former case, there are copies of and copies of , and in the latter case vice versa). In particular, one has
Tensor fields
Differential geometry
Differential geometry is a Mathematics, mathematical discipline that studies the geometry of smooth shapes and smooth spaces, otherwise known as smooth manifolds. It uses the techniques of Calculus, single variable calculus, vector calculus, lin ...
,
physics
Physics is the scientific study of matter, its Elementary particle, fundamental constituents, its motion and behavior through space and time, and the related entities of energy and force. "Physical science is that department of knowledge whi ...
and
engineering
Engineering is the practice of using natural science, mathematics, and the engineering design process to Problem solving#Engineering, solve problems within technology, increase efficiency and productivity, and improve Systems engineering, s ...
must often deal with
tensor field
In mathematics and physics, a tensor field is a function assigning a tensor to each point of a region of a mathematical space (typically a Euclidean space or manifold) or of the physical space. Tensor fields are used in differential geometry, ...
s on
smooth manifold
In mathematics, a differentiable manifold (also differential manifold) is a type of manifold that is locally similar enough to a vector space to allow one to apply calculus. Any manifold can be described by a collection of charts (atlas). One may ...
s. The term ''tensor'' is sometimes used as a shorthand for ''tensor field''. A tensor field expresses the concept of a tensor that varies from point to point on the manifold.
References
*.
*.
*.
*.
*.
*.
*.
*.
{{DEFAULTSORT:Tensor (Intrinsic Definition)
Tensors