HOME

TheInfoList



OR:

In mathematics and
physics Physics is the natural science that studies matter, its fundamental constituents, its motion and behavior through space and time, and the related entities of energy and force. "Physical science is that department of knowledge which rel ...
, a vector space (also called a linear space) is a set whose elements, often called ''
vector Vector most often refers to: *Euclidean vector, a quantity with a magnitude and a direction *Vector (epidemiology), an agent that carries and transmits an infectious pathogen into another living organism Vector may also refer to: Mathematic ...
s'', may be added together and multiplied ("scaled") by numbers called '' scalars''. Scalars are often
real number In mathematics, a real number is a number that can be used to measurement, measure a ''continuous'' one-dimensional quantity such as a distance, time, duration or temperature. Here, ''continuous'' means that values can have arbitrarily small var ...
s, but can be
complex number In mathematics, a complex number is an element of a number system that extends the real numbers with a specific element denoted , called the imaginary unit and satisfying the equation i^= -1; every complex number can be expressed in the for ...
s or, more generally, elements of any field. The operations of vector addition and scalar multiplication must satisfy certain requirements, called ''vector axioms''. The terms real vector space and complex vector space are often used to specify the nature of the scalars:
real coordinate space In mathematics, the real coordinate space of dimension , denoted ( ) or is the set of the -tuples of real numbers, that is the set of all sequences of real numbers. With component-wise addition and scalar multiplication, it is a real vecto ...
or complex coordinate space. Vector spaces generalize
Euclidean vector In mathematics, physics, and engineering, a Euclidean vector or simply a vector (sometimes called a geometric vector or spatial vector) is a geometric object that has magnitude (or length) and direction. Vectors can be added to other vectors ...
s, which allow modeling of
physical quantities A physical quantity is a physical property of a material or system that can be quantified by measurement. A physical quantity can be expressed as a ''value'', which is the algebraic multiplication of a ' Numerical value ' and a ' Unit '. For examp ...
, such as
force In physics, a force is an influence that can change the motion of an object. A force can cause an object with mass to change its velocity (e.g. moving from a state of rest), i.e., to accelerate. Force can also be described intuitively as a ...
s and
velocity Velocity is the directional speed of an object in motion as an indication of its rate of change in position as observed from a particular frame of reference and as measured by a particular standard of time (e.g. northbound). Velocity i ...
, that have not only a magnitude, but also a direction. The concept of vector spaces is fundamental for
linear algebra Linear algebra is the branch of mathematics concerning linear equations such as: :a_1x_1+\cdots +a_nx_n=b, linear maps such as: :(x_1, \ldots, x_n) \mapsto a_1x_1+\cdots +a_nx_n, and their representations in vector spaces and through matric ...
, together with the concept of
matrix Matrix most commonly refers to: * ''The Matrix'' (franchise), an American media franchise ** '' The Matrix'', a 1999 science-fiction action film ** "The Matrix", a fictional setting, a virtual reality environment, within ''The Matrix'' (franchi ...
, which allows computing in vector spaces. This provides a concise and synthetic way for manipulating and studying systems of linear equations. Vector spaces are characterized by their
dimension In physics and mathematics, the dimension of a mathematical space (or object) is informally defined as the minimum number of coordinates needed to specify any point within it. Thus, a line has a dimension of one (1D) because only one coor ...
, which, roughly speaking, specifies the number of independent directions in the space. This means that, for two vector spaces with the same dimension, the properties that depend only on the vector-space structure are exactly the same (technically the vector spaces are isomorphic). A vector space is
finite-dimensional In mathematics, the dimension of a vector space ''V'' is the cardinality (i.e., the number of vectors) of a basis of ''V'' over its base field. p. 44, §2.36 It is sometimes called Hamel dimension (after Georg Hamel) or algebraic dimension to d ...
if its dimension is a
natural number In mathematics, the natural numbers are those numbers used for counting (as in "there are ''six'' coins on the table") and ordering (as in "this is the ''third'' largest city in the country"). Numbers used for counting are called '' cardinal ...
. Otherwise, it is infinite-dimensional, and its dimension is an infinite cardinal. Finite-dimensional vector spaces occur naturally in
geometry Geometry (; ) is, with arithmetic, one of the oldest branches of mathematics. It is concerned with properties of space such as the distance, shape, size, and relative position of figures. A mathematician who works in the field of geometry is c ...
and related areas. Infinite-dimensional vector spaces occur in many areas of mathematics. For example,
polynomial ring In mathematics, especially in the field of algebra, a polynomial ring or polynomial algebra is a ring (which is also a commutative algebra) formed from the set of polynomials in one or more indeterminates (traditionally also called variable ...
s are
countably In mathematics, a Set (mathematics), set is countable if either it is finite set, finite or it can be made in one to one correspondence with the set of natural numbers. Equivalently, a set is ''countable'' if there exists an injective function fro ...
infinite-dimensional vector spaces, and many
function space In mathematics, a function space is a set of functions between two fixed sets. Often, the domain and/or codomain will have additional structure which is inherited by the function space. For example, the set of functions from any set into a ve ...
s have the
cardinality of the continuum In set theory, the cardinality of the continuum is the cardinality or "size" of the set of real numbers \mathbb R, sometimes called the continuum. It is an infinite cardinal number and is denoted by \mathfrak c (lowercase fraktur "c") or , \ma ...
as a dimension. Many vector spaces that are considered in mathematics are also endowed with other structures. This is the case of
algebras In mathematics, an algebra over a field (often simply called an algebra) is a vector space equipped with a bilinear product. Thus, an algebra is an algebraic structure consisting of a set together with operations of multiplication and additio ...
, which include
field extension In mathematics, particularly in algebra, a field extension is a pair of fields E\subseteq F, such that the operations of ''E'' are those of ''F'' restricted to ''E''. In this case, ''F'' is an extension field of ''E'' and ''E'' is a subfield of ...
s,
polynomial ring In mathematics, especially in the field of algebra, a polynomial ring or polynomial algebra is a ring (which is also a commutative algebra) formed from the set of polynomials in one or more indeterminates (traditionally also called variable ...
s, associative algebras and
Lie algebra In mathematics, a Lie algebra (pronounced ) is a vector space \mathfrak g together with an operation called the Lie bracket, an alternating bilinear map \mathfrak g \times \mathfrak g \rightarrow \mathfrak g, that satisfies the Jacobi iden ...
s. This is also the case of
topological vector space In mathematics, a topological vector space (also called a linear topological space and commonly abbreviated TVS or t.v.s.) is one of the basic structures investigated in functional analysis. A topological vector space is a vector space that is al ...
s, which include
function space In mathematics, a function space is a set of functions between two fixed sets. Often, the domain and/or codomain will have additional structure which is inherited by the function space. For example, the set of functions from any set into a ve ...
s,
inner product space In mathematics, an inner product space (or, rarely, a Hausdorff pre-Hilbert space) is a real vector space or a complex vector space with an operation called an inner product. The inner product of two vectors in the space is a scalar, often ...
s,
normed space In mathematics, a normed vector space or normed space is a vector space over the real or complex numbers, on which a norm is defined. A norm is the formalization and the generalization to real vector spaces of the intuitive notion of "lengt ...
s,
Hilbert space In mathematics, Hilbert spaces (named after David Hilbert) allow generalizing the methods of linear algebra and calculus from (finite-dimensional) Euclidean vector spaces to spaces that may be infinite-dimensional. Hilbert spaces arise natu ...
s and
Banach space In mathematics, more specifically in functional analysis, a Banach space (pronounced ) is a complete normed vector space. Thus, a Banach space is a vector space with a metric that allows the computation of vector length and distance between ve ...
s.


Definition and basic properties

In this article, vectors are represented in boldface to distinguish them from scalars.It is also common, especially in physics, to denote vectors with an arrow on top: \vec v. It is also common, especially in higher mathematics, to not use any typographical method for distinguishing vectors from other mathematical objects. A vector space over a field is a set  together with two
binary operation In mathematics, a binary operation or dyadic operation is a rule for combining two elements (called operands) to produce another element. More formally, a binary operation is an operation of arity two. More specifically, an internal binary op ...
s that satisfy the eight axioms listed below. In this context, the elements of are commonly called ''vectors'', and the elements of  are called ''scalars''. * The first operation, called ''vector addition'' or simply ''addition'' assigns to any two vectors  and in a third vector in which is commonly written as , and called the ''sum'' of these two vectors. * The second operation, called ''
scalar multiplication In mathematics, scalar multiplication is one of the basic operations defining a vector space in linear algebra (or more generally, a module in abstract algebra). In common geometrical contexts, scalar multiplication of a real Euclidean vector ...
'',assigns to any scalar  in and any vector  in another vector in , which is denoted .Scalar multiplication is not to be confused with the
scalar product In mathematics, the dot product or scalar productThe term ''scalar product'' means literally "product with a scalar as a result". It is also used sometimes for other symmetric bilinear forms, for example in a pseudo-Euclidean space. is an alg ...
, which is an additional operation on some specific vector spaces, called
inner product space In mathematics, an inner product space (or, rarely, a Hausdorff pre-Hilbert space) is a real vector space or a complex vector space with an operation called an inner product. The inner product of two vectors in the space is a scalar, often ...
s. Scalar multiplication is a multiplication of a vector ''by'' a scalar that produces a vector, while the scalar product is a multiplication of two vectors that produces a scalar.
For having a vector space, the eight following
axiom An axiom, postulate, or assumption is a statement that is taken to be true, to serve as a premise or starting point for further reasoning and arguments. The word comes from the Ancient Greek word (), meaning 'that which is thought worthy o ...
s must be satisfied for every , and in , and and in . When the scalar field is the
real number In mathematics, a real number is a number that can be used to measurement, measure a ''continuous'' one-dimensional quantity such as a distance, time, duration or temperature. Here, ''continuous'' means that values can have arbitrarily small var ...
s the vector space is called a ''real vector space''. When the scalar field is the
complex number In mathematics, a complex number is an element of a number system that extends the real numbers with a specific element denoted , called the imaginary unit and satisfying the equation i^= -1; every complex number can be expressed in the for ...
s, the vector space is called a ''complex vector space''. These two cases are the most common ones, but vector spaces with scalars in an arbitrary field are also commonly considered. Such a vector space is called an -''vector space'' or a ''vector space over ''. An equivalent definition of a vector space can be given, which is much more concise but less elementary: the first four axioms (related to vector addition) say that a vector space is an
abelian group In mathematics, an abelian group, also called a commutative group, is a group in which the result of applying the group operation to two group elements does not depend on the order in which they are written. That is, the group operation is com ...
under addition, and the four remaining axioms (related to the scalar multiplication), say that this operation defines a
ring homomorphism In ring theory, a branch of abstract algebra, a ring homomorphism is a structure-preserving function between two rings. More explicitly, if ''R'' and ''S'' are rings, then a ring homomorphism is a function such that ''f'' is: :addition prese ...
from the field into the
endomorphism ring In mathematics, the endomorphisms of an abelian group ''X'' form a ring. This ring is called the endomorphism ring of ''X'', denoted by End(''X''); the set of all homomorphisms of ''X'' into itself. Addition of endomorphisms arises naturally in ...
of this group. Subtraction of two vectors can be defined as : \mathbf - \mathbf = \mathbf + (-\mathbf). Direct consequences of the axioms include that, for every s\in F and \mathbf v\in V, one has *0\mathbf v = \mathbf 0, *s\mathbf 0=\mathbf 0, *(-1)\mathbf v = -\mathbf v, *s\mathbf v = \mathbf 0 implies s=0 or \mathbf v= \mathbf 0.


Related concepts and properties

; Linear combination : Given a set of elements of a -vector space , a linear combination of elements of is an element of of the form a_1 \mathbf_1 + a_2 \mathbf_2 + \cdots + a_k \mathbf_k, where a_1, \ldots, a_k\in F and \mathbf_1, \ldots, \mathbf_k\in G. The scalars a_1, \ldots, a_k are called the ''coefficients'' of the linear combination. ;
Linear independence In the theory of vector spaces, a set of vectors is said to be if there is a nontrivial linear combination of the vectors that equals the zero vector. If no such linear combination exists, then the vectors are said to be . These concepts a ...
:The elements of a subset of a -vector space are said to be ''linearly independent'' if no element of can be written as a linear combination of the other elements of . Equivalently, they are linearly independent if two linear combinations of element of define the same element of if and only if they have the same coefficients. Also equivalently, they are linearly independent if a linear combination results in the zero vector if and only if all its coefficients are zero. ; Linear subspace :A ''linear subspace'' or ''vector subspace'' of a vector space is a non-empty subset of that is closed under vector addition and scalar multiplication; that is, the sum of two elements of and the product of an element of by a scalar belong to . This implies that every linear combination of elements of belongs to . A linear subspace is a vector space for the induced addition and scalar multiplication; this means that the closure property implies that the axioms of a vector space are satisfied.
The closure property also implies that ''every
intersection In mathematics, the intersection of two or more objects is another object consisting of everything that is contained in all of the objects simultaneously. For example, in Euclidean geometry, when two lines in a plane are not parallel, thei ...
of linear subspaces is a linear subspace.'' ;
Linear span In mathematics, the linear span (also called the linear hull or just span) of a set of vectors (from a vector space), denoted , pp. 29-30, §§ 2.5, 2.8 is defined as the set of all linear combinations of the vectors in . It can be characteri ...
:Given a subset of a vector space , the ''linear span'' or simply the ''span'' of is the smallest linear subspace of that contains , in the sense that it is the intersection of all linear subspaces that contain . The span of is also the set of all linear combinations of elements of .
If is the span of , one says that ''spans'' or ''generates'' , and that is a '' spanning set'' or a ''generating set'' of . ; Basis and
dimension In physics and mathematics, the dimension of a mathematical space (or object) is informally defined as the minimum number of coordinates needed to specify any point within it. Thus, a line has a dimension of one (1D) because only one coor ...
:A subset of a vector space is a ''basis'' if its elements are linearly independent and span the vector space. Every vector space has at least one basis, generally many (see ). Moreover, all bases of a vector space have the same
cardinality In mathematics, the cardinality of a set is a measure of the number of elements of the set. For example, the set A = \ contains 3 elements, and therefore A has a cardinality of 3. Beginning in the late 19th century, this concept was generalized ...
, which is called the ''dimension'' of the vector space (see Dimension theorem for vector spaces). This is a fundamental property of vector spaces, which is detailed in the remainder of the section. ''Bases'' are a fundamental tool for the study of vector spaces, especially when the dimension is finite. In the infinite-dimensional case, the existence of infinite bases, often called Hamel bases, depend on the
axiom of choice In mathematics, the axiom of choice, or AC, is an axiom of set theory equivalent to the statement that ''a Cartesian product of a collection of non-empty sets is non-empty''. Informally put, the axiom of choice says that given any collection ...
. It follows that, in general, no base can be explicitly described. For example, the
real number In mathematics, a real number is a number that can be used to measurement, measure a ''continuous'' one-dimensional quantity such as a distance, time, duration or temperature. Here, ''continuous'' means that values can have arbitrarily small var ...
s form an infinite-dimensional vector space over the
rational number In mathematics, a rational number is a number that can be expressed as the quotient or fraction of two integers, a numerator and a non-zero denominator . For example, is a rational number, as is every integer (e.g. ). The set of all ra ...
s, for which no specific basis is known. Consider a basis (\mathbf_1, \mathbf_2 , \ldots, \mathbf_n) of a vector space of dimension over a field . The definition of a basis implies that every \mathbf v \in V may be written :\mathbf v = a_1\mathbf b_1 +\cdots +a_n \mathbf b_n, with a_1,\dots, a_n in , and that this decomposition is unique. The scalars a_1, \ldots, a_n are called the ''coordinates'' of on the basis. They are also said to be the ''coefficients'' of the decomposition of on the basis. One also says that the -
tuple In mathematics, a tuple is a finite ordered list (sequence) of elements. An -tuple is a sequence (or ordered list) of elements, where is a non-negative integer. There is only one 0-tuple, referred to as ''the empty tuple''. An -tuple is defi ...
of the coordinates is the
coordinate vector In linear algebra, a coordinate vector is a representation of a vector as an ordered list of numbers (a tuple) that describes the vector in terms of a particular ordered basis. An easy example may be a position such as (5, 2, 1) in a 3-dimensio ...
of on the basis, since the set F^n of the -tuples of elements of is a vector space for componentwise addition and scalar multiplication, whose dimension is . The
one-to-one correspondence In mathematics, a bijection, also known as a bijective function, one-to-one correspondence, or invertible function, is a function between the elements of two sets, where each element of one set is paired with exactly one element of the other ...
between vectors and their coordinate vectors maps vector addition to vector addition and scalar multiplication to scalar multiplication. It is thus a vector space isomorphism, which allows translating reasonings and computations on vectors into reasonings and computations on their coordinates. If, in turn, these coordinates are arranged as matrices, these reasonings and computations on coordinates can be expressed concisely as reasonings and computations on matrices. Moreover, a
linear equation In mathematics, a linear equation is an equation that may be put in the form a_1x_1+\ldots+a_nx_n+b=0, where x_1,\ldots,x_n are the variables (or unknowns), and b,a_1,\ldots,a_n are the coefficients, which are often real numbers. The coeffici ...
relating matrices can be expanded into a system of linear equations, and, conversely, every such system can be compacted into a linear equation on matrices. So, in summary, finite-dimensional
linear algebra Linear algebra is the branch of mathematics concerning linear equations such as: :a_1x_1+\cdots +a_nx_n=b, linear maps such as: :(x_1, \ldots, x_n) \mapsto a_1x_1+\cdots +a_nx_n, and their representations in vector spaces and through matric ...
may be expressed in three equivalent languages: *''Vector spaces'', which provide concise and coordinate-free statements, *''Matrices'', which are convenient for expressing concisely explicit computations, *'' Systems of linear equations,'' which provide more elementary formulations.


History

Vector spaces stem from
affine geometry In mathematics, affine geometry is what remains of Euclidean geometry when ignoring (mathematicians often say "forgetting") the metric notions of distance and angle. As the notion of '' parallel lines'' is one of the main properties that is i ...
, via the introduction of
coordinate In geometry, a coordinate system is a system that uses one or more numbers, or coordinates, to uniquely determine the position of the points or other geometric elements on a manifold such as Euclidean space. The order of the coordinates is si ...
s in the plane or three-dimensional space. Around 1636, French mathematicians
René Descartes René Descartes ( or ; ; Latinized: Renatus Cartesius; 31 March 1596 – 11 February 1650) was a French philosopher, scientist, and mathematician, widely considered a seminal figure in the emergence of modern philosophy and science. Mathe ...
and
Pierre de Fermat Pierre de Fermat (; between 31 October and 6 December 1607 – 12 January 1665) was a French mathematician who is given credit for early developments that led to infinitesimal calculus, including his technique of adequality. In particular, he ...
founded analytic geometry by identifying solutions to an equation of two variables with points on a plane
curve In mathematics, a curve (also called a curved line in older texts) is an object similar to a line, but that does not have to be straight. Intuitively, a curve may be thought of as the trace left by a moving point. This is the definition that ...
. To achieve geometric solutions without using coordinates,
Bolzano Bolzano ( or ; german: Bozen, (formerly ); bar, Bozn; lld, Balsan or ) is the capital city of the province of South Tyrol in northern Italy. With a population of 108,245, Bolzano is also by far the largest city in South Tyrol and the third ...
introduced, in 1804, certain operations on points, lines and planes, which are predecessors of vectors. introduced the notion of barycentric coordinates. introduced the notion of a bipoint, i.e., an oriented segment one of whose ends is the origin and the other one a target. Vectors were reconsidered with the presentation of
complex numbers In mathematics, a complex number is an element of a number system that extends the real numbers with a specific element denoted , called the imaginary unit and satisfying the equation i^= -1; every complex number can be expressed in the for ...
by Argand and Hamilton and the inception of
quaternion In mathematics, the quaternion number system extends the complex numbers. Quaternions were first described by the Irish mathematician William Rowan Hamilton in 1843 and applied to mechanics in three-dimensional space. Hamilton defined a quat ...
s by the latter. They are elements in R2 and R4; treating them using linear combinations goes back to Laguerre in 1867, who also defined systems of linear equations. In 1857, Cayley introduced the matrix notation which allows for a harmonization and simplification of
linear map In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping V \to W between two vector spaces that pr ...
s. Around the same time, Grassmann studied the barycentric calculus initiated by Möbius. He envisaged sets of abstract objects endowed with operations. In his work, the concepts of
linear independence In the theory of vector spaces, a set of vectors is said to be if there is a nontrivial linear combination of the vectors that equals the zero vector. If no such linear combination exists, then the vectors are said to be . These concepts a ...
and
dimension In physics and mathematics, the dimension of a mathematical space (or object) is informally defined as the minimum number of coordinates needed to specify any point within it. Thus, a line has a dimension of one (1D) because only one coor ...
, as well as
scalar product In mathematics, the dot product or scalar productThe term ''scalar product'' means literally "product with a scalar as a result". It is also used sometimes for other symmetric bilinear forms, for example in a pseudo-Euclidean space. is an alg ...
s are present. Actually Grassmann's 1844 work exceeds the framework of vector spaces, since his considering multiplication, too, led him to what are today called
algebra Algebra () is one of the areas of mathematics, broad areas of mathematics. Roughly speaking, algebra is the study of mathematical symbols and the rules for manipulating these symbols in formulas; it is a unifying thread of almost all of mathem ...
s. Italian mathematician
Peano Giuseppe Peano (; ; 27 August 1858 – 20 April 1932) was an Italian mathematician and glottologist. The author of over 200 books and papers, he was a founder of mathematical logic and set theory, to which he contributed much notation. The sta ...
was the first to give the modern definition of vector spaces and linear maps in 1888, although he called them "linear systems". An important development of vector spaces is due to the construction of function spaces by Henri Lebesgue. This was later formalized by
Banach Banach (pronounced in German, in Slavic Languages, and or in English) is a Jewish surname of Ashkenazi origin believed to stem from the translation of the phrase " son of man", combining the Hebrew word ''ben'' ("son of") and Arameic ''nash ...
and Hilbert, around 1920. At that time,
algebra Algebra () is one of the areas of mathematics, broad areas of mathematics. Roughly speaking, algebra is the study of mathematical symbols and the rules for manipulating these symbols in formulas; it is a unifying thread of almost all of mathem ...
and the new field of
functional analysis