HOME

TheInfoList



OR:

In
mathematics Mathematics is a field of study that discovers and organizes methods, Mathematical theory, theories and theorems that are developed and Mathematical proof, proved for the needs of empirical sciences and mathematics itself. There are many ar ...
, an
ordered basis Order, ORDER or Orders may refer to: * A socio-political or established or existing order, e.g. World order, Ancien Regime, Pax Britannica * Categorization, the process in which ideas and objects are recognized, differentiated, and understood * ...
of a
vector space In mathematics and physics, a vector space (also called a linear space) is a set (mathematics), set whose elements, often called vector (mathematics and physics), ''vectors'', can be added together and multiplied ("scaled") by numbers called sc ...
of finite
dimension In physics and mathematics, the dimension of a mathematical space (or object) is informally defined as the minimum number of coordinates needed to specify any point within it. Thus, a line has a dimension of one (1D) because only one coo ...
allows representing uniquely any element of the vector space by a
coordinate vector In linear algebra, a coordinate vector is a representation of a vector as an ordered list of numbers (a tuple) that describes the vector in terms of a particular ordered basis. An easy example may be a position such as (5, 2, 1) in a 3-dimension ...
, which is a
sequence In mathematics, a sequence is an enumerated collection of objects in which repetitions are allowed and order matters. Like a set, it contains members (also called ''elements'', or ''terms''). The number of elements (possibly infinite) is cal ...
of scalars called
coordinates In geometry, a coordinate system is a system that uses one or more numbers, or coordinates, to uniquely determine and standardize the Position (geometry), position of the Point (geometry), points or other geometric elements on a manifold such as ...
. If two different bases are considered, the coordinate vector that represents a vector on one basis is, in general, different from the coordinate vector that represents on the other basis. A change of basis consists of converting every assertion expressed in terms of coordinates relative to one basis into an assertion expressed in terms of coordinates relative to the other basis. Such a conversion results from the ''change-of-basis formula'' which expresses the coordinates relative to one basis in terms of coordinates relative to the other basis. Using
matrices Matrix (: matrices or matrixes) or MATRIX may refer to: Science and mathematics * Matrix (mathematics), a rectangular array of numbers, symbols or expressions * Matrix (logic), part of a formula in prenex normal form * Matrix (biology), the ...
, this formula can be written :\mathbf x_\mathrm = A \,\mathbf x_\mathrm, where "old" and "new" refer respectively to the initially defined basis and the other basis, \mathbf x_\mathrm and \mathbf x_\mathrm are the
column vector In linear algebra, a column vector with elements is an m \times 1 matrix consisting of a single column of entries, for example, \boldsymbol = \begin x_1 \\ x_2 \\ \vdots \\ x_m \end. Similarly, a row vector is a 1 \times n matrix for some , c ...
s of the coordinates of the same vector on the two bases. A is the change-of-basis matrix (also called transition matrix), which is the matrix whose columns are the coordinates of the new
basis vector In mathematics, a set of elements of a vector space is called a basis (: bases) if every element of can be written in a unique way as a finite linear combination of elements of . The coefficients of this linear combination are referred to as ...
s on the old basis. A change of basis is sometimes called a ''change of coordinates'', although it excludes many
coordinate transformation In geometry, a coordinate system is a system that uses one or more numbers, or coordinates, to uniquely determine and standardize the position of the points or other geometric elements on a manifold such as Euclidean space. The coordinates are ...
s. For applications in
physics Physics is the scientific study of matter, its Elementary particle, fundamental constituents, its motion and behavior through space and time, and the related entities of energy and force. "Physical science is that department of knowledge whi ...
and specially in
mechanics Mechanics () is the area of physics concerned with the relationships between force, matter, and motion among Physical object, physical objects. Forces applied to objects may result in Displacement (vector), displacements, which are changes of ...
, a change of basis often involves the transformation of an
orthonormal basis In mathematics, particularly linear algebra, an orthonormal basis for an inner product space V with finite Dimension (linear algebra), dimension is a Basis (linear algebra), basis for V whose vectors are orthonormal, that is, they are all unit vec ...
, understood as a
rotation Rotation or rotational/rotary motion is the circular movement of an object around a central line, known as an ''axis of rotation''. A plane figure can rotate in either a clockwise or counterclockwise sense around a perpendicular axis intersect ...
in
physical space Space is a three-dimensional continuum containing positions and directions. In classical physics, physical space is often conceived in three linear dimensions. Modern physicists usually consider it, with time, to be part of a boundless fo ...
, thus excluding
translations Translation is the communication of the meaning of a source-language text by means of an equivalent target-language text. The English language draws a terminological distinction (which does not exist in every language) between ''transl ...
. This article deals mainly with finite-dimensional vector spaces. However, many of the principles are also valid for infinite-dimensional vector spaces.


Change of basis formula

Let B_\mathrm =(v_1, \ldots, v_n) be a basis of a
finite-dimensional vector space In mathematics, the dimension of a vector space ''V'' is the cardinality (i.e., the number of vectors) of a basis of ''V'' over its base field. p. 44, §2.36 It is sometimes called Hamel dimension (after Georg Hamel) or algebraic dimension to d ...
over a field . For , one can define a vector by its coordinates a_ over B_\mathrm \colon :w_j=\sum_^n a_v_i. Let :A=\left(a_\right)_ be the
matrix Matrix (: matrices or matrixes) or MATRIX may refer to: Science and mathematics * Matrix (mathematics), a rectangular array of numbers, symbols or expressions * Matrix (logic), part of a formula in prenex normal form * Matrix (biology), the m ...
whose th column is formed by the coordinates of . (Here and in what follows, the index refers always to the rows of and the v_i, while the index refers always to the columns of and the w_j; such a convention is useful for avoiding errors in explicit computations.) Setting B_\mathrm =(w_1, \ldots, w_n), one has that B_\mathrm is a basis of if and only if the matrix is
invertible In mathematics, the concept of an inverse element generalises the concepts of opposite () and reciprocal () of numbers. Given an operation denoted here , and an identity element denoted , if , one says that is a left inverse of , and that ...
, or equivalently if it has a nonzero
determinant In mathematics, the determinant is a Scalar (mathematics), scalar-valued function (mathematics), function of the entries of a square matrix. The determinant of a matrix is commonly denoted , , or . Its value characterizes some properties of the ...
. In this case, is said to be the ''change-of-basis matrix'' from the basis B_\mathrm to the basis B_\mathrm . Given a vector z\in V, let (x_1, \ldots, x_n) be the coordinates of z over B_\mathrm , and (y_1, \ldots, y_n) its coordinates over B_\mathrm ; that is :z=\sum_^nx_iv_i = \sum_^ny_jw_j. (One could take the same summation index for the two sums, but choosing systematically the indexes for the old basis and for the new one makes clearer the formulas that follows, and helps avoiding errors in proofs and explicit computations.) The ''change-of-basis formula'' expresses the coordinates over the old basis in terms of the coordinates over the new basis. With above notation, it is :x_i = \sum_^n a_y_j\qquad\text i=1, \ldots, n. In terms of matrices, the change of basis formula is :\mathbf x = A\,\mathbf y, where \mathbf x and \mathbf y are the column vectors of the coordinates of over B_\mathrm and B_\mathrm , respectively. ''Proof:'' Using the above definition of the change-of basis matrix, one has :\begin z&=\sum_^n y_jw_j\\ &=\sum_^n \left(y_j\sum_^n a_v_i\right)\\ &=\sum_^n \left(\sum_^n a_ y_j \right) v_i. \end As z=\textstyle \sum_^n x_iv_i, the change-of-basis formula results from the uniqueness of the decomposition of a vector over a basis.


Example

Consider the
Euclidean vector space Euclidean space is the fundamental space of geometry, intended to represent physical space. Originally, in Euclid's ''Elements'', it was the three-dimensional space of Euclidean geometry, but in modern mathematics there are ''Euclidean spaces'' ...
\mathbb R^2 and a basis consisting of the vectors v_1= (1,0) and v_2= (0,1). If one rotates them by an angle of , one has a ''new basis'' formed by w_1=(\cos t, \sin t) and w_2=(-\sin t, \cos t). So, the change-of-basis matrix is \begin \cos t& -\sin t\\ \sin t& \cos t \end. The change-of-basis formula asserts that, if y_1, y_2 are the new coordinates of a vector (x_1, x_2), then one has :\beginx_1\\x_2\end=\begin \cos t& -\sin t\\ \sin t& \cos t \end\,\beginy_1\\y_2\end. That is, :x_1=y_1\cos t - y_2\sin t \qquad\text\qquad x_2=y_1\sin t + y_2\cos t. This may be verified by writing :\begin x_1v_1+x_2v_2 &= (y_1\cos t - y_2\sin t) v_1 + (y_1\sin t + y_2\cos t) v_2\\ &= y_1 (\cos (t) v_1 + \sin(t)v_2) + y_2 (-\sin(t) v_1 +\cos(t) v_2)\\ &=y_1w_1+y_2w_2. \end


In terms of linear maps

Normally, a
matrix Matrix (: matrices or matrixes) or MATRIX may refer to: Science and mathematics * Matrix (mathematics), a rectangular array of numbers, symbols or expressions * Matrix (logic), part of a formula in prenex normal form * Matrix (biology), the m ...
represents a
linear map In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping V \to W between two vector spaces that p ...
, and the product of a matrix and a column vector represents the
function application In mathematics, function application is the act of applying a function to an argument from its domain so as to obtain the corresponding value from its range. In this sense, function application can be thought of as the opposite of function abs ...
of the corresponding linear map to the vector whose coordinates form the column vector. The change-of-basis formula is a specific case of this general principle, although this is not immediately clear from its definition and proof. When one says that a matrix ''represents'' a linear map, one refers implicitly to bases of implied vector spaces, and to the fact that the choice of a basis induces an
isomorphism In mathematics, an isomorphism is a structure-preserving mapping or morphism between two structures of the same type that can be reversed by an inverse mapping. Two mathematical structures are isomorphic if an isomorphism exists between the ...
between a vector space and , where is the field of scalars. When only one basis is considered for each vector space, it is worth to leave this isomorphism implicit, and to work
up to Two Mathematical object, mathematical objects and are called "equal up to an equivalence relation " * if and are related by , that is, * if holds, that is, * if the equivalence classes of and with respect to are equal. This figure of speech ...
an isomorphism. As several bases of the same vector space are considered here, a more accurate wording is required. Let be a field, the set F^n of the -tuples is a -vector space whose addition and scalar multiplication are defined component-wise. Its
standard basis In mathematics, the standard basis (also called natural basis or canonical basis) of a coordinate vector space (such as \mathbb^n or \mathbb^n) is the set of vectors, each of whose components are all zero, except one that equals 1. For exampl ...
is the basis that has as its th element the tuple with all components equal to except the th that is . A basis B=(v_1, \ldots, v_n) of a -vector space defines a
linear isomorphism In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping V \to W between two vector spaces that pr ...
\phi\colon F^n\to V by :\phi(x_1,\ldots,x_n)=\sum_^n x_i v_i. Conversely, such a linear isomorphism defines a basis, which is the image by \phi of the standard basis of F^n. Let B_\mathrm =(v_1, \ldots, v_n) be the "old basis" of a change of basis, and \phi_\mathrm the associated isomorphism. Given a change-of basis matrix , one could consider it the matrix of an
endomorphism In mathematics, an endomorphism is a morphism from a mathematical object to itself. An endomorphism that is also an isomorphism is an automorphism. For example, an endomorphism of a vector space is a linear map , and an endomorphism of a g ...
\psi_A of F^n. Finally, define :\phi_\mathrm=\phi_\mathrm\circ\psi_A (where \circ denotes
function composition In mathematics, the composition operator \circ takes two function (mathematics), functions, f and g, and returns a new function h(x) := (g \circ f) (x) = g(f(x)). Thus, the function is function application, applied after applying to . (g \c ...
), and :B_\mathrm= \phi_\mathrm(\phi_\mathrm^(B_\mathrm)). A straightforward verification shows that this definition of B_\mathrm is the same as that of the preceding section. Now, by composing the equation \phi_\mathrm=\phi_\mathrm\circ\psi_A with \phi_\mathrm^ on the left and \phi_\mathrm^ on the right, one gets :\phi_\mathrm^ = \psi_A \circ \phi_\mathrm^. It follows that, for v\in V, one has :\phi_\mathrm^(v)= \psi_A(\phi_\mathrm^(v)), which is the change-of-basis formula expressed in terms of linear maps instead of coordinates.


Function defined on a vector space

A function that has a vector space as its domain is commonly specified as a
multivariate function In mathematics, a function from a set to a set assigns to each element of exactly one element of .; the words ''map'', ''mapping'', ''transformation'', ''correspondence'', and ''operator'' are sometimes used synonymously. The set is called ...
whose variables are the coordinates on some basis of the vector on which the function is applied. When the basis is changed, the expression of the function is changed. This change can be computed by substituting the "old" coordinates for their expressions in terms of the "new" coordinates. More precisely, if is the expression of the function in terms of the old coordinates, and if is the change-of-base formula, then is the expression of the same function in terms of the new coordinates. The fact that the change-of-basis formula expresses the old coordinates in terms of the new one may seem unnatural, but appears as useful, as no
matrix inversion In linear algebra, an invertible matrix (''non-singular'', ''non-degenarate'' or ''regular'') is a square matrix that has an inverse. In other words, if some other matrix is multiplied by the invertible matrix, the result can be multiplied by an ...
is needed here. As the change-of-basis formula involves only
linear function In mathematics, the term linear function refers to two distinct but related notions: * In calculus and related areas, a linear function is a function whose graph is a straight line, that is, a polynomial function of degree zero or one. For di ...
s, many function properties are kept by a change of basis. This allows defining these properties as properties of functions of a variable vector that are not related to any specific basis. So, a function whose domain is a vector space or a subset of it is * a linear function, * a
polynomial function In mathematics, a polynomial is a mathematical expression consisting of indeterminates (also called variables) and coefficients, that involves only the operations of addition, subtraction, multiplication and exponentiation to nonnegative int ...
, * a
continuous function In mathematics, a continuous function is a function such that a small variation of the argument induces a small variation of the value of the function. This implies there are no abrupt changes in value, known as '' discontinuities''. More preci ...
, * a
differentiable function In mathematics, a differentiable function of one real variable is a function whose derivative exists at each point in its domain. In other words, the graph of a differentiable function has a non- vertical tangent line at each interior point in ...
, * a
smooth function In mathematical analysis, the smoothness of a function is a property measured by the number of continuous derivatives (''differentiability class)'' it has over its domain. A function of class C^k is a function of smoothness at least ; t ...
, * an
analytic function In mathematics, an analytic function is a function that is locally given by a convergent power series. There exist both real analytic functions and complex analytic functions. Functions of each type are infinitely differentiable, but complex ...
, if the multivariate function that represents it on some basis—and thus on every basis—has the same property. This is specially useful in the theory of
manifold In mathematics, a manifold is a topological space that locally resembles Euclidean space near each point. More precisely, an n-dimensional manifold, or ''n-manifold'' for short, is a topological space with the property that each point has a N ...
s, as this allows extending the concepts of continuous, differentiable, smooth and analytic functions to functions that are defined on a manifold.


Linear maps

Consider a
linear map In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping V \to W between two vector spaces that p ...
from a
vector space In mathematics and physics, a vector space (also called a linear space) is a set (mathematics), set whose elements, often called vector (mathematics and physics), ''vectors'', can be added together and multiplied ("scaled") by numbers called sc ...
of dimension to a vector space of dimension . It is represented on "old" bases of and by a matrix . A change of bases is defined by an change-of-basis matrix for , and an change-of-basis matrix for . On the "new" bases, the matrix of is :P^MQ. This is a straightforward consequence of the change-of-basis formula.


Endomorphisms

Endomorphism In mathematics, an endomorphism is a morphism from a mathematical object to itself. An endomorphism that is also an isomorphism is an automorphism. For example, an endomorphism of a vector space is a linear map , and an endomorphism of a g ...
s are linear maps from a vector space to itself. For a change of basis, the formula of the preceding section applies, with the same change-of-basis matrix on both sides of the formula. That is, if is the
square matrix In mathematics, a square matrix is a Matrix (mathematics), matrix with the same number of rows and columns. An ''n''-by-''n'' matrix is known as a square matrix of order Any two square matrices of the same order can be added and multiplied. Squ ...
of an endomorphism of over an "old" basis, and is a change-of-basis matrix, then the matrix of the endomorphism on the "new" basis is :P^MP. As every
invertible matrix In linear algebra, an invertible matrix (''non-singular'', ''non-degenarate'' or ''regular'') is a square matrix that has an inverse. In other words, if some other matrix is multiplied by the invertible matrix, the result can be multiplied by a ...
can be used as a change-of-basis matrix, this implies that two matrices are similar if and only if they represent the same endomorphism on two different bases.


Bilinear forms

A ''
bilinear form In mathematics, a bilinear form is a bilinear map on a vector space (the elements of which are called '' vectors'') over a field ''K'' (the elements of which are called '' scalars''). In other words, a bilinear form is a function that is linea ...
'' on a vector space ''V'' over a field is a function which is
linear In mathematics, the term ''linear'' is used in two distinct senses for two different properties: * linearity of a '' function'' (or '' mapping''); * linearity of a '' polynomial''. An example of a linear function is the function defined by f(x) ...
in both arguments. That is, is bilinear if the maps v \mapsto B(v, w) and v \mapsto B(w, v) are linear for every fixed w\in V. The matrix of a bilinear form on a basis (v_1, \ldots, v_n) (the "old" basis in what follows) is the matrix whose entry of the th row and th column is B(v_i, v_j). It follows that if and are the column vectors of the coordinates of two vectors and , one has :B(v, w)=\mathbf v^\mathbf B\mathbf w, where \mathbf v^ denotes the
transpose In linear algebra, the transpose of a Matrix (mathematics), matrix is an operator which flips a matrix over its diagonal; that is, it switches the row and column indices of the matrix by producing another matrix, often denoted by (among other ...
of the matrix . If is a change of basis matrix, then a straightforward computation shows that the matrix of the bilinear form on the new basis is :P^\mathbf B P. A
symmetric bilinear form In mathematics, a symmetric bilinear form on a vector space is a bilinear map from two copies of the vector space to the field of scalars such that the order of the two vectors does not affect the value of the map. In other words, it is a biline ...
is a bilinear form such that B(v,w)=B(w,v) for every and in . It follows that the matrix of on any basis is
symmetric Symmetry () in everyday life refers to a sense of harmonious and beautiful proportion and balance. In mathematics, the term has a more precise definition and is usually used to refer to an object that is invariant under some transformations ...
. This implies that the property of being a symmetric matrix must be kept by the above change-of-base formula. One can also check this by noting that the transpose of a matrix product is the product of the transposes computed in the reverse order. In particular, :(P^\mathbf B P)^ = P^\mathbf B^ P, and the two members of this equation equal P^ \mathbf B P if the matrix is symmetric. If the characteristic of the ground field is not two, then for every symmetric bilinear form there is a basis for which the matrix is
diagonal In geometry, a diagonal is a line segment joining two vertices of a polygon or polyhedron, when those vertices are not on the same edge. Informally, any sloping line is called diagonal. The word ''diagonal'' derives from the ancient Greek � ...
. Moreover, the resulting nonzero entries on the diagonal are defined up to the multiplication by a square. So, if the ground field is the field \mathbb R of the
real number In mathematics, a real number is a number that can be used to measure a continuous one- dimensional quantity such as a duration or temperature. Here, ''continuous'' means that pairs of values can have arbitrarily small differences. Every re ...
s, these nonzero entries can be chosen to be either or .
Sylvester's law of inertia Sylvester's law of inertia is a theorem in matrix algebra about certain properties of the coefficient matrix of a real quadratic form that remain invariant under a change of basis. Namely, if A is a symmetric matrix, then for any invertible matr ...
is a theorem that asserts that the numbers of and of depends only on the bilinear form, and not of the change of basis. Symmetric bilinear forms over the reals are often encountered in
geometry Geometry (; ) is a branch of mathematics concerned with properties of space such as the distance, shape, size, and relative position of figures. Geometry is, along with arithmetic, one of the oldest branches of mathematics. A mathematician w ...
and
physics Physics is the scientific study of matter, its Elementary particle, fundamental constituents, its motion and behavior through space and time, and the related entities of energy and force. "Physical science is that department of knowledge whi ...
, typically in the study of
quadric In mathematics, a quadric or quadric surface is a generalization of conic sections (ellipses, parabolas, and hyperbolas). In three-dimensional space, quadrics include ellipsoids, paraboloids, and hyperboloids. More generally, a quadric hype ...
s and of the
inertia Inertia is the natural tendency of objects in motion to stay in motion and objects at rest to stay at rest, unless a force causes the velocity to change. It is one of the fundamental principles in classical physics, and described by Isaac Newto ...
of a
rigid body In physics, a rigid body, also known as a rigid object, is a solid body in which deformation is zero or negligible, when a deforming pressure or deforming force is applied on it. The distance between any two given points on a rigid body rema ...
. In these cases,
orthonormal bases In mathematics, particularly linear algebra, an orthonormal basis for an inner product space V with finite dimension is a basis for V whose vectors are orthonormal, that is, they are all unit vectors and orthogonal to each other. For example, th ...
are specially useful; this means that one generally prefer to restrict changes of basis to those that have an
orthogonal In mathematics, orthogonality (mathematics), orthogonality is the generalization of the geometric notion of ''perpendicularity''. Although many authors use the two terms ''perpendicular'' and ''orthogonal'' interchangeably, the term ''perpendic ...
change-of-base matrix, that is, a matrix such that P^=P^. Such matrices have the fundamental property that the change-of-base formula is the same for a symmetric bilinear form and the endomorphism that is represented by the same symmetric matrix. The
Spectral theorem In linear algebra and functional analysis, a spectral theorem is a result about when a linear operator or matrix can be diagonalized (that is, represented as a diagonal matrix in some basis). This is extremely useful because computations involvin ...
asserts that, given such a symmetric matrix, there is an orthogonal change of basis such that the resulting matrix (of both the bilinear form and the endomorphism) is a diagonal matrix with the
eigenvalues In linear algebra, an eigenvector ( ) or characteristic vector is a vector that has its direction unchanged (or reversed) by a given linear transformation. More precisely, an eigenvector \mathbf v of a linear transformation T is scaled by a ...
of the initial matrix on the diagonal. It follows that, over the reals, if the matrix of an endomorphism is symmetric, then it is
diagonalizable In linear algebra, a square matrix A is called diagonalizable or non-defective if it is similar to a diagonal matrix. That is, if there exists an invertible matrix P and a diagonal matrix D such that . This is equivalent to (Such D are not ...
.


See also

*
Active and passive transformation Geometric transformations can be distinguished into two types: active or alibi transformations which change the physical position of a set of points relative to a fixed frame of reference or coordinate system ('' alibi'' meaning "being somewhe ...
*
Covariance and contravariance of vectors In physics, especially in multilinear algebra and tensor analysis, covariance and contravariance describe how the quantitative description of certain geometric or physical entities changes with a change of basis. Briefly, a contravariant vecto ...
*
Integral transform In mathematics, an integral transform is a type of transform that maps a function from its original function space into another function space via integration, where some of the properties of the original function might be more easily charac ...
, the continuous analogue of change of basis. * Chirgwin-Coulson weights — application in computational chemistry


Notes


References


Bibliography

* * *


External links


MIT Linear Algebra Lecture on Change of Basis
from MIT OpenCourseWare
Khan Academy Lecture on Change of Basis
from Khan Academy {{Authority control Linear algebra Matrix theory