HOME

TheInfoList



OR:

In the
mathematical Mathematics is an area of knowledge that includes the topics of numbers, formulas and related structures, shapes and the spaces in which they are contained, and quantities and their changes. These topics are represented in modern mathematics ...
fields of
linear algebra Linear algebra is the branch of mathematics concerning linear equations such as: :a_1x_1+\cdots +a_nx_n=b, linear maps such as: :(x_1, \ldots, x_n) \mapsto a_1x_1+\cdots +a_nx_n, and their representations in vector spaces and through matrices. ...
and
functional analysis Functional analysis is a branch of mathematical analysis, the core of which is formed by the study of vector spaces endowed with some kind of limit-related structure (e.g. Inner product space#Definition, inner product, Norm (mathematics)#Defini ...
, the orthogonal complement of a subspace ''W'' of a
vector space In mathematics and physics, a vector space (also called a linear space) is a set whose elements, often called ''vectors'', may be added together and multiplied ("scaled") by numbers called '' scalars''. Scalars are often real numbers, but can ...
''V'' equipped with a
bilinear form In mathematics, a bilinear form is a bilinear map on a vector space (the elements of which are called '' vectors'') over a field ''K'' (the elements of which are called ''scalars''). In other words, a bilinear form is a function that is linear i ...
''B'' is the set ''W'' of all vectors in ''V'' that are
orthogonal In mathematics, orthogonality is the generalization of the geometric notion of ''perpendicularity''. By extension, orthogonality is also used to refer to the separation of specific features of a system. The term also has specialized meanings in ...
to every vector in ''W''. Informally, it is called the perp, short for perpendicular complement. It is a subspace of ''V''.


Example

Let V = (\R^5, \langle \cdot, \cdot \rangle) be the vector space equipped with the usual
dot product In mathematics, the dot product or scalar productThe term ''scalar product'' means literally "product with a scalar as a result". It is also used sometimes for other symmetric bilinear forms, for example in a pseudo-Euclidean space. is an algebra ...
\langle \cdot, \cdot \rangle (thus making it an
inner product space In mathematics, an inner product space (or, rarely, a Hausdorff pre-Hilbert space) is a real vector space or a complex vector space with an operation called an inner product. The inner product of two vectors in the space is a scalar, often den ...
), and let W = \, with A = \begin 1 & 0\\ 0 & 1\\ 2 & 6\\ 3 & 9\\ 5 & 3\\ \end. then its orthogonal complement W^\perp = \ can also be defined as W^\perp = \, being \tilde = \begin -2 & -3 & -5 \\ -6 & -9 & -3 \\ 1 & 0 & 0 \\ 0 & 1 & 0 \\ 0 & 0 & 1 \end. The fact that every column vector in A is orthogonal to every column vector in \tilde can be checked by direct computation. The fact that the spans of these vectors are orthogonal then follows by bilinearity of the dot product. Finally, the fact that these spaces are orthogonal complements follows from the dimension relationships given below.


General bilinear forms

Let V be a vector space over a field F equipped with a
bilinear form In mathematics, a bilinear form is a bilinear map on a vector space (the elements of which are called '' vectors'') over a field ''K'' (the elements of which are called ''scalars''). In other words, a bilinear form is a function that is linear i ...
B. We define u to be left-orthogonal to v, and v to be right-orthogonal to u, when B(u,v) = 0. For a subset W of V, define the left orthogonal complement W^\bot to be W^\bot = \left\. There is a corresponding definition of right orthogonal complement. For a
reflexive bilinear form In mathematics, a bilinear form is a bilinear map on a vector space (the elements of which are called '' vectors'') over a field ''K'' (the elements of which are called '' scalars''). In other words, a bilinear form is a function that is linear ...
, where B(u,v) = 0 implies B(v,u) = 0 for all u and v in V, the left and right complements coincide. This will be the case if B is a
symmetric Symmetry (from grc, συμμετρία "agreement in dimensions, due proportion, arrangement") in everyday language refers to a sense of harmonious and beautiful proportion and balance. In mathematics, "symmetry" has a more precise definiti ...
or an
alternating form In mathematics, the exterior algebra, or Grassmann algebra, named after Hermann Grassmann, is an algebra that uses the exterior product or wedge product as its multiplication. In mathematics, the exterior product or wedge product of vectors is a ...
. The definition extends to a bilinear form on a
free module In mathematics, a free module is a module that has a basis – that is, a generating set consisting of linearly independent elements. Every vector space is a free module, but, if the ring of the coefficients is not a division ring (not a field in t ...
over a
commutative ring In mathematics, a commutative ring is a ring in which the multiplication operation is commutative. The study of commutative rings is called commutative algebra. Complementarily, noncommutative algebra is the study of ring properties that are not sp ...
, and to a
sesquilinear form In mathematics, a sesquilinear form is a generalization of a bilinear form that, in turn, is a generalization of the concept of the dot product of Euclidean space. A bilinear form is linear in each of its arguments, but a sesquilinear form allows o ...
extended to include any free module over a commutative ring with
conjugation Conjugation or conjugate may refer to: Linguistics * Grammatical conjugation, the modification of a verb from its basic form * Emotive conjugation or Russell's conjugation, the use of loaded language Mathematics * Complex conjugation, the chang ...
.


Properties

* An orthogonal complement is a subspace of V; * If X \subseteq Y then X^\bot \supseteq Y^\bot; * The radical V^\bot of V is a subspace of every orthogonal complement; * W \subseteq (W^\bot)^\bot; * If B is
non-degenerate In mathematics, specifically linear algebra, a degenerate bilinear form on a vector space ''V'' is a bilinear form such that the map from ''V'' to ''V''∗ (the dual space of ''V'' ) given by is not an isomorphism. An equivalent defin ...
and V is finite-dimensional, then \dim(W)+\dim (W^\bot)=\dim V. * If L_1, \ldots, L_r are subspaces of a finite-dimensional space V and L_* = L_1 \cap \cdots \cap L_r, then L_*^\bot = L_1^\bot + \cdots + L_r^\bot.


Inner product spaces

This section considers orthogonal complements in an
inner product space In mathematics, an inner product space (or, rarely, a Hausdorff pre-Hilbert space) is a real vector space or a complex vector space with an operation called an inner product. The inner product of two vectors in the space is a scalar, often den ...
H. Two vectors x and y are called if \langle x, y \rangle = 0, which happens if and only if \, x\, \leq \, x + s y\, for all scalars s. If C is any subset of an inner product space H then its is the vector subspace \begin C^\bot :&= \ \\ &= \ \end which is always a closed subset of HIf C = \varnothing then C^ = H, which is closed in H so assume C \neq \varnothing. Let P := \prod_ \mathbb where \mathbb is the underlying scalar field of H and define L : H \to P by L(h) := \left(\langle h, c \rangle\right)_, which is continuous because this is true of each of its coordinates h \mapsto \langle h, c \rangle. Then C^ = L^(0) = L^\left(\\right) is closed in H because \ is closed in P and L : H \to P is continuous. If \langle \,\cdot\,, \,\cdot\, \rangle is linear in its first (respectively, its second) coordinate then L : H \to P is a
linear map In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a Map (mathematics), mapping V \to W between two vect ...
(resp. an
antilinear map In mathematics, a function f : V \to W between two complex vector spaces is said to be antilinear or conjugate-linear if \begin f(x + y) &= f(x) + f(y) && \qquad \text \\ f(s x) &= \overline f(x) && \qquad \text \\ \end hold for all vectors x, y ...
); either way, its kernel \operatorname L = L^(0) = C^ is a vector subspace of H. Q.E.D.
that satisfies C^ = \left(\operatorname_H \left(\operatorname C\right)\right)^ and if C \neq \varnothing then also C^ \cap \operatorname_H \left(\operatorname C\right) = \ and \operatorname_H \left(\operatorname C\right) \subseteq \left(C^\right)^. If C is a vector subspace of an inner product space H then C^ = \left\. If C is a closed vector subspace of a Hilbert space H then H = C \oplus C^ \qquad \text \qquad \left(C^\right)^ = C where H = C \oplus C^ is called the of H into C and C^ and it indicates that C is a
complemented subspace In the branch of mathematics called functional analysis, a complemented subspace of a topological vector space X, is a vector subspace M for which there exists some other vector subspace N of X, called its (topological) complement in X, such that ...
of H with complement C^.


Properties

The orthogonal complement is always closed in the metric topology. In finite-dimensional spaces, that is merely an instance of the fact that all subspaces of a vector space are closed. In infinite-dimensional
Hilbert space In mathematics, Hilbert spaces (named after David Hilbert) allow generalizing the methods of linear algebra and calculus from (finite-dimensional) Euclidean vector spaces to spaces that may be infinite-dimensional. Hilbert spaces arise natural ...
s, some subspaces are not closed, but all orthogonal complements are closed. If W is a vector subspace of an
inner product space In mathematics, an inner product space (or, rarely, a Hausdorff pre-Hilbert space) is a real vector space or a complex vector space with an operation called an inner product. The inner product of two vectors in the space is a scalar, often den ...
the orthogonal complement of the orthogonal complement of W is the closure of W, that is, \left(W^\bot\right)^\bot = \overline W. Some other useful properties that always hold are the following. Let H be a Hilbert space and let X and Y be its linear subspaces. Then: * X^\bot = \overline^; * if Y \subseteq X then X^\bot \subseteq Y^\bot; * X \cap X^\bot = \; * X \subseteq (X^\bot)^\bot; * if X is a closed linear subspace of H then (X^\bot)^\bot = X; * if X is a closed linear subspace of H then H = X \oplus X^\bot, the (inner) direct sum. The orthogonal complement generalizes to the annihilator, and gives a Galois connection on subsets of the inner product space, with associated
closure operator In mathematics, a closure operator on a set ''S'' is a function \operatorname: \mathcal(S)\rightarrow \mathcal(S) from the power set of ''S'' to itself that satisfies the following conditions for all sets X,Y\subseteq S : Closure operators are de ...
the topological closure of the span.


Finite dimensions

For a finite-dimensional inner product space of dimension n, the orthogonal complement of a k-dimensional subspace is an (n-k)-dimensional subspace, and the double orthogonal complement is the original subspace: \left(W^\right)^ = W. If A is an m \times n matrix, where \operatorname A, \operatorname A, and \operatorname A refer to the
row space Row or ROW may refer to: Exercise *Rowing, or a form of aquatic movement using oars *Row (weight-lifting), a form of weight-lifting exercise Math *Row vector, a 1 × ''n'' matrix in linear algebra. *Row (database), a single, implicitly structured ...
,
column space In linear algebra, the column space (also called the range or image) of a matrix ''A'' is the span (set of all possible linear combinations) of its column vectors. The column space of a matrix is the image or range of the corresponding mat ...
, and
null space In mathematics, the kernel of a linear map, also known as the null space or nullspace, is the linear subspace of the Domain of a function, domain of the map which is mapped to the zero vector. That is, given a linear map between two vector space ...
of A (respectively), then"Orthogonal Complement"
/ref> \left(\operatorname A\right)^ = \operatorname A \qquad \text \qquad \left(\operatorname A\right)^ = \operatorname A^.


Banach spaces

There is a natural analog of this notion in general
Banach space In mathematics, more specifically in functional analysis, a Banach space (pronounced ) is a complete normed vector space. Thus, a Banach space is a vector space with a metric that allows the computation of vector length and distance between vector ...
s. In this case one defines the orthogonal complement of ''W'' to be a subspace of the dual of ''V'' defined similarly as the annihilator W^\bot = \left\. It is always a closed subspace of ''V''. There is also an analog of the double complement property. ''W''⊥⊥ is now a subspace of ''V''∗∗ (which is not identical to ''V''). However, the
reflexive space In the area of mathematics known as functional analysis, a reflexive space is a locally convex topological vector space (TVS) for which the canonical evaluation map from X into its bidual (which is the strong dual of the strong dual of X) is an i ...
s have a
natural Nature, in the broadest sense, is the physical world or universe. "Nature" can refer to the phenomena of the physical world, and also to life in general. The study of nature is a large, if not the only, part of science. Although humans are ...
isomorphism In mathematics, an isomorphism is a structure-preserving mapping between two structures of the same type that can be reversed by an inverse mapping. Two mathematical structures are isomorphic if an isomorphism exists between them. The word is ...
''i'' between ''V'' and ''V''∗∗. In this case we have i\overline = W^. This is a rather straightforward consequence of the
Hahn–Banach theorem The Hahn–Banach theorem is a central tool in functional analysis. It allows the extension of bounded linear functionals defined on a subspace of some vector space to the whole space, and it also shows that there are "enough" continuous linear f ...
.


Applications

In
special relativity In physics, the special theory of relativity, or special relativity for short, is a scientific theory regarding the relationship between space and time. In Albert Einstein's original treatment, the theory is based on two postulates: # The laws o ...
the orthogonal complement is used to determine the simultaneous hyperplane at a point of a
world line The world line (or worldline) of an object is the path that an object traces in 4-dimensional spacetime. It is an important concept in modern physics, and particularly theoretical physics. The concept of a "world line" is distinguished from c ...
. The bilinear form η used in
Minkowski space In mathematical physics, Minkowski space (or Minkowski spacetime) () is a combination of three-dimensional Euclidean space and time into a four-dimensional manifold where the spacetime interval between any two events is independent of the inerti ...
determines a
pseudo-Euclidean space In mathematics and theoretical physics, a pseudo-Euclidean space is a finite-dimensional real -space together with a non- degenerate quadratic form . Such a quadratic form can, given a suitable choice of basis , be applied to a vector , giving q(x ...
of events. The origin and all events on the
light cone In special and general relativity, a light cone (or "null cone") is the path that a flash of light, emanating from a single event (localized to a single point in space and a single moment in time) and traveling in all directions, would take thro ...
are self-orthogonal. When a
time Time is the continued sequence of existence and events that occurs in an apparently irreversible succession from the past, through the present, into the future. It is a component quantity of various measurements used to sequence events, to ...
event and a
space Space is the boundless three-dimensional extent in which objects and events have relative position and direction. In classical physics, physical space is often conceived in three linear dimensions, although modern physicists usually consider ...
event evaluate to zero under the bilinear form, then they are
hyperbolic-orthogonal In geometry, the relation of hyperbolic orthogonality between two lines separated by the asymptotes of a hyperbola is a concept used in special relativity to define simultaneous events. Two events will be simultaneous when they are on a line hyperb ...
. This terminology stems from the use of two conjugate hyperbolas in the pseudo-Euclidean plane:
conjugate diameters In geometry, two diameters of a conic section are said to be conjugate if each chord (geometry), chord parallel (geometry), parallel to one diameter is bisection, bisected by the other diameter. For example, two diameters of a circle are conjugate ...
of these hyperbolas are hyperbolic-orthogonal.


See also

* * * *


Notes


References


Bibliography

* * * *


External links

* Orthogona
complement ; Minute 9.00 in the Youtube Video

Instructional video describing orthogonal complements (Khan Academy)
{{DEFAULTSORT:Orthogonal Complement Linear algebra Functional analysis