In
mathematical analysis
Analysis is the branch of mathematics dealing with continuous functions, limit (mathematics), limits, and related theories, such as Derivative, differentiation, Integral, integration, measure (mathematics), measure, infinite sequences, series (m ...
, the Weierstrass approximation theorem states that every
continuous function
In mathematics, a continuous function is a function such that a continuous variation (that is a change without jump) of the argument induces a continuous variation of the value of the function. This means that there are no abrupt changes in value ...
defined on a closed
interval can be
uniformly approximated as closely as desired by a
polynomial
In mathematics, a polynomial is an expression consisting of indeterminates (also called variables) and coefficients, that involves only the operations of addition, subtraction, multiplication, and positive-integer powers of variables. An exa ...
function. Because polynomials are among the simplest functions, and because computers can directly evaluate polynomials, this theorem has both practical and theoretical relevance, especially in
polynomial interpolation
In numerical analysis, polynomial interpolation is the interpolation of a given data set by the polynomial of lowest possible degree that passes through the points of the dataset.
Given a set of data points (x_0,y_0), \ldots, (x_n,y_n), with no ...
. The original version of this result was established by
Karl Weierstrass
Karl Theodor Wilhelm Weierstrass (german: link=no, Weierstraß ; 31 October 1815 – 19 February 1897) was a German mathematician often cited as the "father of modern analysis". Despite leaving university without a degree, he studied mathematics ...
in
1885
Events
January–March
* January 3– 4 – Sino-French War – Battle of Núi Bop: French troops under General Oscar de Négrier defeat a numerically superior Qing Chinese force, in northern Vietnam.
* January 4 – ...
using the
Weierstrass transform
In mathematics, the Weierstrass transform of a function , named after Karl Weierstrass, is a "smoothed" version of obtained by averaging the values of , weighted with a Gaussian centered at ''x''.
Specifically, it is the function defined ...
.
Marshall H. Stone
Marshall Harvey Stone (April 8, 1903 – January 9, 1989) was an American mathematician who contributed to real analysis, functional analysis, topology and the study of Boolean algebras.
Biography
Stone was the son of Harlan Fiske Stone, who wa ...
considerably generalized the theorem and simplified the proof . His result is known as the Stone–Weierstrass theorem. The Stone–Weierstrass theorem generalizes the Weierstrass approximation theorem in two directions: instead of the real interval , an arbitrary
compact
Compact as used in politics may refer broadly to a pact or treaty; in more specific cases it may refer to:
* Interstate compact
* Blood compact, an ancient ritual of the Philippines
* Compact government, a type of colonial rule utilized in British ...
Hausdorff space
In topology and related branches of mathematics, a Hausdorff space ( , ), separated space or T2 space is a topological space where, for any two distinct points, there exist neighbourhoods of each which are disjoint from each other. Of the many ...
is considered, and instead of the
algebra
Algebra () is one of the broad areas of mathematics. Roughly speaking, algebra is the study of mathematical symbols and the rules for manipulating these symbols in formulas; it is a unifying thread of almost all of mathematics.
Elementary a ...
of polynomial functions, a variety of other families of continuous functions on
are shown to suffice, as is
detailed below. The Stone–Weierstrass theorem is a vital result in the study of the algebra of
continuous functions on a compact Hausdorff space In mathematical analysis, and especially functional analysis, a fundamental role is played by the space of continuous functions on a compact Hausdorff space X with values in the real or complex numbers. This space, denoted by \mathcal(X), is a vec ...
.
Further, there is a generalization of the Stone–Weierstrass theorem to noncompact
Tychonoff space
In topology and related branches of mathematics, Tychonoff spaces and completely regular spaces are kinds of topological spaces. These conditions are examples of separation axioms. A Tychonoff space refers to any completely regular space that is ...
s, namely, any continuous function on a Tychonoff space is approximated
uniformly on compact sets by algebras of the type appearing in the Stone–Weierstrass theorem and described below.
A different generalization of Weierstrass' original theorem is
Mergelyan's theorem Mergelyan's theorem is a result from approximation by polynomials in complex analysis proved by the Armenian mathematician Sergei Mergelyan in 1951.
Statement
:Let ''K'' be a compact subset of the complex plane C such that C∖''K'' is conne ...
, which generalizes it to functions defined on certain subsets of the
complex plane
In mathematics, the complex plane is the plane formed by the complex numbers, with a Cartesian coordinate system such that the -axis, called the real axis, is formed by the real numbers, and the -axis, called the imaginary axis, is formed by the ...
.
Weierstrass approximation theorem
The statement of the approximation theorem as originally discovered by Weierstrass is as follows:
A constructive proof of this theorem using
Bernstein polynomial
In the mathematical field of numerical analysis, a Bernstein polynomial is a polynomial that is a linear combination of Bernstein basis polynomials. The idea is named after Sergei Natanovich Bernstein.
A numerically stable way to evaluate polyn ...
s is outlined on that page.
Applications
As a consequence of the Weierstrass approximation theorem, one can show that the space is
separable: the polynomial functions are dense, and each polynomial function can be uniformly approximated by one with
rational
Rationality is the quality of being guided by or based on reasons. In this regard, a person acts rationally if they have a good reason for what they do or a belief is rational if it is based on strong evidence. This quality can apply to an abili ...
coefficients; there are only
countably many
In mathematics, a set is countable if either it is finite or it can be made in one to one correspondence with the set of natural numbers. Equivalently, a set is ''countable'' if there exists an injective function from it into the natural number ...
polynomials with rational coefficients. Since is
metrizable
In topology and related areas of mathematics, a metrizable space is a topological space that is homeomorphic to a metric space. That is, a topological space (X, \mathcal) is said to be metrizable if there is a metric d : X \times X \to , \infty) ...
and separable it follows that has
cardinality
In mathematics, the cardinality of a set is a measure of the number of elements of the set. For example, the set A = \ contains 3 elements, and therefore A has a cardinality of 3. Beginning in the late 19th century, this concept was generalized ...
at most . (Remark: This cardinality result also follows from the fact that a continuous function on the reals is uniquely determined by its restriction to the rationals.)
Stone–Weierstrass theorem, real version
The set of continuous real-valued functions on , together with the supremum norm , is a
Banach algebra
In mathematics, especially functional analysis, a Banach algebra, named after Stefan Banach, is an associative algebra A over the real or complex numbers (or over a non-Archimedean complete normed field) that at the same time is also a Banach spa ...
, (that is, an
associative algebra
In mathematics, an associative algebra ''A'' is an algebraic structure with compatible operations of addition, multiplication (assumed to be associative), and a scalar multiplication by elements in some field ''K''. The addition and multiplic ...
and a
Banach space
In mathematics, more specifically in functional analysis, a Banach space (pronounced ) is a complete normed vector space. Thus, a Banach space is a vector space with a metric that allows the computation of vector length and distance between vector ...
such that for all ). The set of all polynomial functions forms a subalgebra of (that is, a
vector subspace
In mathematics, and more specifically in linear algebra, a linear subspace, also known as a vector subspaceThe term ''linear subspace'' is sometimes used for referring to flats and affine subspaces. In the case of vector spaces over the reals, li ...
of that is closed under multiplication of functions), and the content of the Weierstrass approximation theorem is that this subalgebra is
dense
Density (volumetric mass density or specific mass) is the substance's mass per unit of volume. The symbol most often used for density is ''ρ'' (the lower case Greek letter rho), although the Latin letter ''D'' can also be used. Mathematically ...
in .
Stone starts with an arbitrary compact Hausdorff space and considers the algebra of real-valued continuous functions on , with the topology of
uniform convergence
In the mathematical field of analysis, uniform convergence is a mode of convergence of functions stronger than pointwise convergence. A sequence of functions (f_n) converges uniformly to a limiting function f on a set E if, given any arbitrarily s ...
. He wants to find subalgebras of which are dense. It turns out that the crucial property that a subalgebra must satisfy is that it ''
separates points
''Separates'' is the second album by English punk rock band 999, released in 1978. ''Separates'' was released in the United States under the title ''High Energy Plan'', with a different cover and slightly altered track listing; on ''High Energ ...
'': a set of functions defined on is said to separate points if, for every two different points and in there exists a function in with . Now we may state:
This implies Weierstrass' original statement since the polynomials on form a subalgebra of which contains the constants and separates points.
Locally compact version
A version of the Stone–Weierstrass theorem is also true when is only
locally compact In topology and related branches of mathematics, a topological space is called locally compact if, roughly speaking, each small portion of the space looks like a small portion of a compact space. More precisely, it is a topological space in which ev ...
. Let be the space of real-valued continuous functions on that
vanish at infinity In mathematics, a function is said to vanish at infinity if its values approach 0 as the input grows without bounds. There are two different ways to define this with one definition applying to functions defined on normed vector spaces and the other ...
; that is, a continuous function is in if, for every , there exists a compact set such that on . Again, is a
Banach algebra
In mathematics, especially functional analysis, a Banach algebra, named after Stefan Banach, is an associative algebra A over the real or complex numbers (or over a non-Archimedean complete normed field) that at the same time is also a Banach spa ...
with the
supremum norm
In mathematical analysis, the uniform norm (or ) assigns to real- or complex-valued bounded functions defined on a set the non-negative number
:\, f\, _\infty = \, f\, _ = \sup\left\.
This norm is also called the , the , the , or, when the ...
. A subalgebra of is said to vanish nowhere if not all of the elements of simultaneously vanish at a point; that is, for every in , there is some in such that . The theorem generalizes as follows:
This version clearly implies the previous version in the case when is compact, since in that case . There are also more general versions of the Stone–Weierstrass that weaken the assumption of local compactness.
Applications
The Stone–Weierstrass theorem can be used to prove the following two statements, which go beyond Weierstrass's result.
* If is a continuous real-valued function defined on the set and , then there exists a polynomial function in two variables such that for all in and in .
* If and are two compact Hausdorff spaces and is a continuous function, then for every there exist and continuous functions on and continuous functions on such that .
The theorem has many other applications to analysis, including:
*
Fourier series
A Fourier series () is a summation of harmonically related sinusoidal functions, also known as components or harmonics. The result of the summation is a periodic function whose functional form is determined by the choices of cycle length (or ''p ...
: The set of linear combinations of functions is dense in , where we identify the endpoints of the interval to obtain a circle. An important consequence of this is that the are an
orthonormal basis
In mathematics, particularly linear algebra, an orthonormal basis for an inner product space ''V'' with finite dimension is a basis for V whose vectors are orthonormal, that is, they are all unit vectors and orthogonal to each other. For example, ...
of the space
of
square-integrable function
In mathematics, a square-integrable function, also called a quadratically integrable function or L^2 function or square-summable function, is a real- or complex-valued measurable function for which the integral of the square of the absolute value i ...
s on .
Stone–Weierstrass theorem, complex version
Slightly more general is the following theorem, where we consider the algebra
of complex-valued continuous functions on the compact space
, again with the topology of uniform convergence. This is a
C*-algebra
In mathematics, specifically in functional analysis, a C∗-algebra (pronounced "C-star") is a Banach algebra together with an involution satisfying the properties of the adjoint. A particular case is that of a complex algebra ''A'' of continuous ...
with the *-operation given by pointwise
complex conjugation
In mathematics, the complex conjugate of a complex number is the number with an equal real part and an imaginary part equal in magnitude but opposite in sign. That is, (if a and b are real, then) the complex conjugate of a + bi is equal to a - ...
.
The complex unital *-algebra generated by
consists of all those functions that can be obtained from the elements of
by throwing in the constant function and adding them, multiplying them, conjugating them, or multiplying them with complex scalars, and repeating finitely many times.
This theorem implies the real version, because if a net of complex-valued functions uniformly approximates a given function,
, then the real parts of those functions uniformly approximate the real part of that function,
, and because for real subsets,
taking the real parts of the generated complex unital (selfadjoint) algebra agrees with the generated real unital algebra generated.
As in the real case, an analog of this theorem is true for locally compact Hausdorff spaces.
Stone–Weierstrass theorem, quaternion version
Following , consider the algebra of quaternion-valued continuous functions on the compact space , again with the topology of uniform convergence.
If a quaternion is written in the form
*its scalar part is the real number
.
Likewise
*the scalar part of is which is the real number
.
*the scalar part of is which is the real number
.
*the scalar part of is which is the real number
.
Then we may state:
Stone–Weierstrass theorem, C*-algebra version
The space of complex-valued continuous functions on a compact Hausdorff space
i.e.
is the canonical example of a unital
commutative C*-algebra . The space ''X'' may be viewed as the space of pure states on
, with the weak-* topology. Following the above cue, a non-commutative extension of the Stone–Weierstrass theorem, which remains unsolved, is as follows:
In 1960, Jim Glimm proved a weaker version of the above conjecture.
Lattice versions
Let be a compact Hausdorff space. Stone's original proof of the theorem used the idea of
lattices in . A subset of is called a
lattice
Lattice may refer to:
Arts and design
* Latticework, an ornamental criss-crossed framework, an arrangement of crossing laths or other thin strips of material
* Lattice (music), an organized grid model of pitch ratios
* Lattice (pastry), an orna ...
if for any two elements , the functions also belong to . The lattice version of the Stone–Weierstrass theorem states:
The above versions of Stone–Weierstrass can be proven from this version once one realizes that the lattice property can also be formulated using the
absolute value
In mathematics, the absolute value or modulus of a real number x, is the non-negative value without regard to its sign. Namely, , x, =x if is a positive number, and , x, =-x if x is negative (in which case negating x makes -x positive), an ...
which in turn can be approximated by polynomials in . A variant of the theorem applies to linear subspaces of closed under max :
More precise information is available:
:Suppose is a compact Hausdorff space with at least two points and is a lattice in . The function belongs to the
closure of if and only if for each pair of distinct points ''x'' and ''y'' in and for each there exists some for which and .
Bishop's theorem
Another generalization of the Stone–Weierstrass theorem is due to
Errett Bishop
Errett Albert Bishop (July 14, 1928 – April 14, 1983) was an Americans, American mathematician known for his work on analysis. He expanded constructive analysis in his 1967 ''Foundations of Constructive Analysis'', where he Mathematical proof, p ...
. Bishop's theorem is as follows :
gives a short proof of Bishop's theorem using the
Krein–Milman theorem
In the mathematical theory of functional analysis, the Krein–Milman theorem is a proposition about compact convex sets in locally convex topological vector spaces (TVSs).
This theorem generalizes to infinite-dimensional spaces and to arbitrar ...
in an essential way, as well as the
Hahn–Banach theorem
The Hahn–Banach theorem is a central tool in functional analysis.
It allows the extension of bounded linear functionals defined on a subspace of some vector space to the whole space, and it also shows that there are "enough" continuous linear f ...
: the process of . See also .
Nachbin's theorem
Nachbin's theorem gives an analog for Stone–Weierstrass theorem for algebras of complex valued smooth functions on a smooth manifold . Nachbin's theorem is as follows :
Editorial history
In 1885 it was also published an English version of the paper whose title was ''On the possibility of giving an analytic representation to an arbitrary function of real variable''.
According to the mathematician
Yamilet Quintana, Weierstrass "suspected that any
analytic functions
In mathematics, an analytic function is a function that is locally given by a convergent power series. There exist both real analytic functions and complex analytic functions. Functions of each type are infinitely differentiable, but complex a ...
could be represented by
power series
In mathematics, a power series (in one variable) is an infinite series of the form
\sum_^\infty a_n \left(x - c\right)^n = a_0 + a_1 (x - c) + a_2 (x - c)^2 + \dots
where ''an'' represents the coefficient of the ''n''th term and ''c'' is a const ...
".
[ (arXiv 0611034v3). Citing: D. S. Lubinsky, ''Weierstrass' Theorem in the twentieth century: a selection'', in ''Quaestiones Mathematicae''18 (1995), 91–130.][ (arXiv 0611038v2).]
See also
*
Müntz–Szász theorem
*
Bernstein polynomial
In the mathematical field of numerical analysis, a Bernstein polynomial is a polynomial that is a linear combination of Bernstein basis polynomials. The idea is named after Sergei Natanovich Bernstein.
A numerically stable way to evaluate polyn ...
*
Runge's phenomenon
In the mathematical field of numerical analysis, Runge's phenomenon () is a problem of oscillation at the edges of an interval that occurs when using polynomial interpolation with polynomials of high degree over a set of equispaced interpolation ...
shows that finding a polynomial such that for some finely spaced is a bad way to attempt to find a polynomial approximating uniformly. A better approach, explained e.g. in , p. 160, eq. (51) ff., is to construct polynomials uniformly approximating by taking the convolution of with a family of suitably chosen polynomial kernels.
*
Mergelyan's theorem Mergelyan's theorem is a result from approximation by polynomials in complex analysis proved by the Armenian mathematician Sergei Mergelyan in 1951.
Statement
:Let ''K'' be a compact subset of the complex plane C such that C∖''K'' is conne ...
, concerning polynomial approximations of complex functions.
Notes
References
* .
* .
*
Jan Brinkhuis
Jan Brinkhuis (born 1952) is a Dutch mathematician, and Associate Professor of Finance and Mathematical Methods and Techniques at the Econometric Institute of Erasmus University Rotterdam, specialized in the theory and application of optimization t ...
& Vladimir Tikhomirov (2005) ''Optimization: Insights and Applications'',
Princeton University Press
Princeton University Press is an independent publisher with close connections to Princeton University. Its mission is to disseminate scholarship within academia and society at large.
The press was founded by Whitney Darrow, with the financial su ...
.
*
* .
* .
* .
* .
* .
*
*
* .
Historical works
The historical publication of Weierstrass (in
German language
German ( ) is a West Germanic languages, West Germanic language mainly spoken in Central Europe. It is the most widely spoken and Official language, official or co-official language in Germany, Austria, Switzerland, Liechtenstein, and the Ita ...
) is freely available from the digital online archive of the
Berlin Brandenburgische Akademie der Wissenschaften':
* K. Weierstrass (1885). Über die analytische Darstellbarkeit sogenannter willkürlicher Functionen einer reellen Veränderlichen. ''Sitzungsberichte der Königlich Preußischen Akademie der Wissenschaften zu Berlin'', 1885 (II).
Erste Mitteilung(part 1) pp. 633–639
Zweite Mitteilung(part 2) pp. 789–805.
Important historical works of Stone include:
* .
* ; 21 (5), 237–254.
External links
*
{{DEFAULTSORT:Stone-Weierstrass Theorem
Theory of continuous functions
Theorems in analysis
Theorems in approximation theory
1885 in mathematics
1937 in mathematics