![Natural and sequency ordered Walsh 16](https://upload.wikimedia.org/wikipedia/commons/0/0b/Natural_and_sequency_ordered_Walsh_16.svg)
In
mathematics
Mathematics is an area of knowledge that includes the topics of numbers, formulas and related structures, shapes and the spaces in which they are contained, and quantities and their changes. These topics are represented in modern mathematics ...
, more specifically in
harmonic analysis
Harmonic analysis is a branch of mathematics concerned with the representation of Function (mathematics), functions or signals as the Superposition principle, superposition of basic waves, and the study of and generalization of the notions of Fo ...
, Walsh functions form a
complete orthogonal set of functions that can be used to represent any discrete function—just like
trigonometric function
In mathematics, the trigonometric functions (also called circular functions, angle functions or goniometric functions) are real functions which relate an angle of a right-angled triangle to ratios of two side lengths. They are widely used in all ...
s can be used to represent any continuous function in
Fourier analysis
In mathematics, Fourier analysis () is the study of the way general functions may be represented or approximated by sums of simpler trigonometric functions. Fourier analysis grew from the study of Fourier series, and is named after Josep ...
. They can thus be viewed as a discrete, digital counterpart of the continuous, analog system of trigonometric functions on the
unit interval
In mathematics, the unit interval is the closed interval , that is, the set of all real numbers that are greater than or equal to 0 and less than or equal to 1. It is often denoted ' (capital letter ). In addition to its role in real analysis, ...
. But unlike the sine and cosine functions, which are
continuous
Continuity or continuous may refer to:
Mathematics
* Continuity (mathematics), the opposing concept to discreteness; common examples include
** Continuous probability distribution or random variable in probability and statistics
** Continuous ...
, Walsh functions are piecewise constant. They take the values −1 and +1 only, on sub-intervals defined by
dyadic fractions.
The system of Walsh functions is known as the Walsh system. It is an extension of the
Rademacher system Rademacher is an occupational surname of German origin, which means "wheelmaker". It may refer to:
People
* Arthur Rademacher (1889–1981), Australian football player
*Autumn Rademacher (born 1975), American basketball coach
*Bill Rademacher (born ...
of orthogonal functions.
Walsh functions, the Walsh system, the Walsh series, and the
fast Walsh–Hadamard transform
In computational mathematics, the Hadamard ordered fast Walsh–Hadamard transform (FWHT''h'') is an efficient algorithm to compute the Walsh–Hadamard transform (WHT). A naive implementation of the WHT of order n = 2^m would have a computati ...
are all named after the American
mathematician
A mathematician is someone who uses an extensive knowledge of mathematics in their work, typically to solve mathematical problems.
Mathematicians are concerned with numbers, data, quantity, structure, space, models, and change.
History
On ...
Joseph L. Walsh
__NOTOC__
Joseph Leonard Walsh (September 21, 1895 – December 6, 1973) was an American mathematician who worked mainly in the field of analysis. The Walsh function and the Walsh–Hadamard code are named after him. The Grace–Walsh–Szegő ...
. They find various applications in physics and engineering when
analyzing digital signals.
Historically, various
numeration
A numeral system (or system of numeration) is a writing system for expressing numbers; that is, a mathematical notation for representing numbers of a given set, using digits or other symbols in a consistent manner.
The same sequence of symbo ...
s of Walsh functions have been used; none of them is particularly superior to another. This articles uses the ''Walsh–Paley numeration''.
Definition
We define the sequence of Walsh functions
,
as follows.
For any natural number ''k'', and real number
, let
:
be the ''j''th bit in the binary representation of ''k'', starting with
as the least significant bit, and
:
be the ''j''th bit in the fractional binary representation of
, starting with
as the most significant fractional bit.
Then, by definition
:
In particular,
everywhere on the interval, since all bits of ''k'' are zero.
Notice that
is precisely the
Rademacher function
In mathematics, the Haar wavelet is a sequence of rescaled "square-shaped" functions which together form a wavelet family or basis. Wavelet analysis is similar to Fourier analysis in that it allows a target function over an interval to be represe ...
''r''
m.
Thus, the Rademacher system is a subsystem of the Walsh system. Moreover, every Walsh function is a product of Rademacher functions:
:
Comparison between Walsh functions and trigonometric functions
Walsh functions and trigonometric functions are both systems that form a complete,
orthonormal
In linear algebra, two vectors in an inner product space are orthonormal if they are orthogonal (or perpendicular along a line) unit vectors. A set of vectors form an orthonormal set if all vectors in the set are mutually orthogonal and all of un ...
set of functions, an
orthonormal basis
In mathematics, particularly linear algebra, an orthonormal basis for an inner product space ''V'' with finite dimension is a basis for V whose vectors are orthonormal, that is, they are all unit vectors and orthogonal to each other. For example, ...
in
Hilbert space
In mathematics, Hilbert spaces (named after David Hilbert) allow generalizing the methods of linear algebra and calculus from (finite-dimensional) Euclidean vector spaces to spaces that may be infinite-dimensional. Hilbert spaces arise natural ...
of the
square-integrable functions on the unit interval. Both are systems of bounded functions, unlike, say, the
Haar system or the Franklin system.
Both trigonometric and Walsh systems admit natural extension by periodicity from the unit interval to the real line
. Furthermore, both
Fourier analysis
In mathematics, Fourier analysis () is the study of the way general functions may be represented or approximated by sums of simpler trigonometric functions. Fourier analysis grew from the study of Fourier series, and is named after Josep ...
on the unit interval (
Fourier series
A Fourier series () is a summation of harmonically related sinusoidal functions, also known as components or harmonics. The result of the summation is a periodic function whose functional form is determined by the choices of cycle length (or ''p ...
) and on the real line (
Fourier transform
A Fourier transform (FT) is a mathematical transform that decomposes functions into frequency components, which are represented by the output of the transform as a function of frequency. Most commonly functions of time or space are transformed, ...
) have their digital counterparts defined via Walsh system, the Walsh series analogous to the Fourier series, and the
Hadamard transform analogous to the Fourier transform.
Properties
The Walsh system
is a commutative multiplicative discrete group isomorphic to
, the
Pontryagin dual of
Cantor group . Its identity is
, and every element is of order two (that is, self-inverse).
The Walsh system is an
orthonormal
In linear algebra, two vectors in an inner product space are orthonormal if they are orthogonal (or perpendicular along a line) unit vectors. A set of vectors form an orthonormal set if all vectors in the set are mutually orthogonal and all of un ...
basis of Hilbert space
. Orthonormality means
:
,
and being a basis means that if, for every
, we set
then
:
It turns out that for every
, the series
converge to
for almost every
.
The Walsh system (in Walsh-Paley numeration) forms a
Schauder basis In mathematics, a Schauder basis or countable basis is similar to the usual ( Hamel) basis of a vector space; the difference is that Hamel bases use linear combinations that are finite sums, while for Schauder bases they may be infinite sums. This ...
in
,
. Note that, unlike the
Haar system, and like the trigonometric system, this basis is not
unconditional, nor is the system a Schauder basis in
.
Generalizations
Walsh-Ferleger systems
Let
be the compact
Cantor group endowed with
Haar measure In mathematical analysis, the Haar measure assigns an "invariant volume" to subsets of locally compact topological groups, consequently defining an integral for functions on those groups.
This measure was introduced by Alfréd Haar in 1933, though ...
and let
be its discrete group of
characters. Elements of
are readily identified with Walsh functions. Of course, the characters are defined on
while Walsh functions are defined on the unit interval, but since there exists a
modulo zero isomorphism between these
measure space
A measure space is a basic object of measure theory, a branch of mathematics that studies generalized notions of volumes. It contains an underlying set, the subsets of this set that are feasible for measuring (the -algebra) and the method that i ...
s, measurable functions on them are identified via
isometry
In mathematics, an isometry (or congruence, or congruent transformation) is a distance-preserving transformation between metric spaces, usually assumed to be bijective. The word isometry is derived from the Ancient Greek: ἴσος ''isos'' mea ...
.
Then basic
representation theory suggests the following broad generalization of the concept of Walsh system.
For an arbitrary
Banach space
In mathematics, more specifically in functional analysis, a Banach space (pronounced ) is a complete normed vector space. Thus, a Banach space is a vector space with a metric that allows the computation of vector length and distance between vector ...
let
be a
strongly continuous In mathematics, a strong topology is a topology which is stronger than some other "default" topology. This term is used to describe different topologies depending on context, and it may refer to:
* the final topology on the disjoint union
* the top ...
, uniformly bounded faithful action of
on ''X''. For every
, consider its
eigenspace
In linear algebra, an eigenvector () or characteristic vector of a linear transformation is a nonzero vector that changes at most by a scalar factor when that linear transformation is applied to it. The corresponding eigenvalue, often denoted b ...
. Then ''X'' is the closed
linear span
In mathematics, the linear span (also called the linear hull or just span) of a set of vectors (from a vector space), denoted , pp. 29-30, §§ 2.5, 2.8 is defined as the set of all linear combinations of the vectors in . It can be characterized ...
of the eigenspaces:
. Assume that every eigenspace is one-dimensional and pick an element
such that
. Then the system
, or the same system in the Walsh-Paley numeration of the characters
is called generalized Walsh system associated with action
. Classical Walsh system becomes a special case, namely, for
:
where
is addition modulo 2.
In the early 1990s, Serge Ferleger and Fyodor Sukochev showed that in a broad class of Banach spaces (so called ''UMD'' spaces ) generalized Walsh systems have many properties similar to the classical one: they form a Schauder basis and a uniform finite dimensional decomposition in the space, have property of random unconditional convergence.
One important example of generalized Walsh system is Fermion Walsh system in non-commutative ''L''
p spaces associated with
hyperfinite type II factor In mathematics, there are up to isomorphism exactly two separably acting hyperfinite type II factors; one infinite and one finite. Murray and von Neumann proved that up to isomorphism there is a unique von Neumann algebra that is a factor of type I ...
.
Fermion Walsh system
The
Fermion
In particle physics, a fermion is a particle that follows Fermi–Dirac statistics. Generally, it has a half-odd-integer spin: spin , spin , etc. In addition, these particles obey the Pauli exclusion principle. Fermions include all quarks an ...
Walsh system is a non-commutative, or "quantum" analog of the classical Walsh system. Unlike the latter, it consists of operators, not functions. Nevertheless, both systems share many important properties, e.g., both form an orthonormal basis in corresponding Hilbert space, or
Schauder basis In mathematics, a Schauder basis or countable basis is similar to the usual ( Hamel) basis of a vector space; the difference is that Hamel bases use linear combinations that are finite sums, while for Schauder bases they may be infinite sums. This ...
in corresponding symmetric spaces. Elements of the Fermion Walsh system are called ''Walsh operators''.
The term ''Fermion'' in the name of the system is explained by the fact that the enveloping operator space, the so-called
hyperfinite type II factor In mathematics, there are up to isomorphism exactly two separably acting hyperfinite type II factors; one infinite and one finite. Murray and von Neumann proved that up to isomorphism there is a unique von Neumann algebra that is a factor of type I ...
, may be viewed as the space of ''observables'' of the system of countably infinite number of distinct
spin
Spin or spinning most often refers to:
* Spinning (textiles), the creation of yarn or thread by twisting fibers together, traditionally by hand spinning
* Spin, the rotation of an object around a central axis
* Spin (propaganda), an intentionally b ...
fermions. Each
Rademacher Rademacher is an occupational surname of German origin, which means "wheelmaker". It may refer to:
People
* Arthur Rademacher (1889–1981), Australian football player
*Autumn Rademacher (born 1975), American basketball coach
*Bill Rademacher (born ...
operator acts on one particular fermion coordinate only, and there it is a
Pauli matrix
In mathematical physics and mathematics, the Pauli matrices are a set of three complex matrices which are Hermitian, involutory and unitary. Usually indicated by the Greek letter sigma (), they are occasionally denoted by tau () when used in c ...
. It may be identified with the observable measuring spin component of that fermion along one of the axes
in spin space. Thus, a Walsh operator measures the spin of a subset of fermions, each along its own axis.
Vilenkin system
Fix a sequence
of integers with
and let
endowed with the
product topology
In topology and related areas of mathematics, a product space is the Cartesian product of a family of topological spaces equipped with a natural topology called the product topology. This topology differs from another, perhaps more natural-seemin ...
and the normalized Haar measure. Define
and
. Each
can be associated with the real number
:
This correspondence is a module zero isomorphism between
and the unit interval. It also defines a norm which generates the topology of
. For
, let
where
:
The set
is called ''generalized Rademacher system''. The Vilenkin system is the group
of (complex-valued) characters of
, which are all finite products of
. For each non-negative integer
there is a unique sequence
such that
and
:
Then
where
:
In particular, if
, then
is the Cantor group and
is the (real-valued) Walsh-Paley system.
The Vilenkin system is a complete orthonormal system on
and forms a
Schauder basis In mathematics, a Schauder basis or countable basis is similar to the usual ( Hamel) basis of a vector space; the difference is that Hamel bases use linear combinations that are finite sums, while for Schauder bases they may be infinite sums. This ...
in
,
.
Binary Surfaces
Romanuke showed that Walsh functions can be generalized to binary surfaces in a particular case of function of two variables. There also exist eight Walsh-like bases of orthonormal binary functions, whose structure is nonregular (unlike the structure of Walsh functions). These eight bases are generalized to surfaces (in the case of the function of two variables) also. It was proved that piecewise-constant functions can be represented within each of nine bases (including the Walsh functions basis) as finite sums of binary functions, when weighted with proper coefficients.
Nonlinear Phase Extensions
Nonlinear phase extensions of discrete Walsh-
Hadamard transform were developed. It was shown that the nonlinear phase basis functions with improved cross-correlation properties significantly outperform the traditional Walsh codes in code division multiple access (CDMA) communications.
[A.N. Akansu and R. Poluri,]
"Walsh-Like Nonlinear Phase Orthogonal Codes for Direct Sequence CDMA Communications,"
IEEE Trans. Signal Process., vol. 55, no. 7, pp. 3800–3806, July 2007.
Applications
Applications of the Walsh functions can be found wherever digit representations are used, including
speech recognition
Speech recognition is an interdisciplinary subfield of computer science and computational linguistics that develops methodologies and technologies that enable the recognition and translation of spoken language into text by computers with the m ...
, medical and biological
image processing
An image is a visual representation of something. It can be two-dimensional, three-dimensional, or somehow otherwise feed into the visual system to convey information. An image can be an artifact, such as a photograph or other two-dimensiona ...
, and
digital holography.
For example, the
fast Walsh–Hadamard transform
In computational mathematics, the Hadamard ordered fast Walsh–Hadamard transform (FWHT''h'') is an efficient algorithm to compute the Walsh–Hadamard transform (WHT). A naive implementation of the WHT of order n = 2^m would have a computati ...
(FWHT) may be used in the analysis of digital
quasi-Monte Carlo methods. In
radio astronomy
Radio astronomy is a subfield of astronomy that studies celestial objects at radio frequencies. The first detection of radio waves from an astronomical object was in 1933, when Karl Jansky at Bell Telephone Laboratories reported radiation coming f ...
, Walsh functions can help reduce the effects of electrical
crosstalk
In electronics, crosstalk is any phenomenon by which a signal transmitted on one circuit or channel of a transmission system creates an undesired effect in another circuit or channel. Crosstalk is usually caused by undesired capacitive, induc ...
between antenna signals. They are also used in passive
LCD
A liquid-crystal display (LCD) is a flat-panel display or other electronically modulated optical device that uses the light-modulating properties of liquid crystals combined with polarizers. Liquid crystals do not emit light directly but in ...
panels as X and Y binary driving waveforms where the autocorrelation between X and Y can be made minimal for pixels that are off.
See also
*
Discrete Fourier transform
In mathematics, the discrete Fourier transform (DFT) converts a finite sequence of equally-spaced samples of a function into a same-length sequence of equally-spaced samples of the discrete-time Fourier transform (DTFT), which is a complex- ...
*
Fast Fourier transform
A fast Fourier transform (FFT) is an algorithm that computes the discrete Fourier transform (DFT) of a sequence, or its inverse (IDFT). Fourier analysis converts a signal from its original domain (often time or space) to a representation in th ...
*
Harmonic analysis
Harmonic analysis is a branch of mathematics concerned with the representation of Function (mathematics), functions or signals as the Superposition principle, superposition of basic waves, and the study of and generalization of the notions of Fo ...
*
Orthogonal functions In mathematics, orthogonal functions belong to a function space that is a vector space equipped with a bilinear form. When the function space has an interval (mathematics), interval as the domain of a function, domain, the bilinear form may be the i ...
*
Walsh matrix
In mathematics, a Walsh matrix is a specific square matrix of dimensions 2, where ''n'' is some particular natural number. The entries of the matrix are either +1 or −1 and its rows as well as columns are orthogonal, i.e. dot product is ...
*
Parity function
Notes
References
*
*
*
*
*
*
*
*
*
*
*
External links
*
*
*
*
{{Authority control
Special functions