Welch Bounds
   HOME

TheInfoList



OR:

In mathematics, Welch bounds are a family of
inequalities Inequality may refer to: Economics * Attention inequality, unequal distribution of attention across users, groups of people, issues in etc. in attention economy * Economic inequality, difference in economic well-being between population groups * ...
pertinent to the problem of evenly spreading a set of unit vectors in a
vector space In mathematics and physics, a vector space (also called a linear space) is a set whose elements, often called '' vectors'', may be added together and multiplied ("scaled") by numbers called ''scalars''. Scalars are often real numbers, but can ...
. The bounds are important tools in the design and analysis of certain methods in
telecommunication Telecommunication is the transmission of information by various types of technologies over wire, radio, optical, or other electromagnetic systems. It has its origin in the desire of humans for communication over a distance greater than that fe ...
engineering, particularly in
coding theory Coding theory is the study of the properties of codes and their respective fitness for specific applications. Codes are used for data compression, cryptography, error detection and correction, data transmission and data storage. Codes are studied ...
. The bounds were originally published in a 1974 paper by L. R. Welch.


Mathematical statement

If \ are unit vectors in \mathbb^n, define c_\max = \max_ , \langle x_i, x_j \rangle, , where \langle\cdot,\cdot\rangle is the usual
inner product In mathematics, an inner product space (or, rarely, a Hausdorff pre-Hilbert space) is a real vector space or a complex vector space with an operation called an inner product. The inner product of two vectors in the space is a scalar, often ...
on \mathbb^n. Then the following inequalities hold for k=1,2,\dots:(c_\max)^ \geq \frac \left \frac-1 \rightWelch bounds are also sometimes stated in terms of the averaged squared overlap between the set of vectors. In this case, one has the inequality\frac\sum_^m , \langle x_i,x_j\rangle, ^ \ge \frac.


Applicability

If m\leq n, then the vectors \ can form an
orthonormal set In linear algebra, two vectors in an inner product space are orthonormal if they are orthogonal (or perpendicular along a line) unit vectors. A set of vectors form an orthonormal set if all vectors in the set are mutually orthogonal and all of un ...
in \mathbb^n. In this case, c_\max=0 and the bounds are vacuous. Consequently, interpretation of the bounds is only meaningful if m>n. This will be assumed throughout the remainder of this article.


Proof for ''k'' = 1

The "first Welch bound," corresponding to k=1, is by far the most commonly used in applications. Its proof proceeds in two steps, each of which depends on a more basic mathematical inequality. The first step invokes the Cauchy–Schwarz inequality and begins by considering the m\times m
Gram matrix In linear algebra, the Gram matrix (or Gramian matrix, Gramian) of a set of vectors v_1,\dots, v_n in an inner product space is the Hermitian matrix of inner products, whose entries are given by the inner product G_ = \left\langle v_i, v_j \right\r ...
G of the vectors \; i.e., : G=\left \begin \langle x_1, x_1 \rangle & \cdots & \langle x_1, x_m \rangle \\ \vdots & \ddots & \vdots \\ \langle x_m, x_1 \rangle & \cdots & \langle x_m, x_m \rangle \end\right/math> The
trace Trace may refer to: Arts and entertainment Music * ''Trace'' (Son Volt album), 1995 * ''Trace'' (Died Pretty album), 1993 * Trace (band), a Dutch progressive rock band * ''The Trace'' (album) Other uses in arts and entertainment * ''Trace'' ...
of G is equal to the sum of its eigenvalues. Because the
rank Rank is the relative position, value, worth, complexity, power, importance, authority, level, etc. of a person or object within a ranking, such as: Level or position in a hierarchical organization * Academic rank * Diplomatic rank * Hierarchy * ...
of G is at most n, and it is a positive semidefinite matrix, G has at most n positive
eigenvalue In linear algebra, an eigenvector () or characteristic vector of a linear transformation is a nonzero vector that changes at most by a scalar factor when that linear transformation is applied to it. The corresponding eigenvalue, often denoted ...
s with its remaining eigenvalues all equal to zero. Writing the non-zero eigenvalues of G as \lambda_1,\ldots,\lambda_r with r\leq n and applying the Cauchy-Schwarz inequality to the inner product of an r-vector of ones with a vector whose components are these eigenvalues yields : (\mathrm\;G)^2 = \left( \sum_^r \lambda_i \right)^2 \leq r \sum_^r \lambda_i^2 \leq n \sum_^m \lambda_i^2 The square of the
Frobenius norm In mathematics, a matrix norm is a vector norm in a vector space whose elements (vectors) are matrices (of given dimensions). Preliminaries Given a field K of either real or complex numbers, let K^ be the -vector space of matrices with m ro ...
(Hilbert–Schmidt norm) of G satisfies : , , G, , ^2 = \sum_^ \sum_^m , \langle x_i , x_j \rangle, ^2 = \sum_^m \lambda_i^2 Taking this together with the preceding inequality gives : \sum_^m \sum_^m , \langle x_i , x_j \rangle, ^2\geq \frac Because each x_i has unit length, the elements on the main diagonal of G are ones, and hence its trace is \mathrm\;G = m. So, : \sum_^ \sum_^m , \langle x_i , x_j \rangle, ^2 = m+\sum_ , \langle x_i , x_j \rangle, ^2 \geq \frac or : \sum_ , \langle x_i , x_j \rangle, ^2 \geq \frac The second part of the proof uses an inequality encompassing the simple observation that the average of a set of non-negative numbers can be no greater than the largest number in the set. In mathematical notation, if a_\geq 0 for \ell=1,\ldots, L, then : \frac\sum_^L a_ \leq \max a_ The previous expression has m(m-1) non-negative terms in the sum, the largest of which is c_\max^2. So, : (c_\max)^2\geq \frac\sum_ , \langle x_i , x_j \rangle, ^2\geq\frac or : (c_\max)^2\geq \frac which is precisely the inequality given by Welch in the case that k=1.


Achieving the Welch bounds

In certain telecommunications applications, it is desirable to construct sets of vectors that meet the Welch bounds with equality. Several techniques have been introduced to obtain so-called Welch Bound Equality (WBE) sets of vectors for the k=1 bound. The proof given above shows that two separate mathematical inequalities are incorporated into the Welch bound when k=1. The Cauchy–Schwarz inequality is met with equality when the two vectors involved are collinear. In the way it is used in the above proof, this occurs when all the non-zero eigenvalues of the Gram matrix G are equal, which happens precisely when the vectors \ constitute a tight frame for \mathbb^n. The other inequality in the proof is satisfied with equality if and only if , \langle x_i, x_j \rangle, is the same for every choice of i\neq j. In this case, the vectors are equiangular. So this Welch bound is met with equality if and only if the set of vectors \ is an equiangular tight frame in \mathbb^n. Similarly, the Welch bounds stated in terms of average squared overlap, are saturated for all k\le t if and only if the set of vectors is a t-design in the complex projective space \mathbb^.


See also

* Spherical design * Quantum t-design *
Equiangular lines In geometry, a set of lines is called equiangular if all the lines intersect at a single point, and every pair of lines makes the same angle. Equiangular lines in Euclidean space Computing the maximum number of equiangular lines in ''n''-dimensi ...


References

{{reflist, 2 Inequalities