Isotropic position
   HOME

TheInfoList



OR:

In the fields of
machine learning Machine learning (ML) is a field of study in artificial intelligence concerned with the development and study of Computational statistics, statistical algorithms that can learn from data and generalise to unseen data, and thus perform Task ( ...
, the
theory of computation In theoretical computer science and mathematics, the theory of computation is the branch that deals with what problems can be solved on a model of computation, using an algorithm, how efficiently they can be solved or to what degree (e.g., app ...
, and random matrix theory, a probability distribution over vectors is said to be in isotropic position if its
covariance matrix In probability theory and statistics, a covariance matrix (also known as auto-covariance matrix, dispersion matrix, variance matrix, or variance–covariance matrix) is a square matrix giving the covariance between each pair of elements of ...
is proportional to the
identity matrix In linear algebra, the identity matrix of size n is the n\times n square matrix with ones on the main diagonal and zeros elsewhere. It has unique properties, for example when the identity matrix represents a geometric transformation, the obje ...
.


Formal definitions

Let D be a distribution over vectors in the vector space \mathbb^n. Then D is in isotropic position if, for vector v sampled from the distribution, \mathbb\, vv^\mathsf = \mathrm. A ''set'' of vectors is said to be in isotropic position if the uniform distribution over that set is in isotropic position. In particular, every
orthonormal In linear algebra, two vectors in an inner product space are orthonormal if they are orthogonal unit vectors. A unit vector means that the vector has a length of 1, which is also known as normalized. Orthogonal means that the vectors are all perpe ...
set of vectors is isotropic. As a related definition, a
convex body In mathematics, a convex body in n-dimensional Euclidean space \R^n is a compact convex set with non- empty interior. Some authors do not require a non-empty interior, merely that the set is non-empty. A convex body K is called symmetric if it ...
K in \mathbb^n is called isotropic if it has volume , K, = 1, center of mass at the origin, and there is a constant \alpha > 0 such that \int_K \langle x, y \rangle^2 dx = \alpha^2 , y, ^2, for all vectors y in \mathbb^n; here , \cdot, stands for the standard Euclidean norm.


See also

*
Whitening transformation A whitening transformation or sphering transformation is a linear transformation that transforms a vector of random variables with a known covariance matrix into a set of new variables whose covariance is the identity matrix, meaning that they ar ...


References

* Machine learning Random matrices {{ai-stub