manifold hypothesis
   HOME

TheInfoList



OR:

In
theoretical computer science computer science (TCS) is a subset of general computer science and mathematics that focuses on mathematical aspects of computer science such as the theory of computation, lambda calculus, and type theory. It is difficult to circumscribe the ...
and the study of
machine learning Machine learning (ML) is a field of inquiry devoted to understanding and building methods that 'learn', that is, methods that leverage data to improve performance on some set of tasks. It is seen as a part of artificial intelligence. Machine ...
, the manifold hypothesis is the hypothesis that many high-dimensional data sets that occur in the real world actually lie along low-dimensional latent manifolds inside that high-dimensional space.Olah, Christopher. 2014. Blog: Neural Networks, Manifolds, and Topology. Available: https://colah.github.io/posts/2014-03-NN-Manifolds-Topology/ As a consequence of the manifold hypothesis, many data sets that appear to initially require many variables to describe, can actually be described by a comparatively small number of variables, likened to the local coordinate system of the underlying manifold. It is suggested that this principle underpins the effectiveness of machine learning algorithms in describing high-dimensional data sets by considering a few common features. The manifold hypothesis is related to the effectiveness of nonlinear dimensionality reduction techniques in machine learning. Many techniques of dimensional reduction make the assumption that data lies along a low-dimensional submanifold, such as manifold sculpting, manifold alignment, and manifold regularization.


References


Further reading

*{{cite document , first1=Bradley C. A. , last1=Brown , first2=Anthony L. , last2=Caterini , first3=Brendan Leigh , last3=Ross , first4=Jesse C. , last4=Cresswell , first5=Gabriel , last5=Loaiza-Ganem , display-authors=1 , title=The Union of Manifolds Hypothesis and its Implications for Deep Generative Modelling , year=2022 , arxiv=2207.02862 Machine learning Theoretical computer science