Constraint (information theory)
   HOME

TheInfoList



OR:

Constraint in
information theory Information theory is the scientific study of the quantification (science), quantification, computer data storage, storage, and telecommunication, communication of information. The field was originally established by the works of Harry Nyquist a ...
is the degree of statistical dependence between or among variables. Garner Garner W R (1962). ''Uncertainty and Structure as Psychological Concepts'', John Wiley & Sons, New York. provides a thorough discussion of various forms of constraint (internal constraint, external constraint, total constraint) with application to
pattern recognition Pattern recognition is the automated recognition of patterns and regularities in data. It has applications in statistical data analysis, signal processing, image analysis, information retrieval, bioinformatics, data compression, computer graphi ...
and
psychology Psychology is the scientific study of mind and behavior. Psychology includes the study of conscious and unconscious phenomena, including feelings and thoughts. It is an academic discipline of immense scope, crossing the boundaries betwe ...
.


See also

*
Mutual Information In probability theory and information theory, the mutual information (MI) of two random variables is a measure of the mutual dependence between the two variables. More specifically, it quantifies the " amount of information" (in units such ...
* Total Correlation *
Interaction information The interaction information is a generalization of the mutual information for more than two variables. There are many names for interaction information, including ''amount of information'', ''information correlation'', ''co-information'', and sim ...


References

Information theory {{compsci-stub