Edwin Thompson Jaynes (July 5, 1922 – April 30, 1998) was the Wayman Crow Distinguished Professor of Physics at
Washington University
Washington University in St. Louis (WashU or WUSTL) is a private research university with its main campus in St. Louis County, and Clayton, Missouri. Founded in 1853, the university is named after George Washington. Washington University is r ...
in
St. Louis
St. Louis () is the second-largest city in Missouri, United States. It sits near the confluence of the Mississippi and the Missouri Rivers. In 2020, the city proper had a population of 301,578, while the bi-state metropolitan area, which e ...
. He wrote extensively on
statistical mechanics
In physics, statistical mechanics is a mathematical framework that applies statistical methods and probability theory to large assemblies of microscopic entities. It does not assume or postulate any natural laws, but explains the macroscopic be ...
and on foundations of
probability
Probability is the branch of mathematics concerning numerical descriptions of how likely an Event (probability theory), event is to occur, or how likely it is that a proposition is true. The probability of an event is a number between 0 and ...
and
statistical inference
Statistical inference is the process of using data analysis to infer properties of an underlying probability distribution, distribution of probability.Upton, G., Cook, I. (2008) ''Oxford Dictionary of Statistics'', OUP. . Inferential statistical ...
, initiating in 1957 the
maximum entropy interpretation of thermodynamics as being a particular application of more general
Bayesian
Thomas Bayes (/beɪz/; c. 1701 – 1761) was an English statistician, philosopher, and Presbyterian minister.
Bayesian () refers either to a range of concepts and approaches that relate to statistical methods based on Bayes' theorem, or a followe ...
/
information theory
Information theory is the scientific study of the quantification (science), quantification, computer data storage, storage, and telecommunication, communication of information. The field was originally established by the works of Harry Nyquist a ...
techniques (although he argued this was already implicit in the works of
Josiah Willard Gibbs
Josiah Willard Gibbs (; February 11, 1839 – April 28, 1903) was an American scientist who made significant theoretical contributions to physics, chemistry, and mathematics. His work on the applications of thermodynamics was instrumental in t ...
). Jaynes strongly promoted the interpretation of
probability theory
Probability theory is the branch of mathematics concerned with probability. Although there are several different probability interpretations, probability theory treats the concept in a rigorous mathematical manner by expressing it through a set o ...
as an extension of
logic
Logic is the study of correct reasoning. It includes both formal and informal logic. Formal logic is the science of deductively valid inferences or of logical truths. It is a formal science investigating how conclusions follow from premises ...
.
In 1963, together with
Fred Cummings, he
modeled the evolution of a
two-level atom in an electromagnetic field, in a fully quantized way. This model is known as the
Jaynes–Cummings model
The Jaynes–Cummings model (sometimes abbreviated JCM) is a theoretical model in quantum optics. It describes the system of a two-level atom interacting with a quantized mode of an optical cavity (or a bosonic field), with or without the prese ...
.
A particular focus of his work was the construction of logical principles for assigning
prior probability
In Bayesian statistical inference, a prior probability distribution, often simply called the prior, of an uncertain quantity is the probability distribution that would express one's beliefs about this quantity before some evidence is taken into ...
distributions; see the
principle of maximum entropy, the
principle of maximum caliber The principle of maximum caliber (MaxCal) or maximum path entropy principle, suggested by E. T. Jaynes, can be considered as a generalization of the principle of maximum entropy. It postulates that the most unbiased probability distribution of paths ...
, the
principle of transformation groups The principle of transformation groups is a rule for assigning ''epistemic'' probabilities in a statistical inference problem. It was first suggested by Edwin T. Jaynes and can be seen as a generalisation of the principle of indifference.
This can ...
and
Laplace's
principle of indifference
The principle of indifference (also called principle of insufficient reason) is a rule for assigning epistemic probabilities. The principle of indifference states that in the absence of any relevant evidence, agents should distribute their cre ...
. Other contributions include the
mind projection fallacy
The mind projection fallacy is an informal fallacy first described by physicist and Bayesian philosopher E. T. Jaynes. In a first, "positive" form, it occurs when someone thinks that the way they see the world reflects the way the world real ...
.
Jaynes' book, ''Probability Theory: The Logic of Science'' (2003) gathers various threads of modern thinking about
Bayesian probability
Bayesian probability is an interpretation of the concept of probability, in which, instead of frequency or propensity of some phenomenon, probability is interpreted as reasonable expectation representing a state of knowledge or as quantification ...
and
statistical inference
Statistical inference is the process of using data analysis to infer properties of an underlying probability distribution, distribution of probability.Upton, G., Cook, I. (2008) ''Oxford Dictionary of Statistics'', OUP. . Inferential statistical ...
, develops the notion of
probability theory as extended logic
Cox's theorem, named after the physicist Richard Threlkeld Cox, is a derivation of the laws of probability theory from a certain set of postulates. This derivation justifies the so-called "logical" interpretation of probability, as the laws of pr ...
, and contrasts the advantages of Bayesian techniques with the results of other approaches. This book, which he dedicated to
Harold Jeffreys
Sir Harold Jeffreys, FRS (22 April 1891 – 18 March 1989) was a British mathematician, statistician, geophysicist, and astronomer. His book, ''Theory of Probability'', which was first published in 1939, played an important role in the revival ...
, was published posthumously in 2003 (from an incomplete manuscript that was edited by
Larry Bretthorst).
See also
*
Differential entropy
Differential entropy (also referred to as continuous entropy) is a concept in information theory that began as an attempt by Claude Shannon to extend the idea of (Shannon) entropy, a measure of average surprisal of a random variable, to continuo ...
*
Limiting density of discrete points
In information theory, the limiting density of discrete points is an adjustment to the formula of Claude Shannon for differential entropy.
It was formulated by Edwin Thompson Jaynes to address defects in the initial definition of differential e ...
References
External links
*
* Edwin Thompson Jaynes
''Probability Theory: The Logic of Science''.Cambridge University Press, (2003). .
(fragmentary) of ''Probability Theory: The Logic of Science''. Book no longer downloadable for copyright reasons.
* A comprehensiv
web pageon E. T. Jaynes's life and work.
ET Jaynes' obituary at Washington universityhttp://bayes.wustl.edu/etj/articles/entropy.concentration.pdfJaynes' analysis of
Rudolph Wolf's dice data
{{DEFAULTSORT:Jaynes, Edwin Thompson
1922 births
1998 deaths
American agnostics
20th-century American physicists
American statisticians
Washington University in St. Louis faculty
Washington University in St. Louis mathematicians
Washington University physicists
Physicists from Missouri
Mathematicians from Missouri
Scientists from Missouri
20th-century American mathematicians