The classical definition or
interpretation of probability is identified with the works of
Jacob Bernoulli
Jacob Bernoulli (also known as James or Jacques; – 16 August 1705) was one of the many prominent mathematicians in the Bernoulli family. He was an early proponent of Leibnizian calculus and sided with Gottfried Wilhelm Leibniz during the Le ...
and
Pierre-Simon Laplace
Pierre-Simon, marquis de Laplace (; ; 23 March 1749 – 5 March 1827) was a French scholar and polymath whose work was important to the development of engineering, mathematics, statistics, physics, astronomy, and philosophy. He summarized ...
. As stated in Laplace's ''
Théorie analytique des probabilités
Pierre-Simon, marquis de Laplace (; ; 23 March 1749 – 5 March 1827) was a French scholar and polymath whose work was important to the development of engineering, mathematics, statistics, physics, astronomy, and philosophy. He summarized ...
'',
:The probability of an event is the ratio of the number of cases favorable to it, to the number of all cases possible when nothing leads us to expect that any one of these cases should occur more than any other, which renders them, for us, equally possible.
This definition is essentially a consequence of the
principle of indifference
The principle of indifference (also called principle of insufficient reason) is a rule for assigning epistemic probabilities. The principle of indifference states that in the absence of any relevant evidence, agents should distribute their cre ...
. If
elementary events
In probability theory, an elementary event, also called an atomic event or sample point, is an event which contains only a single outcome in the sample space. Using set theory terminology, an elementary event is a singleton. Elementary events an ...
are assigned equal probabilities, then the
probability
Probability is the branch of mathematics concerning numerical descriptions of how likely an Event (probability theory), event is to occur, or how likely it is that a proposition is true. The probability of an event is a number between 0 and ...
of a disjunction of elementary events is just the number of events in the disjunction divided by the total number of elementary events.
The classical definition of probability was called into question by several writers of the nineteenth century, including
John Venn
John Venn, Fellow of the Royal Society, FRS, Fellow of the Society of Antiquaries of London, FSA (4 August 1834 – 4 April 1923) was an English mathematician, logician and philosopher noted for introducing Venn diagrams, which are used in l ...
and
George Boole
George Boole (; 2 November 1815 – 8 December 1864) was a largely self-taught English mathematician, philosopher, and logician, most of whose short career was spent as the first professor of mathematics at Queen's College, Cork in Ire ...
.
The
frequentist definition of probability became widely accepted as a result of their criticism, and especially through the works of
R.A. Fisher
Sir Ronald Aylmer Fisher (17 February 1890 – 29 July 1962) was a British polymath who was active as a mathematician, statistician, biologist, geneticist, and academic. For his work in statistics, he has been described as "a genius who a ...
. The classical definition enjoyed a revival of sorts due to the general interest in
Bayesian probability
Bayesian probability is an Probability interpretations, interpretation of the concept of probability, in which, instead of frequentist probability, frequency or propensity probability, propensity of some phenomenon, probability is interpreted as re ...
, because Bayesian methods require a prior probability distribution and the principle of indifference offers one source of such a distribution. Classical probability can offer prior probabilities that reflect ignorance which often seems appropriate before an experiment is conducted.
History
As a mathematical subject, the
theory of probability
Probability theory is the branch of mathematics concerned with probability. Although there are several different probability interpretations, probability theory treats the concept in a rigorous mathematical manner by expressing it through a set o ...
arose very late—as compared to
geometry
Geometry (; ) is, with arithmetic, one of the oldest branches of mathematics. It is concerned with properties of space such as the distance, shape, size, and relative position of figures. A mathematician who works in the field of geometry is c ...
for example—despite the fact that we have prehistoric evidence of man playing with dice from cultures from all over the world. One of the earliest writers on probability was
Gerolamo Cardano
Gerolamo Cardano (; also Girolamo or Geronimo; french: link=no, Jérôme Cardan; la, Hieronymus Cardanus; 24 September 1501– 21 September 1576) was an Italian polymath, whose interests and proficiencies ranged through those of mathematician, ...
. He perhaps produced the earliest known definition of classical probability.
The sustained development of probability began in the year 1654 when
Blaise Pascal
Blaise Pascal ( , , ; ; 19 June 1623 – 19 August 1662) was a French mathematician, physicist, inventor, philosopher, and Catholic Church, Catholic writer.
He was a child prodigy who was educated by his father, a tax collector in Rouen. Pa ...
had some correspondence with his father's friend
Pierre de Fermat
Pierre de Fermat (; between 31 October and 6 December 1607 – 12 January 1665) was a French mathematician who is given credit for early developments that led to infinitesimal calculus, including his technique of adequality. In particular, he ...
about two problems concerning games of chance he had heard from the
Chevalier de Méré Antoine Gombaud, ''alias'' Chevalier de Méré, (1607 – 29 December 1684) was a French people, French writer, born in Poitou.E. Feuillâtre (Editor), ''Les Épistoliers Du XVIIe Siècle. Avec des Notices biographiques, des Notices littéraires ...
earlier the same year, whom Pascal happened to accompany during a trip. One problem was the so-called
problem of points
The problem of points, also called the problem of division of the stakes, is a classical problem in probability theory. One of the famous problems that motivated the beginnings of modern probability theory in the 17th century, it led Blaise Pascal ...
, a classic problem already then (treated by
Luca Pacioli
Fra Luca Bartolomeo de Pacioli (sometimes ''Paccioli'' or ''Paciolo''; 1447 – 19 June 1517) was an Italian mathematician, Franciscan friar, collaborator with Leonardo da Vinci, and an early contributor to the field now known as accounting ...
as early as 1494,
[ and even earlier in an anonymous manuscript in 1400][), dealing with the question how to split the money at stake ''in a fair way'' when the game at hand is interrupted half-way through. The other problem was one about a mathematical rule of thumb that seemed not to hold when extending a game of dice from using one die to two dice. This last problem, or paradox, was the discovery of Méré himself and showed, according to him, how dangerous it was to apply mathematics to reality.][James Franklin, ''The Science of Conjecture: Evidence and Probability before Pascal'' (2001) The Johns Hopkins University Press ] They discussed other mathematical-philosophical issues and paradoxes as well during the trip that Méré thought was strengthening his general philosophical view.
Pascal, in disagreement with Méré's view of mathematics as something beautiful and flawless but poorly connected to reality, determined to prove Méré wrong by solving these two problems within pure mathematics. When he learned that Fermat, already recognized as a distinguished mathematician, had reached the same conclusions, he was convinced they had solved the problems conclusively. This correspondence circulated among other scholars at the time, in particular, to Huygens, Roberval and indirectly Caramuel
Juan Caramuel y Lobkowitz (Juan Caramuel de Lobkowitz, 23 May 1606 in Madrid — 7 or 8 September 1682 in Vigevano) was a Spanish Catholic scholastic philosopher, ecclesiastic, mathematician and writer. He is believed to be a great-grandson of J ...
,[ and marks the starting point for when mathematicians in general began to study problems from games of chance. The correspondence did not mention "probability"; It focused on fair prices.]
Half a century later, Jacob Bernoulli
Jacob Bernoulli (also known as James or Jacques; – 16 August 1705) was one of the many prominent mathematicians in the Bernoulli family. He was an early proponent of Leibnizian calculus and sided with Gottfried Wilhelm Leibniz during the Le ...
showed a sophisticated grasp of probability. He showed facility with permutations and combinations, discussed the concept of probability with examples beyond the classical definition (such as personal, judicial and financial decisions) and showed that probabilities could be estimated by repeated trials with uncertainty diminished as the number of trials increased.[
The 1765 volume of Diderot and d'Alembert's classic ]Encyclopédie
''Encyclopédie, ou dictionnaire raisonné des sciences, des arts et des métiers'' (English: ''Encyclopedia, or a Systematic Dictionary of the Sciences, Arts, and Crafts''), better known as ''Encyclopédie'', was a general encyclopedia publis ...
contains a lengthy discussion of probability and summary of knowledge up to that time. A distinction is made between probabilities "drawn from the consideration of nature itself" (physical) and probabilities "founded only on the experience in the past which can make us confidently draw conclusions for the future" (evidential).[ Lubières, Charles-Benjamin, baron de. "Probability." The Encyclopedia of Diderot & d'Alembert Collaborative Translation Project. Translated by Daniel C. Weiner. Ann Arbor: Michigan Publishing, University of Michigan Library, 2008. http://hdl.handle.net/2027/spo.did2222.0000.983. Originally published as "Probabilité," Encyclopédie ou Dictionnaire raisonné des sciences, des arts et des métiers, 13:393–400 (Paris, 1765).]
The source of a clear and lasting definition of probability was Laplace
Pierre-Simon, marquis de Laplace (; ; 23 March 1749 – 5 March 1827) was a French scholar and polymath whose work was important to the development of engineering, mathematics, statistics, physics, astronomy, and philosophy. He summarized ...
. As late as 1814 he stated:
This description is what would ultimately provide the classical definition of probability. Laplace published several editions of multiple documents (technical and a popularization) on probability over a half-century span. Many of his predecessors (Cardano, Bernoulli, Bayes) published a single document posthumously.
Criticism
The classical definition of probability assigns equal probabilities to events based on physical symmetry which is natural for coins, cards and dice.
* Some mathematicians object that the definition is circular. The probability for a "fair" coin is... A "fair" coin is defined by a probability of...
* The definition is very limited. It says nothing about cases where no physical symmetry exists. Insurance premiums, for example, can only be rationally priced by measured rates of loss.
* It is not trivial to justify the principle of indifference except in the simplest and most idealized of cases (an extension of the problem limited definition). Coins are not truly symmetric. Can we assign equal probabilities to each side? Can we assign equal probabilities to any real world experience?
However limiting, the definition is accompanied with substantial confidence. Much of the mathematics of probability was developed on the basis of this simplistic definition. Alternative interpretations of probability
The word probability has been used in a variety of ways since it was first applied to the mathematical study of games of chance. Does probability measure the real, physical, tendency of something to occur, or is it a measure of how strongly one be ...
(for example frequentist
Frequentist inference is a type of statistical inference based in frequentist probability, which treats “probability” in equivalent terms to “frequency” and draws conclusions from sample-data by means of emphasizing the frequency or pr ...
and subjective) also have problems.
Mathematical probability theory
Probability theory is the branch of mathematics concerned with probability. Although there are several different probability interpretations, probability theory treats the concept in a rigorous mathematical manner by expressing it through a set o ...
deals in abstractions, avoiding the limitations and philosophical complications of any probability interpretation.
References
* Pierre-Simon de Laplace. ''Théorie analytique des probabilités''. Paris: Courcier Imprimeur, 1812.
* Pierre-Simon de Laplace. ''Essai philosophique sur les probabilités'', 3rd edition. Paris: Courcier Imprimeur, 1816.
* Pierre-Simon de Laplace. ''Philosophical essay on probabilities''. New York: Springer-Verlag, 1995. ''(Translated by A.I. Dale from the fifth French edition, 1825. Extensive notes.)''
External links
The problem of points
{{DEFAULTSORT:Classical Definition Of Probability
Probability interpretations