Condorcet Jury Theorem
   HOME

TheInfoList



OR:

Condorcet's jury theorem is a
political science Political science is the scientific study of politics. It is a social science dealing with systems of governance and power, and the analysis of political activities, political thought, political behavior, and associated constitutions and la ...
theorem about the
relative probability The relative risk (RR) or risk ratio is the ratio of the probability of an outcome in an exposed group to the probability of an outcome in an unexposed group. Together with risk difference and odds ratio, relative risk measures the association bet ...
of a given group of individuals arriving at a correct decision. The theorem was first expressed by the
Marquis de Condorcet Marie Jean Antoine Nicolas de Caritat, Marquis of Condorcet (; 17 September 1743 – 29 March 1794), known as Nicolas de Condorcet, was a French philosopher and mathematician. His ideas, including support for a liberal economy, free and equal pu ...
in his 1785 work ''Essay on the Application of Analysis to the Probability of Majority Decisions''. The assumptions of the theorem are that a group wishes to reach a decision by
majority vote A majority, also called a simple majority or absolute majority to distinguish it from related terms, is more than half of the total.Dictionary definitions of ''majority'' aMerriam-Websterjury theorem A jury theorem is a mathematical theorem proving that, under certain assumptions, a decision attained using majority voting in a large group is more likely to be correct than a decision attained by a single expert. It serves as a formal argument for ...
s, relaxing some or all of Condorcet's assumptions.


Proofs


Proof 1: Calculating the probability that two additional voters change the outcome

To avoid the need for a tie-breaking rule, we assume ''n'' is odd. Essentially the same argument works for even ''n'' if ties are broken by adding a single voter. Now suppose we start with ''n'' voters, and let ''m'' of these voters vote correctly. Consider what happens when we add two more voters (to keep the total number odd). The majority vote changes in only two cases: * ''m'' was one vote too small to get a majority of the ''n'' votes, but both new voters voted correctly. * ''m'' was just equal to a majority of the ''n'' votes, but both new voters voted incorrectly. The rest of the time, either the new votes cancel out, only increase the gap, or don't make enough of a difference. So we only care what happens when a single vote (among the first ''n'') separates a correct from an incorrect majority. Restricting our attention to this case, we can imagine that the first ''n''-1 votes cancel out and that the deciding vote is cast by the ''n''-th voter. In this case the probability of getting a correct majority is just ''p''. Now suppose we send in the two extra voters. The probability that they change an incorrect majority to a correct majority is (1-''p'')''p''2, while the probability that they change a correct majority to an incorrect majority is ''p''(1-''p'')(1-''p''). The first of these probabilities is greater than the second if and only if ''p'' > 1/2, proving the theorem.


Proof 2: Calculating the probability that the decision is correct

This proof is direct; it just sums up the probabilities of the majorities. Each term of the sum multiplies the number of
combination In mathematics, a combination is a selection of items from a set that has distinct members, such that the order of selection does not matter (unlike permutations). For example, given three fruits, say an apple, an orange and a pear, there are th ...
s of a majority by the
probability Probability is the branch of mathematics concerning numerical descriptions of how likely an Event (probability theory), event is to occur, or how likely it is that a proposition is true. The probability of an event is a number between 0 and ...
of that majority. Each majority is counted using a
combination In mathematics, a combination is a selection of items from a set that has distinct members, such that the order of selection does not matter (unlike permutations). For example, given three fruits, say an apple, an orange and a pear, there are th ...
, ''n'' items taken ''k'' at a time, where ''n'' is the jury size, and ''k'' is the size of the majority. Probabilities range from 0 (= the vote is always wrong) to 1 (= always right). Each person decides independently, so the probabilities of their decisions multiply. The probability of each correct decision is ''p''. The probability of an incorrect decision, ''q'', is the opposite of ''p'', i.e. 1 − ''p''. The power notation, i.e. p^x is a shorthand for ''x'' multiplications of ''p''. Committee or jury accuracies can be easily estimated by using this approach in computer spreadsheets or programs. As an example, let us take the simplest case of ''n'' = 3, ''p'' = 0.8. We need to show that 3 people have higher than 0.8 chance of being right. Indeed: : 0.8 × 0.8 × 0.8 + 0.8 × 0.8 × 0.2 + 0.8 × 0.2 × 0.8 + 0.2 × 0.8 × 0.8 = 0.896.


Asymptotics

The probability of a correct majority decision ''P''(''n'', ''p''), when the individual probability ''p'' is close to 1/2 grows linearly in terms of ''p'' − 1/2. For ''n'' voters each one having probability ''p'' of deciding correctly and for odd ''n'' (where there are no possible ties): :P(n, p) = 1/2 + c_1 (p - 1/2) + c_3 (p - 1/2)^3 + O\left( (p - 1/2)^5 \right), where :c_1 = \frac = \sqrt \left(1 + \frac + O(n^)\right), and the asymptotic approximation in terms of ''n'' is very accurate. The expansion is only in odd powers and c_3 < 0. In simple terms, this says that when the decision is difficult (''p'' close to 1/2), the gain by having ''n'' voters grows proportionally to \sqrt.


The theorem in other disciplines

The Condorcet jury theorem has recently been used to conceptualize score integration when several physician readers (radiologists, endoscopists, etc.) independently evaluate images for disease activity. This task arises in central reading performed during clinical trials and has similarities to voting. According to the authors, the application of the theorem can translate individual reader scores into a final score in a fashion that is both mathematically sound (by avoiding averaging of ordinal data), mathematically tractable for further analysis, and in a manner that is consistent with the scoring task at hand (based on decisions about the presence or absence of features, a subjective classification task) The Condorcet jury theorem is also used in
ensemble learning In statistics and machine learning, ensemble methods use multiple learning algorithms to obtain better predictive performance than could be obtained from any of the constituent learning algorithms alone. Unlike a statistical ensemble in statisti ...
in the field of
machine learning Machine learning (ML) is a field of inquiry devoted to understanding and building methods that 'learn', that is, methods that leverage data to improve performance on some set of tasks. It is seen as a part of artificial intelligence. Machine ...
. An ensemble method combines the predictions of many individual classifiers by majority voting. Assuming that each of the individual classifiers predict with slightly greater than 50% accuracy and their predictions are independent, then the ensemble of their predictions will be far greater than their individual predictive scores.


Applicability to democratic processes

Many political theorists and philosophers use the Condorcet’s Jury Theorem (CJT) to defend democracy, see Brennan and references therein. Nevertheless, it is an empirical question whether the theorem holds in real life or not. Note that the CJT is a ''double-edged sword'': it can either prove that majority rule is an (almost) perfect mechanism to aggregate information, when p>1/2, or an (almost) perfect disaster, when p<1/2. A disaster would mean that the wrong option is chosen systematically. Some authors have argued that we are in the latter scenario. For instance,
Bryan Caplan Bryan Douglas Caplan (born April 8, 1971) is an American economist and author. Caplan is a professor of economics at George Mason University, research fellow at the Mercatus Center, adjunct scholar at the Cato Institute, and former contributor ...
has extensively argued that voters' knowledge is systematically biased toward (probably) wrong options. In the CJT setup, this could be interpreted as evidence for p<1/2. Recently, another approach to study the applicability of the CJT was taken. Instead of considering the homogeneous case, each voter is allowed to have a probability p_i\in ,1/math>, possibly different from other voters. This case was previously studied by Daniel Berend and Jacob Paroush and includes the classical theorem of Condorcet (when p_i=p~~ \forall~i\in\mathbb) and other results, like the Miracle of Aggregation (when p_i=1/2 for most voters and p_i=1 for a small proportion of them). Then, following a Bayesian approach, the
prior probability In Bayesian statistical inference, a prior probability distribution, often simply called the prior, of an uncertain quantity is the probability distribution that would express one's beliefs about this quantity before some evidence is taken into ...
(in this case,
a priori ("from the earlier") and ("from the later") are Latin phrases used in philosophy to distinguish types of knowledge, justification, or argument by their reliance on empirical evidence or experience. knowledge is independent from current ex ...
) of the thesis predicted by the theorem is estimated. That is, if we choose an arbitrary sequence of voters (i.e., a sequence (p_i)_ ), will the thesis of the CJT hold? The answer is no. More precisely, if a random sequence of p_i is taken following an unbiased distribution that does not favor competence, p_i>1/2, or incompetence, p_i<1/2, then the thesis predicted by the theorem will not hold
almost surely In probability theory, an event is said to happen almost surely (sometimes abbreviated as a.s.) if it happens with probability 1 (or Lebesgue measure 1). In other words, the set of possible exceptions may be non-empty, but it has probability 0. ...
. With this new approach, proponents of the CJT should present strong evidence of competence, to overcome the low prior probability. That is, it is not only the case that there is evidence against competence (posterior probability), but also that we cannot expect the CJT to hold in the absence of any evidence (prior probability).


Further reading

*
Condorcet method A Condorcet method (; ) is an election method that elects the candidate who wins a majority of the vote in every head-to-head election against each of the other candidates, that is, a candidate preferred by more voters than any others, whenever ...
*
Condorcet paradox The Condorcet paradox (also known as the voting paradox or the paradox of voting) in social choice theory is a situation noted by the Marquis de Condorcet in the late 18th century, in which collective preferences can be cyclic, even if the prefer ...
*
Jury theorem A jury theorem is a mathematical theorem proving that, under certain assumptions, a decision attained using majority voting in a large group is more likely to be correct than a decision attained by a single expert. It serves as a formal argument for ...
*
Wisdom of the crowd The wisdom of the crowd is the collective opinion of a diverse independent group of individuals rather than that of a single expert. This process, while not new to the Information Age, has been pushed into the mainstream spotlight by social infor ...


Notes

{{reflist Probability theorems Voting theory