HOME

TheInfoList



OR:

In
probability theory Probability theory is the branch of mathematics concerned with probability. Although there are several different probability interpretations, probability theory treats the concept in a rigorous mathematical manner by expressing it through a set ...
, the law of rare events or Poisson limit theorem states that the
Poisson distribution In probability theory and statistics, the Poisson distribution is a discrete probability distribution that expresses the probability of a given number of events occurring in a fixed interval of time or space if these events occur with a known co ...
may be used as an approximation to the binomial distribution, under certain conditions. The theorem was named after
Siméon Denis Poisson Baron Siméon Denis Poisson FRS FRSE (; 21 June 1781 – 25 April 1840) was a French mathematician and physicist who worked on statistics, complex analysis, partial differential equations, the calculus of variations, analytical mechanics, electri ...
(1781–1840). A generalization of this theorem is 
Le Cam's theorem In probability theory, Le Cam's theorem, named after Lucien Le Cam (1924 – 2000), states the following. Suppose: * X_1, X_2, X_3, \ldots are independent random variables, each with a Bernoulli distribution (i.e., equal to either 0 or 1), n ...
.


Theorem

Let p_n be a sequence of real numbers in ,1 such that the sequence n p_n converges to a finite limit \lambda . Then: :\lim_ p_n^k (1-p_n)^ = e^\frac


Proofs

: \begin \lim\limits_ p_n^k (1-p_n)^ &\simeq \lim_\frac \left(\frac\right)^k \left(1- \frac\right)^ \\ &= \lim_\frac\frac \left(1- \frac\right)^ \\ &= \lim_\frac \left(1-\frac\right)^ \end . Since : \lim_ \left(1-\frac\right)^ = e^ and : \lim_ \left(1- \frac\right)^=1 This leaves :p^k (1-p)^ \simeq \frac.


Alternative proof

Using
Stirling's approximation In mathematics, Stirling's approximation (or Stirling's formula) is an approximation for factorials. It is a good approximation, leading to accurate results even for small values of n. It is named after James Stirling, though a related but less p ...
, we can write: : \begin p^k (1-p)^ &= \frac p^k (1-p)^ \\ &\simeq \frac p^k (1-p)^ \\ &= \sqrt\fracp^k (1-p)^. \end Letting n \to \infty and np = \lambda: : \begin p^k (1-p)^ &\simeq \frac \\&= \frac \\&= \frac \\ &\simeq \frac . \end As n \to \infty, \left(1-\frac\right)^n \to e^ so: :\begin p^k (1-p)^ &\simeq \frac \\&= \frac \end


Ordinary generating functions

It is also possible to demonstrate the theorem through the use of
ordinary generating function In mathematics, a generating function is a way of encoding an infinite sequence of numbers () by treating them as the coefficients of a formal power series. This series is called the generating function of the sequence. Unlike an ordinary ser ...
s of the binomial distribution: : G_\operatorname(x;p,N) \equiv \sum_^N \left \binom p^k (1-p)^ \rightx^k = \Big 1 + (x-1)p \BigN by virtue of the
binomial theorem In elementary algebra, the binomial theorem (or binomial expansion) describes the algebraic expansion of powers of a binomial. According to the theorem, it is possible to expand the polynomial into a sum involving terms of the form , where the ...
. Taking the limit N \rightarrow \infty while keeping the product pN\equiv\lambda constant, we find : \lim_ G_\operatorname(x;p,N) = \lim_ \left 1 + \frac \rightN = \mathrm^ = \sum_^ \left \frac \rightx^k which is the OGF for the Poisson distribution. (The second equality holds due to the definition of the
exponential function The exponential function is a mathematical function denoted by f(x)=\exp(x) or e^x (where the argument is written as an exponent). Unless otherwise specified, the term generally refers to the positive-valued function of a real variable, ...
.)


See also

*
De Moivre–Laplace theorem In probability theory, the de Moivre–Laplace theorem, which is a special case of the central limit theorem, states that the normal distribution may be used as an approximation to the binomial distribution under certain conditions. In particu ...
*
Le Cam's theorem In probability theory, Le Cam's theorem, named after Lucien Le Cam (1924 – 2000), states the following. Suppose: * X_1, X_2, X_3, \ldots are independent random variables, each with a Bernoulli distribution (i.e., equal to either 0 or 1), n ...


References

{{Reflist Articles containing proofs Probability theorems