Fisher–Tippett–Gnedenko theorem

In statistics, the Fisher–Tippett–Gnedenko theorem (also the Fisher–Tippett theorem or the extreme value theorem) is a general result in extreme value theory regarding asymptotic distribution of extreme order statistics. The maximum of a sample of iid random variables after proper renormalization can only converge in distribution to one of 3 possible distributions, the Gumbel distribution, the Fréchet distribution, or the Weibull distribution. Credit for the extreme value theorem and its convergence details are given to Fréchet (1927), Fisher and Tippett (1928), Mises (1936) and Gnedenko (1943).

The role of the extremal types theorem for maxima is similar to that of central limit theorem for averages, except that the central limit theorem applies to the average of a sample from any distribution with finite variance, while the Fisher–Tippet–Gnedenko theorem only states that ''if'' the distribution of a normalized maximum converges, ''then'' the limit has to be one of a particular class of distributions. It does not state that the distribution of the normalized maximum does converge.

Statement

Let $X_1,X_2,\ldots, X_n$ be a sequence of independent and identically-distributed random variables with cumulative distribution function $F$. Suppose that there exist two sequences of real numbers $a_n > 0$ and $b_n \in \mathbb$ such that the following limits converge to a non-degenerate distribution function:
:$\lim_P\left(\frac\leq x\right) = G(x)$,
or equivalently:

:$\lim_F^n\left(a_n x + b_n \right) = G(x)$.

In such circumstances, the limit distribution $G$ belongs to either the Gumbel, the Fréchet or the Weibull family.

In other words, if the limit above converges, $G(x)$ will assume the form:

:$G_\gamma(x) = \exp\left(-(1 + \gamma \, x)^ \right), \;\; 1 + \gamma \, x_ > 0$

or else

:$G_0(x) = \exp\left(-\exp(-x)\right)$

for some parameter $\gamma.$ This is the cumulative distribution function of the generalized extreme value distribution (GEV) with extreme value index $\gamma$. The GEV distribution groups the Gumbel, Fréchet and Weibull distributions into a single one. Note that the second formula (the Gumbel distribution) is the limit of the first as $\gamma$ goes to zero.

Conditions of convergence

The Fisher–Tippett–Gnedenko theorem is a statement about the convergence of the limiting distribution $G(x)$ above. The study of conditions for convergence of $G$ to particular cases of the generalized extreme value distribution began with Mises (1936) and was further developed by Gnedenko (1943).

Let $F$ be the distribution function of $X$, and $X_1, \dots, X_n$ an i.i.d. sample thereof. Also let $x^*$ be the populational maximum, i.e. $x^* = \sup\$. The limiting distribution of the normalized sample maximum, given by $G$ above, will then be:

*A Fréchet distribution ($\gamma > 0$) if and only if $x^* = \infty$ and $\lim_ \frac = u^$ for all $u> 0$.
:This corresponds to what is called a heavy tail. In this case, possible sequences that will satisfy the theorem conditions are $b_n = 0$ and $a_n=F^\left(1-\frac\right)$.

*A Gumbel distribution ($\gamma = 0$), with $x^*$ finite or infinite, if and only if $\lim_ \frac = e^$ for all $u>0$ with $f(t) := \frac$.
: Possible sequences here are $b_n = F^\left(1-\frac\right)$ and $a_n = f\left(F^\left(1-\frac\right)\right)$.

*A Weibull distribution ($\gamma < 0$) if and only if $x^*$ is finite and $\lim_ \frac = u^$ for all $u>0$.
: Possible sequences here are $b_n = x^*$ and $a_n=x^* - F^\left(1-\frac\right)$.

Examples

Fréchet distribution

For the Cauchy distribution

:$f(x)=(\pi^2+x^2)^$

the cumulative distribution function is:

:$F(x)=1/2+\frac 1\pi\arctan(x/\pi)$

$1-F(x)$ is asymptotic to $1/x,$ or

:$\ln F(x)\sim-1/x$

and we have

:$\ln F(x)^n=n\ln F(x)\sim-n/x.$

Thus we have

:$F(x)^n\approx\exp(-n/x)$

and letting $u=x/n-1$ (and skipping some explanation)

:$\lim_F(nu+n)^n =\exp(-(1+u)^)= G_1(u)$

for any $u.$ The expected maximum value therefore goes up linearly with .

Gumbel distribution

Let us take the normal distribution with cumulative distribution function

:$F(x)=\frac 12\text(-x/\sqrt 2).$

We have

:$\ln F(x)\sim-\frac$

and

:$\ln F(x)^n=n\ln F(x)\sim-\frac.$

Thus we have

:$F(x)^n\approx\exp\left(-\frac\right).$

If we define $c_n$ as the value that satisfies

:$\frac=1$

then around $x=c_n$

:$\frac\approx\exp(c_n(c_n-x)).$

As increases, this becomes a good approximation for a wider and wider range of $c_n(c_n-x)$ so letting $u=c_n(c_n-x)$ we find that

:$\lim_F(u/c_n+c_n)^n =\exp(-\exp(-u))= G_0(u).$

Equivalently,

:$\lim_P\Bigl(\frac \leq u \Bigr) =\exp(-\exp(-u))= G_0(u).$

We can see that $\ln c_n\sim(\ln\ln n)/2$ and then

:$c_n\sim\sqrt$

so the maximum is expected to climb ever more slowly toward infinity.

Weibull distribution

We may take the simplest example, a uniform distribution between 0 and 1, with cumulative distribution function

:$F(x)=x$ from 0 to 1.

Approaching 1 we have

:$\ln F(x)^n=n\ln F(x)\sim-n(1-x).$

Then

:$F(x)^n\approx\exp(nx-n).$

Letting $u=1+n(1-x)$ we have

:$\lim_F(u/n+1)^n=\exp\left(-(1-u)\right)=G_(u).$

The expected maximum approaches 1 inversely proportionally to .

See also

* Extreme value theory
* Gumbel distribution
* Generalized extreme value distribution
* Pickands–Balkema–de Haan theorem
* Generalized Pareto distribution
Exponentiated generalized Pareto distribution

Notes

{{DEFAULTSORT:Fisher-Tippett-Gnedenko theorem
Theorems in statistics
Extreme value data
Tails of probability distributions