In
statistics
Statistics (from German language, German: ', "description of a State (polity), state, a country") is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a s ...
, the Lehmann–Scheffé theorem ties together completeness, sufficiency, uniqueness, and best unbiased estimation.
[ The theorem states that any ]estimator
In statistics, an estimator is a rule for calculating an estimate of a given quantity based on Sample (statistics), observed data: thus the rule (the estimator), the quantity of interest (the estimand) and its result (the estimate) are distinguish ...
that is unbiased
Bias is a disproportionate weight ''in favor of'' or ''against'' an idea or thing, usually in a way that is inaccurate, closed-minded, prejudicial, or unfair. Biases can be innate or learned. People may develop biases for or against an individ ...
for a given unknown quantity and that depends on the data only through a complete
Complete may refer to:
Logic
* Completeness (logic)
* Completeness of a theory, the property of a theory that every formula in the theory's language or its negation is provable
Mathematics
* The completeness of the real numbers, which implies t ...
, sufficient statistic
In statistics, sufficiency is a property of a statistic computed on a sample dataset in relation to a parametric model of the dataset. A sufficient statistic contains all of the information that the dataset provides about the model parameters. It ...
is the unique best unbiased estimator of that quantity. The Lehmann–Scheffé theorem is named after Erich Leo Lehmann
Erich Leo Lehmann (20 November 1917 – 12 September 2009) was a German-born American statistician, who made a major contribution to nonparametric hypothesis testing. He is one of the eponyms of the Lehmann–Scheffé theorem and of the Hodges ...
and Henry Scheffé
Henry Scheffé (April 11, 1907 – July 5, 1977) was an American statistician.
He is known for the Lehmann–Scheffé theorem and Scheffé's method.
Education and career
Scheffé was born in New York City on April 11, 1907, the child of Germ ...
, given their two early papers.[
If is a complete sufficient statistic for and then is the uniformly minimum-variance unbiased estimator (UMVUE) of .
]
Statement
Let be a random sample from a distribution that has p.d.f (or p.m.f in the discrete case) where is a parameter in the parameter space. Suppose is a sufficient statistic for ''θ'', and let be a complete family. If then is the unique MVUE of ''θ''.
Proof
By the Rao–Blackwell theorem, if is an unbiased estimator of ''θ'' then