In
statistics
Statistics (from German language, German: ''wikt:Statistik#German, Statistik'', "description of a State (polity), state, a country") is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of ...
, an adaptive estimator is an
estimator
In statistics, an estimator is a rule for calculating an estimate of a given quantity based on observed data: thus the rule (the estimator), the quantity of interest (the estimand) and its result (the estimate) are distinguished. For example, the ...
in a
parametric or
semiparametric In statistics, a semiparametric model is a statistical model that has Parametric statistics, parametric and nonparametric components.
A statistical model is a parameterized family of distributions: \ indexed by a statistical parameter, parameter \t ...
model with
nuisance parameter
Nuisance (from archaic ''nocence'', through Fr. ''noisance'', ''nuisance'', from Lat. ''nocere'', "to hurt") is a common law tort. It means that which causes offence, annoyance, trouble or injury. A nuisance can be either public (also "common") ...
s such that the presence of these nuisance parameters does not affect efficiency of estimation.
Definition
Formally, let parameter ''θ'' in a parametric model consists of two parts: the parameter of interest , and the nuisance parameter . Thus . Then we will say that
is an adaptive estimator of ''ν'' in the presence of ''η'' if this estimator is
regular, and efficient for each of the submodels
:
Adaptive estimator estimates the parameter of interest equally well regardless whether the value of the nuisance parameter is known or not.
The necessary condition for a
regular parametric model
In statistics, a parametric model or parametric family or finite-dimensional model is a particular class of statistical models. Specifically, a parametric model is a family of probability distributions that has a finite number of parameters.
Defi ...
to have an adaptive estimator is that
:
where ''z''
''ν'' and ''z''
''η'' are components of the
score function corresponding to parameters ''ν'' and ''η'' respectively, and thus ''I''
''νη'' is the top-right ''k×m'' block of the
Fisher information matrix
In mathematical statistics, the Fisher information (sometimes simply called information) is a way of measuring the amount of information that an observable random variable ''X'' carries about an unknown parameter ''θ'' of a distribution that model ...
''I''(''θ'').
Example
Suppose
is the
normal Normal(s) or The Normal(s) may refer to:
Film and television
* ''Normal'' (2003 film), starring Jessica Lange and Tom Wilkinson
* ''Normal'' (2007 film), starring Carrie-Anne Moss, Kevin Zegers, Callum Keith Rennie, and Andrew Airlie
* ''Norma ...
location-scale family:
:
Then the usual estimator
is adaptive: we can estimate the mean equally well whether we know the variance or not.
Notes
Basic references
*
{{refend
Other useful references
I. V. Blagouchine and E. Moreau: "Unbiased Adaptive Estimations of the Fourth-Order Cumulant for Real Random Zero-Mean Signal", ''IEEE Transactions on Signal Processing'', vol. 57, no. 9, pp. 3330–3346, September 2009.
Estimator