Partial (pooled) likelihood estimation for
panel data
In statistics and econometrics, panel data and longitudinal data are both multi-dimensional data involving measurements over time. Panel data is a subset of longitudinal data where observations are for the same subjects each time.
Time series and ...
is a
quasi-maximum likelihood In statistics a quasi-maximum likelihood estimate (QMLE), also known as a pseudo-likelihood estimate or a composite likelihood estimate, is an estimate of a parameter ''θ'' in a statistical model that is formed by maximizing a function that is rela ...
method for
panel analysis Panel (data) analysis is a statistical method, widely used in social science, epidemiology, and econometrics to analyze two-dimensional (typically cross sectional and longitudinal) panel data. The data are usually collected over time and over the ...
that assumes that density of ''y
it'' given ''x
it'' is correctly specified for each time period but it allows for misspecification in the conditional density of ''y
i≔(y
i1,...,y
iT) given x
i≔(x
i1,...,x
iT)''.
Description
Concretely, partial likelihood estimation uses the product of conditional densities as the density of the joint conditional distribution. This generality facilitates
maximum likelihood
In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of an assumed probability distribution, given some observed data. This is achieved by maximizing a likelihood function so that, under the assumed sta ...
methods in panel data setting because fully specifying conditional distribution of ''y
i'' can be computationally demanding.
[Wooldridge, J.M., Econometric Analysis of Cross Section and Panel Data, MIT Press, Cambridge, Mass.] On the other hand, allowing for misspecification generally results in violation of information equality and thus requires robust
standard error estimator for inference.
In the following exposition, we follow the treatment in Wooldridge.
Particularly, the asymptotic derivation is done under fixed-T, growing-N setting.
Writing the conditional density of y
it given ''x
it'' as ''f
t'' (''y
it'' , ''x
it'';θ), the partial maximum likelihood estimator solves:
:
In this formulation, the joint conditional density of ''y
i'' given ''x
i'' is modeled as ''Î
t'' ''f
t'' (''y
it'' , ''x
it'' ; θ). We assume that ''f
t (y
it , x
it ; θ)'' is correctly specified for each ''t'' = 1,...,''T'' and that there exists ''θ
0'' ∈ Θ that uniquely maximizes ''E
t (yit│xit ; θ)">t (yit│xit ; θ)
But, it is not assumed that the joint conditional density is correctly specified. Under some regularity conditions, partial MLE is consistent and asymptotically normal.
By the usual argument for
M-estimator
In statistics, M-estimators are a broad class of extremum estimators for which the objective function is a sample average. Both non-linear least squares and maximum likelihood estimation are special cases of M-estimators. The definition of M-est ...
s (details in Wooldridge
), the asymptotic variance of ''(θ
MLE- θ
0) is A
−1 BA
−1'' where ''A
−1 = E
t∇2θ logft (yit│xit ; θ)">Σt∇2θ logft (yit│xit ; θ)sup>−1 and B=E
t∇θ logft (yit│xit ; θ) ) ( Σt∇θ logft (yit│xit; θ ) )T"> Σt∇θ logft (yit│xit ; θ) ) ( Σt∇θ logft (yit│xit; θ ) )T'. If the joint conditional density of y
i given x
i is correctly specified, the above formula for asymptotic variance simplifies because information equality says ''B=A''. Yet, except for special circumstances, the
joint density modeled by partial MLE is not correct. Therefore, for valid inference, the above formula for asymptotic variance should be used. For information equality to hold, one sufficient condition is that scores of the densities for each time period are uncorrelated. In dynamically complete models, the condition holds and thus simplified asymptotic variance is valid.
Pooled QMLE for Poisson models
Pooled QMLE is a technique that allows estimating parameters when
panel data
In statistics and econometrics, panel data and longitudinal data are both multi-dimensional data involving measurements over time. Panel data is a subset of longitudinal data where observations are for the same subjects each time.
Time series and ...
is available with Poisson outcomes. For instance, one might have information on the number of patents files by a number of different firms over time. Pooled QMLE does not necessarily contain
unobserved effects (which can be either
random effects
In statistics, a random effects model, also called a variance components model, is a statistical model where the model parameters are random variables. It is a kind of hierarchical linear model, which assumes that the data being analysed are dr ...
or
fixed effects), and the estimation method is mainly proposed for these purposes. The computational requirements are less stringent, especially compared to
fixed-effect Poisson models, but the trade off is the possibly strong assumption of no
unobserved heterogeneity. Pooled refers to pooling the data over the different time periods ''T'', while QMLE refers to the quasi-maximum likelihood technique.
The
Poisson distribution
In probability theory and statistics, the Poisson distribution is a discrete probability distribution that expresses the probability of a given number of events occurring in a fixed interval of time or space if these events occur with a known ...
of
given
is specified as follows:
[Cameron, C. A. and P. K. Trivedi (2015) Count Panel Data, Oxford Handbook of Panel Data, ed. by B. Baltagi, Oxford University Press, pp. 233–256]
:
the starting point for Poisson pooled QMLE is the conditional mean assumption. Specifically, we assume that for some
in a compact parameter space B, the conditional mean is given by
:
The compact parameter space condition is imposed to enable the use of
M-estimation techniques, while the conditional mean reflects the fact that the population mean of a Poisson process is the parameter of interest. In this particular case, the parameter governing the Poisson process is allowed to vary with respect to the vector
.
The function ''m'' can, in principle, change over time even though it is often specified as static over time.
[Wooldridge, J. (2002): Econometric Analysis of Cross Section and Panel Data, MIT Press, Cambridge, Mass.] Note that only the conditional mean function is specified, and we will get consistent estimates of
as long as this mean condition is correctly specified. This leads to the following first order condition, which represents the quasi-log likelihood for the pooled Poisson estimation:
:
A popular choice is
, as Poisson processes are defined over the positive real line.
This reduces the conditional moment to an exponential index function, where
is the linear index and exp is the link function.
[McCullagh, P. and J. A. Nelder (1989): Generalized Linear Models, CRC Monographs on Statistics and Applied Probability (Book 37), 2nd Edition, Chapman and Hall, London.]
References
{{Statistics
M-estimators
Maximum likelihood estimation
Panel data
Probability distribution fitting