Partial (pooled) likelihood estimation for
panel data
In statistics and econometrics, panel data and longitudinal data are both multi-dimensional data involving measurements over time. Panel data is a subset of longitudinal data where observations are for the same subjects each time.
Time series and ...
is a
quasi-maximum likelihood method for
panel analysis
Panel (data) analysis is a statistical method, widely used in social science, epidemiology, and econometrics to analyze two-dimensional (typically cross sectional and longitudinal) panel data. The data are usually collected over time and over the s ...
that assumes that density of
given
is correctly specified for each time period but it allows for misspecification in the conditional density of
given
.
Description
Concretely, partial likelihood estimation uses the product of conditional densities as the density of the joint conditional distribution. This generality facilitates
maximum likelihood
In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of an assumed probability distribution, given some observed data. This is achieved by maximizing a likelihood function so that, under the assumed stati ...
methods in panel data setting because fully specifying conditional distribution of ''y
i'' can be computationally demanding.
[Wooldridge, J.M., Econometric Analysis of Cross Section and Panel Data, MIT Press, Cambridge, Mass.] On the other hand, allowing for misspecification generally results in violation of information equality and thus requires robust
standard error estimator for inference.
In the following exposition, we follow the treatment in Wooldridge.
Particularly, the asymptotic derivation is done under fixed-T, growing-N setting.
Writing the conditional density of y
it given ''x
it'' as ''f
t'' (''y
it'' , ''x
it'';θ), the partial maximum likelihood estimator solves:
:
In this formulation, the joint conditional density of ''y
i'' given ''x
i'' is modeled as ''Î
t'' ''f
t'' (''y
it'' , ''x
it'' ; θ). We assume that ''f
t (y
it , x
it ; θ)'' is correctly specified for each ''t'' = 1,...,''T'' and that there exists ''θ
0'' ∈ Θ that uniquely maximizes ''E
t (yit│xit ; θ)">t (yit│xit ; θ)'.
But, it is not assumed that the joint conditional density is correctly specified. Under some regularity conditions, partial MLE is consistent and asymptotically normal.
By the usual argument for
M-estimators (details in Wooldridge
), the asymptotic variance of ''(θ
MLE- θ
0) is A
−1 BA
−1'' where ''A
−1 = E
t∇2θ logft (yit│xit ; θ)">Σt∇2θ logft (yit│xit ; θ)sup>−1 and B=E
t∇θ logft (yit│xit ; θ) ) ( Σt∇θ logft (yit│xit; θ ) )T"> Σt∇θ logft (yit│xit ; θ) ) ( Σt∇θ logft (yit│xit; θ ) )T'. If the joint conditional density of y
i given x
i is correctly specified, the above formula for asymptotic variance simplifies because information equality says ''B=A''. Yet, except for special circumstances, the
joint density modeled by partial MLE is not correct. Therefore, for valid inference, the above formula for asymptotic variance should be used. For information equality to hold, one sufficient condition is that scores of the densities for each time period are uncorrelated. In dynamically complete models, the condition holds and thus simplified asymptotic variance is valid.
Pooled QMLE for Poisson models
Pooled QMLE is a technique that allows estimating parameters when
panel data
In statistics and econometrics, panel data and longitudinal data are both multi-dimensional data involving measurements over time. Panel data is a subset of longitudinal data where observations are for the same subjects each time.
Time series and ...
is available with Poisson outcomes. For instance, one might have information on the number of patents files by a number of different firms over time. Pooled QMLE does not necessarily contain
unobserved effects (which can be either
random effects or
fixed effects
In statistics, a fixed effects model is a statistical model in which the model parameters are fixed or non-random quantities. This is in contrast to random effects models and mixed models in which all or some of the model parameters are random v ...
), and the estimation method is mainly proposed for these purposes. The computational requirements are less stringent, especially compared to
fixed-effect Poisson models, but the trade off is the possibly strong assumption of no
unobserved heterogeneity. Pooled refers to pooling the data over the different time periods ''T'', while QMLE refers to the quasi-maximum likelihood technique.
The
Poisson distribution
In probability theory and statistics, the Poisson distribution () is a discrete probability distribution that expresses the probability of a given number of events occurring in a fixed interval of time if these events occur with a known const ...
of
given
is specified as follows:
[Cameron, C. A. and P. K. Trivedi (2015) Count Panel Data, Oxford Handbook of Panel Data, ed. by B. Baltagi, Oxford University Press, pp. 233–256]
:
the starting point for Poisson pooled QMLE is the conditional mean assumption. Specifically, we assume that for some
in a compact parameter space B, the conditional mean is given by
:
The compact parameter space condition is imposed to enable the use of
M-estimation techniques, while the conditional mean reflects the fact that the population mean of a Poisson process is the parameter of interest. In this particular case, the parameter governing the Poisson process is allowed to vary with respect to the vector
.
The function ''m'' can, in principle, change over time even though it is often specified as static over time.
[Wooldridge, J. (2002): Econometric Analysis of Cross Section and Panel Data, MIT Press, Cambridge, Mass.] Note that only the conditional mean function is specified, and we will get consistent estimates of
as long as this mean condition is correctly specified. This leads to the following first order condition, which represents the quasi-log likelihood for the pooled Poisson estimation:
: