Cochrane–Orcutt Estimation
   HOME

TheInfoList



OR:

Cochrane–Orcutt estimation is a procedure in
econometrics Econometrics is an application of statistical methods to economic data in order to give empirical content to economic relationships. M. Hashem Pesaran (1987). "Econometrics", '' The New Palgrave: A Dictionary of Economics'', v. 2, p. 8 p. 8 ...
, which adjusts a
linear model In statistics, the term linear model refers to any model which assumes linearity in the system. The most common occurrence is in connection with regression models and the term is often taken as synonymous with linear regression model. However, t ...
for
serial correlation Autocorrelation, sometimes known as serial correlation in the discrete time case, measures the correlation of a signal with a delayed copy of itself. Essentially, it quantifies the similarity between observations of a random variable at differe ...
in the
error term In mathematics and statistics, an error term is an additive type of error. In writing, an error term is an instance of faulty language or grammar. Common examples include: * errors and residuals in statistics, e.g. in linear regression * the error ...
. Developed in the 1940s, it is named after
statistician A statistician is a person who works with Theory, theoretical or applied statistics. The profession exists in both the private sector, private and public sectors. It is common to combine statistical knowledge with expertise in other subjects, a ...
s Donald Cochrane and
Guy Orcutt Guy Henderson Orcutt (July 5, 1917 – March 5, 2006) was an American econometrician. He was a long-time faculty member at the University of Wisconsin–Madison, and is known for developing the Cochrane–Orcutt estimation procedure. A native o ...
.


Theory

Consider the model :y_t = \alpha + X_t \beta+\varepsilon_t,\, where y_ is the value of the
dependent variable A variable is considered dependent if it depends on (or is hypothesized to depend on) an independent variable. Dependent variables are studied under the supposition or demand that they depend, by some law or rule (e.g., by a mathematical functio ...
of interest at time ''t'', \beta is a column
vector Vector most often refers to: * Euclidean vector, a quantity with a magnitude and a direction * Disease vector, an agent that carries and transmits an infectious pathogen into another living organism Vector may also refer to: Mathematics a ...
of coefficients to be estimated, X_ is a row vector of
explanatory variable A variable is considered dependent if it depends on (or is hypothesized to depend on) an independent variable. Dependent variables are studied under the supposition or demand that they depend, by some law or rule (e.g., by a mathematical function ...
s at time ''t'', and \varepsilon_t is the
error term In mathematics and statistics, an error term is an additive type of error. In writing, an error term is an instance of faulty language or grammar. Common examples include: * errors and residuals in statistics, e.g. in linear regression * the error ...
at time ''t''. If it is found, for instance via the
Durbin–Watson statistic In statistics, the Durbin–Watson statistic is a test statistic used to detect the presence of autocorrelation at lag 1 in the residuals (prediction errors) from a regression analysis. It is named after James Durbin and Geoffrey Watson. The ...
, that if the error term is serially correlated over time, then standard
statistical inference Statistical inference is the process of using data analysis to infer properties of an underlying probability distribution.Upton, G., Cook, I. (2008) ''Oxford Dictionary of Statistics'', OUP. . Inferential statistical analysis infers properties of ...
as normally applied to regressions is invalid because
standard error The standard error (SE) of a statistic (usually an estimator of a parameter, like the average or mean) is the standard deviation of its sampling distribution or an estimate of that standard deviation. In other words, it is the standard deviati ...
s are estimated with
bias Bias is a disproportionate weight ''in favor of'' or ''against'' an idea or thing, usually in a way that is inaccurate, closed-minded, prejudicial, or unfair. Biases can be innate or learned. People may develop biases for or against an individ ...
. To avoid this problem, the residuals must be modeled. If the process generating the residuals is found to be a stationary first-order autoregressive structure, \varepsilon_t =\rho \varepsilon_+e_t,\ , \rho, <1 , with the errors being
white noise In signal processing, white noise is a random signal having equal intensity at different frequencies, giving it a constant power spectral density. The term is used with this or similar meanings in many scientific and technical disciplines, i ...
, then the Cochrane–Orcutt procedure can be used to transform the model by taking a quasi-difference: :y_t - \rho y_ = \alpha(1-\rho)+(X_t - \rho X_)\beta + e_t. \, In this specification the error terms are white noise, so statistical inference is valid. Then the sum of squared residuals (the sum of squared estimates of e_t^2) is minimized with respect to (\alpha,\beta), conditional on \rho.


Inefficiency

The transformation suggested by Cochrane and Orcutt disregards the first observation of a time series, causing a loss of
efficiency Efficiency is the often measurable ability to avoid making mistakes or wasting materials, energy, efforts, money, and time while performing a task. In a more general sense, it is the ability to do things well, successfully, and without waste. ...
that can be substantial in small samples. A superior transformation, which retains the first observation with a weight of \sqrt was first suggested by Prais and Winsten, and later independently by Kadilaya.


Estimating the autoregressive parameter

If \rho is not known, then it is estimated by first regressing the untransformed model and obtaining the residuals , and regressing \hat_t on \hat_, leading to an estimate of \rho and making the transformed regression sketched above feasible. (Note that one data point, the first, is lost in this regression.) This procedure of autoregressing estimated residuals can be done once and the resulting value of \rho can be used in the transformed ''y'' regression, or the residuals of the residuals autoregression can themselves be autoregressed in consecutive steps until no substantial change in the estimated value of \rho is observed. The iterative Cochrane–Orcutt procedure might converge to a local but not
global minimum In mathematical analysis, the maximum and minimum of a function are, respectively, the greatest and least value taken by the function. Known generically as extremum, they may be defined either within a given range (the ''local'' or ''relative' ...
of the residual sum of squares. This problem disappears when using the Prais–Winsten transformation instead, which keeps the initial observation.


See also

* Hildreth–Lu estimation * Newey–West estimator * Prais–Winsten estimation *
Feasible generalized least squares In statistics, generalized least squares (GLS) is a method used to estimate the unknown parameters in a linear regression model. It is used when there is a non-zero amount of correlation between the residuals in the regression model. GLS is emp ...


References


Further reading

* * * * *


External links

* by
Mark Thoma Mark Allen Thoma (born December 15, 1956) is a macroeconomist and econometrician and a professor of economics at the Department of Economics of the University of Oregon. Thoma is best known as a regular columnist for ''The Fiscal Times'' through ...
. {{DEFAULTSORT:Cochrane-Orcutt Estimation Autocorrelation Curve fitting Regression with time series structure