MANCOVA
   HOME

TheInfoList



OR:

Multivariate analysis of covariance (MANCOVA) is an extension of
analysis of covariance Analysis of covariance (ANCOVA) is a general linear model which blends ANOVA and regression. ANCOVA evaluates whether the means of a dependent variable (DV) are equal across levels of a categorical independent variable (IV) often called a tre ...
(
ANCOVA Analysis of covariance (ANCOVA) is a general linear model which blends ANOVA and regression. ANCOVA evaluates whether the means of a dependent variable (DV) are equal across levels of a categorical independent variable (IV) often called a tre ...
) methods to cover cases where there is more than one dependent variable and where the control of concomitant continuous independent variables –
covariate Dependent and independent variables are variables in mathematical modeling, statistical modeling and experimental sciences. Dependent variables receive this name because, in an experiment, their values are studied under the supposition or deman ...
s – is required. The most prominent benefit of the MANCOVA design over the simple
MANOVA In statistics, multivariate analysis of variance (MANOVA) is a procedure for comparing multivariate sample means. As a multivariate procedure, it is used when there are two or more dependent variables, and is often followed by significance tests ...
is the 'factoring out' of
noise Noise is unwanted sound considered unpleasant, loud or disruptive to hearing. From a physics standpoint, there is no distinction between noise and desired sound, as both are vibrations through a medium, such as air or water. The difference arise ...
or error that has been introduced by the covariant. A commonly used multivariate version of the
ANOVA Analysis of variance (ANOVA) is a collection of statistical models and their associated estimation procedures (such as the "variation" among and between groups) used to analyze the differences among means. ANOVA was developed by the statistician ...
F-statistic is Wilks' Lambda (Λ), which represents the ratio between the error variance (or covariance) and the effect variance (or covariance).
Statsoft Textbook, ANOVA/MANOVA.


Goals

Similarly to all tests in the
ANOVA Analysis of variance (ANOVA) is a collection of statistical models and their associated estimation procedures (such as the "variation" among and between groups) used to analyze the differences among means. ANOVA was developed by the statistician ...
family, the primary aim of the MANCOVA is to test for significant differences between group means. The process of characterising a covariate in a data source allows the reduction of the magnitude of the error term, represented in the MANCOVA design as ''MSerror''. Subsequently, the overall Wilks' Lambda will become larger and more likely to be characterised as significant. This grants the researcher more
statistical power In statistics, the power of a binary hypothesis test is the probability that the test correctly rejects the null hypothesis (H_0) when a specific alternative hypothesis (H_1) is true. It is commonly denoted by 1-\beta, and represents the chances ...
to detect differences within the data. The multivariate aspect of the MANCOVA allows the characterisation of differences in group means in regards to a linear combination of multiple dependent variables, while simultaneously controlling for covariates. ''Example situation where MANCOVA is appropriate:'' Suppose a scientist is interested in testing two new drugs for their effects on depression and anxiety scores. Also suppose that the scientist has information pertaining to the overall responsivity to drugs for each patient; accounting for this
covariate Dependent and independent variables are variables in mathematical modeling, statistical modeling and experimental sciences. Dependent variables receive this name because, in an experiment, their values are studied under the supposition or deman ...
will grant the test higher sensitivity in determining the effects of each drug on both dependent variables.


Assumptions

Certain assumptions must be met for the MANCOVA to be used appropriately: # Normality: For each group, each dependent variable must represent a
normal distribution In statistics, a normal distribution or Gaussian distribution is a type of continuous probability distribution for a real-valued random variable. The general form of its probability density function is : f(x) = \frac e^ The parameter \mu ...
of scores. Furthermore, any linear combination of dependent variables must be normally distributed. Transformation or removal of outliers can help ensure this assumption is met.
French, A. et al., 2010. Multivariate analysis of variance (MANOVA).
Violation of this assumption may lead to an increase in
Type I error In statistical hypothesis testing, a type I error is the mistaken rejection of an actually true null hypothesis (also known as a "false positive" finding or conclusion; example: "an innocent person is convicted"), while a type II error is the fa ...
rates.
Davis, K., 2003. Multiple analysis of variance (MANOVA) or multiple analysis of covariance (MANCOVA). Louisiana State University.
# Independence of observations: Each observation must be independent of all other observations; this assumption can be met by employing random sample, random sampling techniques. Violation of this assumption may lead to an increase in Type I error rates. # Homogeneity of variances: Each dependent variable must demonstrate similar levels of variance across each independent variable. Violation of this assumption can be conceptualised as a correlation existing between the variances and the means of dependent variables. This violation is often called '
heteroscedasticity In statistics, a sequence (or a vector) of random variables is homoscedastic () if all its random variables have the same finite variance. This is also known as homogeneity of variance. The complementary notion is called heteroscedasticity. The s ...
'
Bors, D. A. University of Toronto at Scarborough.
and can be tested for using
Levene's test In statistics, Levene's test is an inferential statistic used to assess the equality of variances for a variable calculated for two or more groups. Some common statistical procedures assume that variances of the populations from which different sam ...
.
McLaughlin, M., 2009. University of Southern Carolina.
# Homogeneity of covariances: The intercorrelation matrix between dependent variables must be equal across all levels of the independent variable. Violation of this assumption may lead to an increase in Type I error rates as well as decreased
statistical power In statistics, the power of a binary hypothesis test is the probability that the test correctly rejects the null hypothesis (H_0) when a specific alternative hypothesis (H_1) is true. It is commonly denoted by 1-\beta, and represents the chances ...
.


Logic of MANOVA

Analogous to
ANOVA Analysis of variance (ANOVA) is a collection of statistical models and their associated estimation procedures (such as the "variation" among and between groups) used to analyze the differences among means. ANOVA was developed by the statistician ...
, MANOVA is based on the product of model variance matrix, \Sigma_\text and inverse of the error variance matrix, \Sigma_\text^, or A=\Sigma_\text \times \Sigma_\text^. The hypothesis that \Sigma_\text = \Sigma_\text implies that the product A \sim I. Invariance considerations imply the MANOVA statistic should be a measure of magnitude (mathematics), magnitude of the
singular value decomposition In linear algebra, the singular value decomposition (SVD) is a factorization of a real or complex matrix. It generalizes the eigendecomposition of a square normal matrix with an orthonormal eigenbasis to any \ m \times n\ matrix. It is related ...
of this matrix product, but there is no unique choice owing to the multi-
dimension In physics and mathematics, the dimension of a Space (mathematics), mathematical space (or object) is informally defined as the minimum number of coordinates needed to specify any Point (geometry), point within it. Thus, a Line (geometry), lin ...
al nature of the alternative hypothesis. The most common statistics are summaries based on the roots (or
eigenvalues In linear algebra, an eigenvector () or characteristic vector of a linear transformation is a nonzero vector that changes at most by a scalar factor when that linear transformation is applied to it. The corresponding eigenvalue, often denoted b ...
) \lambda_p of the A matrix: *
Samuel Stanley Wilks Samuel Stanley Wilks (June 17, 1906 – March 7, 1964) was an American mathematician and academic who played an important role in the development of mathematical statistics, especially in regard to practical applications. Early life and edu ...
' Λ: :: \Lambda_\text = \prod _ \frac 1 = \det(I + A)^ = \frac : distributed as
lambda Lambda (}, ''lám(b)da'') is the 11th letter of the Greek alphabet, representing the voiced alveolar lateral approximant . In the system of Greek numerals, lambda has a value of 30. Lambda is derived from the Phoenician Lamed . Lambda gave rise ...
(Λ) * the Pillai– M. S. Bartlett
trace Trace may refer to: Arts and entertainment Music * ''Trace'' (Son Volt album), 1995 * ''Trace'' (Died Pretty album), 1993 * Trace (band), a Dutch progressive rock band * ''The Trace'' (album) Other uses in arts and entertainment * ''Trace'' ...
, :: \Lambda_\text = \sum_ \frac = \operatorname((I + A)^) * the Lawley– Hotelling trace, :: \Lambda_\text = \sum _ \lambda_p = \operatorname(A) *
Roy's greatest root Roy's is an upscale American restaurant that specializes in Hawaiian and Japanese fusion cuisine, with a focus on sushi, seafood and steak. The chain was founded by James Beard Foundation Award Winner, Roy Yamaguchi in 1988 in Honolulu, Hawaii ...
(also called ''Roy's largest root''), :: \Lambda_\text = \max_p(\lambda_p) = \, A\, _\infty


Covariates

In statistics, a covariate represents a source of variation that has not been controlled in the experiment and is believed to affect the dependent variable. The aim of such techniques as
ANCOVA Analysis of covariance (ANCOVA) is a general linear model which blends ANOVA and regression. ANCOVA evaluates whether the means of a dependent variable (DV) are equal across levels of a categorical independent variable (IV) often called a tre ...
is to remove the effects of such uncontrolled variation, in order to increase statistical power and to ensure an accurate measurement of the true relationship between independent and dependent variables. An example is provided by the analysis of trend in sea-level by Woodworth (1987). Here the
dependent variable Dependent and independent variables are variables in mathematical modeling, statistical modeling and experimental sciences. Dependent variables receive this name because, in an experiment, their values are studied under the supposition or demand ...
(and variable of most interest) was the annual mean sea level at a given location for which a series of yearly values were available. The primary independent variable was "time". Use was made of a "covariate" consisting of yearly values of annual mean atmospheric pressure at sea level. The results showed that inclusion of the covariate allowed improved estimates of the trend against time to be obtained, compared to analyses which omitted the covariate.


See also

*
Discriminant function analysis Linear discriminant analysis (LDA), normal discriminant analysis (NDA), or discriminant function analysis is a generalization of Fisher's linear discriminant, a method used in statistics and other fields, to find a linear combination of features ...
*
ANCOVA Analysis of covariance (ANCOVA) is a general linear model which blends ANOVA and regression. ANCOVA evaluates whether the means of a dependent variable (DV) are equal across levels of a categorical independent variable (IV) often called a tre ...
*
MANOVA In statistics, multivariate analysis of variance (MANOVA) is a procedure for comparing multivariate sample means. As a multivariate procedure, it is used when there are two or more dependent variables, and is often followed by significance tests ...


References

{{DEFAULTSORT:Mancova Analysis of variance