Law Of Total Cumulance

In probability theory and mathematical statistics, the law of total cumulance is a generalization to cumulants of the law of total probability, the law of total expectation, and the law of total variance. It has applications in the analysis of time series. It was introduced by David Brillinger.David Brillinger, "The calculation of cumulants via conditioning", ''Annals of the Institute of Statistical Mathematics'', Vol. 21 (1969), pp. 215–218.

It is most transparent when stated in its most general form, for ''joint'' cumulants, rather than for cumulants of a specified order for just one random variable. In general, we have

: $\kappa(X_1,\dots,X_n)=\sum_\pi \kappa(\kappa(X_i : i\in B \mid Y) : B \in \pi),$

where

* ''κ''(''X''₁, ..., ''X''_''n'') is the joint cumulant of ''n'' random variables ''X''₁, ..., ''X''_''n'', and
* the sum is over all partitions $\pi$ of the set of indices, and
* "''B'' ∈ ;" means ''B'' runs through the whole list of "blocks" of the partition , and
* ''κ''(''X''_''i'' : ''i'' ∈ ''B'' ,  ''Y'') is a conditional cumulant given the value of the random variable ''Y''. It is therefore a random variable in its own right—a function of the random variable ''Y''.

Examples

The special case of just one random variable and ''n'' = 2 or 3

Only in case ''n'' = either 2 or 3 is the ''n''th cumulant the same as the ''n''th central moment. The case ''n'' = 2 is well-known (see law of total variance). Below is the case ''n'' = 3. The notation ''μ''₃ means the third central moment.

:$\mu_3(X)= \operatorname(\mu_3(X\mid Y))+\mu_3(\operatorname(X\mid Y)) +3\operatorname(\operatorname(X\mid Y),\operatorname(X\mid Y)).$

General 4th-order joint cumulants

For general 4th-order cumulants, the rule gives a sum of 15 terms, as follows:

:
\begin
& \kappa(X_1,X_2,X_3,X_4) \\ pt= & \kappa(\kappa(X_1,X_2,X_3,X_4\mid Y)) \\ pt& \left.\begin
& +\kappa(\kappa(X_1,X_2,X_3\mid Y),\kappa(X_4\mid Y)) \\ pt& +\kappa(\kappa(X_1,X_2,X_4\mid Y),\kappa(X_3\mid Y)) \\ pt& +\kappa(\kappa(X_1,X_3,X_4\mid Y),\kappa(X_2\mid Y)) \\ pt& +\kappa(\kappa(X_2,X_3,X_4\mid Y),\kappa(X_1\mid Y))
\end\right\}(\text 3+1 \text) \\ pt& \left.\begin
& +\kappa(\kappa(X_1,X_2\mid Y),\kappa(X_3,X_4\mid Y)) \\ pt& +\kappa(\kappa(X_1,X_3\mid Y),\kappa(X_2,X_4\mid Y)) \\ pt& +\kappa(\kappa(X_1,X_4\mid Y),\kappa(X_2,X_3\mid Y))\end\right\}(\text 2+2 \text) \\ pt& \left.\begin
& +\kappa(\kappa(X_1,X_2\mid Y),\kappa(X_3\mid Y),\kappa(X_4\mid Y)) \\ pt& +\kappa(\kappa(X_1,X_3\mid Y),\kappa(X_2\mid Y),\kappa(X_4\mid Y)) \\ pt& +\kappa(\kappa(X_1,X_4\mid Y),\kappa(X_2\mid Y),\kappa(X_3\mid Y)) \\ pt& +\kappa(\kappa(X_2,X_3\mid Y),\kappa(X_1\mid Y),\kappa(X_4\mid Y)) \\ pt& +\kappa(\kappa(X_2,X_4\mid Y),\kappa(X_1\mid Y),\kappa(X_3\mid Y)) \\ pt& +\kappa(\kappa(X_3,X_4\mid Y),\kappa(X_1\mid Y),\kappa(X_2\mid Y))
\end\right\}(\text 2+1+1 \text) \\ pt& \begin +\kappa(\kappa(X_1\mid Y),\kappa(X_2\mid Y),\kappa(X_3\mid Y),\kappa(X_4\mid Y)). \end
\end

Cumulants of compound Poisson random variables

Suppose ''Y'' has a Poisson distribution with expected value ''λ'', and ''X'' is the sum of ''Y'' copies of ''W'' that are independent of each other and of ''Y''.

:$X=\sum_^Y W_y.$

All of the cumulants of the Poisson distribution are equal to each other, and so in this case are equal to ''λ''. Also recall that if random variables ''W''₁, ..., ''W''_''m'' are independent, then the ''n''th cumulant is additive:

:$\kappa_n(W_1+\cdots+W_m)=\kappa_n(W_1)+\cdots+\kappa_n(W_m).$

We will find the 4th cumulant of ''X''. We have:

:
\begin
\kappa_4(X) = & \kappa(X,X,X,X) \\ pt= &\kappa_1(\kappa_4(X\mid Y))+4\kappa(\kappa_3(X\mid Y),\kappa_1(X\mid Y))+3\kappa_2(\kappa_2(X\mid Y)) \\
& +6\kappa(\kappa_2(X\mid Y),\kappa_1(X\mid Y),\kappa_1(X\mid Y))+\kappa_4(\kappa_1(X\mid Y)) \\ pt= & \kappa_1(Y\kappa_4(W))+4\kappa(Y\kappa_3(W),Y\kappa_1(W))
+3\kappa_2(Y\kappa_2(W)) \\
& +6\kappa(Y\kappa_2(W),Y\kappa_1(W),Y\kappa_1(W))
+\kappa_4(Y\kappa_1(W)) \\ pt= & \kappa_4(W)\kappa_1(Y)+4\kappa_3(W)\kappa_1(W)\kappa_2(Y)
+3\kappa_2(W)^2 \kappa_2(Y) \\
& +6\kappa_2(W) \kappa_1(W)^2 \kappa_3(Y)+\kappa_1(W)^4 \kappa_4(Y) \\ pt= & \kappa_4(W)\lambda + 4\kappa_3(W)\kappa_1(W)\lambda + 3\kappa_2(W)^2+6\kappa_2(W) \kappa_1(W)^2 \lambda + \kappa_1(W)^4\lambda \\ pt= & \lambda \operatorname E(W^4) \qquad\text
\end

We recognize the last sum as the sum over all partitions of the set , of the product over all blocks of the partition, of cumulants of ''W'' of order equal to the size of the block. That is precisely the 4th raw moment of ''W'' (see cumulant for a more leisurely discussion of this fact). Hence the cumulants of ''X'' are the moments of ''W'' multiplied by ''λ''.

In this way we see that every moment sequence is also a cumulant sequence (the converse cannot be true, since cumulants of even order ≥ 4 are in some cases negative, and also because the cumulant sequence of the normal distribution is not a moment sequence of any probability distribution).

Conditioning on a Bernoulli random variable

Suppose ''Y'' = 1 with probability ''p'' and ''Y'' = 0 with probability ''q'' = 1 − ''p''. Suppose the conditional probability distribution of ''X'' given ''Y'' is ''F'' if ''Y'' = 1 and ''G'' if ''Y'' = 0. Then we have

:$\kappa_n(X)=p\kappa_n(F)+q\kappa_n(G)+\sum_ \kappa_(Y)\prod_ (\kappa_(F)-\kappa_(G))$

where $\pi<\widehat$ means is a partition of the set that is finer than the coarsest partition – the sum is over all partitions except that one. For example, if ''n'' = 3, then we have

:$\kappa_3(X)=p\kappa_3(F)+q\kappa_3(G)+3pq(\kappa_2(F)-\kappa_2(G))(\kappa_1(F)-\kappa_1(G))+pq(q-p)(\kappa_1(F)-\kappa_1(G))^3.$

References

{{DEFAULTSORT:Law Of Total Cumulance
Algebra of random variables
Theory of probability distributions
Theorems in statistics
Statistical laws