Var(Y) = Var(E(Y|X)) + E(Var(Y|X))

Dependencies:

  1. Random variable
  2. Expected value of a random variable
  3. Variance of a random variable
  4. Conditional expectation
  5. Conditional variance
  6. Linearity of expectation
  7. Law of total probability: E(Y) = E(E(Y|X)) (incomplete)

Let $Y$ be a real-valued random variable. Let $X$ be a random variable. Then \[ \Var(Y) = \Var(\E(Y|X)) + \E(\Var(Y|X)). \]

Proof

Let $Z = \E(Y|X)$.

\begin{align} & \Var(Z) + \E(\Var(Y|X)) \\ &= (\E(Z^2) - \E(Z)^2) + \E(\E(Y^2|X) - \E(Y|X)^2) \tag{definition of $\Var$} \\ &= \E(Z^2) - \E(Z)^2 + \E(\E(Y^2|X)) - \E(Z^2) \tag{linearity of expectation} \\ &= \E(\E(Y^2|X)) - \E(Z)^2 \\ &= \E(Y^2) - \E(Y)^2 \tag{law of total probability} \\ &= \Var(Y) \end{align}

Dependency for: None

Info:

Transitive dependencies:

  1. /analysis/topological-space
  2. /sets-and-relations/countable-set
  3. /sets-and-relations/de-morgan-laws
  4. /measure-theory/linearity-of-lebesgue-integral
  5. /measure-theory/lebesgue-integral
  6. σ-algebra
  7. Generated σ-algebra
  8. Borel algebra
  9. Measurable function
  10. Generators of the real Borel algebra (incomplete)
  11. Measure
  12. σ-algebra is closed under countable intersections
  13. Group
  14. Ring
  15. Field
  16. Vector Space
  17. Probability
  18. Conditional probability (incomplete)
  19. Random variable
  20. Expected value of a random variable
  21. Conditional expectation
  22. Law of total probability: E(Y) = E(E(Y|X)) (incomplete)
  23. Linearity of expectation
  24. Variance of a random variable
  25. Conditional variance