Cantelli's inequality

Dependencies:

  1. Random variable
  2. Expected value of a random variable
  3. Variance of a random variable
  4. Linearity of expectation
  5. Markov's bound

Let $X$ be a real-valued random variable. Let $t \ge 0$ and $\Var(X) = \sigma^2$. Then \[ \Pr(X \ge \E(X) + t) \le \frac{\sigma^2}{\sigma^2 + t^2}, \] \[ \Pr(X \le \E(X) - t) \le \frac{\sigma^2}{\sigma^2 + t^2}. \]

This is called Cantelli's inequality, or the one-sided Chebyshev inequality.

Proof

Let $Z = X - \E(X)$. Then $\E(Z) = 0$ and $\Var(Z) = \E(Z^2) = \sigma^2$.

Let $u = \sigma^2/t$. Then \begin{align} & \Pr(X \ge \E(X) + t) \\ &= \Pr(Z \ge t) \\ &\le \Pr((Z+u)^2 \ge (t+u)^2) \\ &\le \frac{\E((Z+u)^2)}{(t+u)^2} \tag{by Markov's bound} \\ &= \frac{\sigma^2 + u^2}{(t+u)^2} \\ &= \frac{\sigma^2}{\sigma^2 + t^2}. \end{align}

This proves the first part of Cantelli's inequality. To prove the second part, let $Y = \E(X) - X$, and apply Cantelli's inequality to $Y$. Since $\E(Y) = 0$ and $\Var(Y) = \sigma^2$, we get

\[ \Pr(X \le \E(X) - t) = \Pr(Y \ge t) \le \frac{\sigma^2}{\sigma^2 + t^2}. \]

Dependency for: None

Info:

Transitive dependencies:

  1. /analysis/topological-space
  2. /sets-and-relations/countable-set
  3. /sets-and-relations/de-morgan-laws
  4. /measure-theory/linearity-of-lebesgue-integral
  5. /measure-theory/lebesgue-integral
  6. σ-algebra
  7. Generated σ-algebra
  8. Borel algebra
  9. Measurable function
  10. Generators of the real Borel algebra (incomplete)
  11. Measure
  12. σ-algebra is closed under countable intersections
  13. Group
  14. Ring
  15. Field
  16. Vector Space
  17. Probability
  18. Random variable
  19. Expected value of a random variable
  20. Linearity of expectation
  21. Variance of a random variable
  22. Markov's bound