Markov chains: positive recurrence

Dependencies:

  1. Markov chain
  2. Markov chains: recurrent states

Let $X = [X_0, X_1, \ldots]$ be a markov chain. Let $i$ be a recurrent state. Let $T_i = \min_{t \ge 1} (X_t = i)$. Then $i$ is called positive recurrent iff $\E(T_i \mid X_0 = i)$ is finite. Otherwise, $i$ is called null recurrent.

Dependency for:

  1. Markov chains: finite sink is positive recurrent
  2. Markov chains: positive recurrence is a class property

Info:

Transitive dependencies:

  1. /analysis/topological-space
  2. /sets-and-relations/countable-set
  3. /sets-and-relations/de-morgan-laws
  4. σ-algebra
  5. Generated σ-algebra
  6. Borel algebra
  7. Measurable function
  8. Generators of the real Borel algebra (incomplete)
  9. Measure
  10. σ-algebra is closed under countable intersections
  11. Group
  12. Ring
  13. Semiring
  14. Matrix
  15. Probability
  16. Conditional probability (incomplete)
  17. Random variable
  18. Markov chain
  19. Markov chains: recurrent states