Markov chains: recurrent states

Dependencies:

  1. Markov chain

Let $X = [X_0, X_1, \ldots]$ be a markov chain. Let $R_i = \bigvee_{t=1}^{\infty} (X_t = i)$, i.e., $R_i$ is the event that we'll enter state $i$ at some time $t \ge 1$. Then state $i$ is said to be recurrent iff $\Pr(R_i \mid X_0 = i) = 1$. Intuitively, this means state $i$ is recurrent iff we will always come back to state $i$ if we start from it.

Dependency for:

  1. Markov chains: finite sink is recurrent (incomplete)
  2. Markov chains: recurrent class is sink
  3. Markov chains: recurrent iff infinite visits
  4. Markov chains: recurrence is a class property
  5. Markov chains: positive recurrence
  6. Markov chains: recurrent iff expected number of visits is infinite
  7. Markov chains: recurrent state to acessible state (incomplete)
  8. Markov chains: long run proportion is inverse of time to reenter (incomplete)

Info:

Transitive dependencies:

  1. /sets-and-relations/de-morgan-laws
  2. /sets-and-relations/countable-set
  3. /analysis/topological-space
  4. Group
  5. Ring
  6. Semiring
  7. Matrix
  8. σ-algebra
  9. σ-algebra is closed under countable intersections
  10. Measure
  11. Probability
  12. Conditional probability (incomplete)
  13. Generated σ-algebra
  14. Measurable function
  15. Borel algebra
  16. Generators of the real Borel algebra (incomplete)
  17. Random variable
  18. Markov chain