Markov chains: recurrence is a class property
Dependencies:
- Markov chain
- Markov chains: accessibility and state classes
- Markov chains: recurrent states
- Markov chains: recurrent iff expected number of visits is infinite
Let $X = [X_0, X_1, \ldots]$ be a markov chain with transition function $P$. Suppose state $i$ is transient and states $i$ and $j$ communicate. Then $j$ is also recurrent.
This implies that either all states of a state class are recurrent, or no state in the class is recurrent. We call a class recurrent iff all states in the class are recurrent.
Proof can be found in Corollary 4.2 of [intro-to-prob-models-book].
Dependency for:
Info:
- Depth: 9
- Number of transitive dependencies: 31
Transitive dependencies:
- /analysis/topological-space
- /sets-and-relations/countable-set
- /sets-and-relations/poset
- /sets-and-relations/equivalence-relation
- /sets-and-relations/de-morgan-laws
- /measure-theory/linearity-of-lebesgue-integral
- /measure-theory/lebesgue-integral
- σ-algebra
- Generated σ-algebra
- Borel algebra
- Measurable function
- Generators of the real Borel algebra (incomplete)
- Measure
- σ-algebra is closed under countable intersections
- Group
- Ring
- Field
- Vector Space
- Semiring
- Matrix
- Identity matrix
- Probability
- Conditional probability (incomplete)
- Random variable
- Markov chain
- Markov chains: recurrent states
- Chapman-Kolmogorov equation
- Markov chains: accessibility and state classes
- Expected value of a random variable
- Linearity of expectation
- Markov chains: recurrent iff expected number of visits is infinite