Markov chains: long run proportion of a state

Dependencies:

  1. Markov chain

Let $X = [X_0, X_1, \ldots]$ be a markov chain. Let $N_{j,n}$ be the number of times the markov chain is in state $j$ in the first $n$ steps, i.e., \[ N_{j,n} = \sum_{t=0}^{n-1} \begin{cases}1 & \textrm{ if }X_t = j \\ 0 & \textrm{ if }X_t \neq j\end{cases}. \] Define \[ \pi_j = \lim_{n \to \infty} \frac{N_{j,n}}{n}. \] Then $\pi_j$ is called the long-run proportion of state $j$.

Dependency for:

  1. Markov chains: finite sink is positive recurrent
  2. Markov chains: long run proportion is inverse of time to reenter (incomplete)

Info:

Transitive dependencies:

  1. /sets-and-relations/de-morgan-laws
  2. /sets-and-relations/countable-set
  3. /analysis/topological-space
  4. Group
  5. Ring
  6. Semiring
  7. Matrix
  8. σ-algebra
  9. σ-algebra is closed under countable intersections
  10. Measure
  11. Probability
  12. Conditional probability (incomplete)
  13. Generated σ-algebra
  14. Measurable function
  15. Borel algebra
  16. Generators of the real Borel algebra (incomplete)
  17. Random variable
  18. Markov chain