Answers are grounded in this paper and cite their sources.
Consider a Markov chain with an enumerable infinity of states, labelled 0, 1, 2, …, whose one-step transition probabilities p ij are independent of time. Then I write and, departing slightly from the usual convention, Then it is known ((1), pp. 324–34, or (6)) that the limits π ij always exist, and that
No takes yet. Share an insight, caveat, or question.
J. G. Mauldon (1957) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: