Answers are grounded in this paper and cite their sources.
Consider a stochastic process X ( t ) ( t ≧ 0) taking values in a countable state space, say, {1, 2,3, …}. To be picturesque we think of X ( t ) as the state which a particle is in at epoch t . Suppose the particle moves from state to state in such a way that the successive states visited form a Markov chain, and that the particle stays in a given state a random amount of time depending on the state it is in as well as on the state to be visited next. Below is a possible realization of such a process.
No takes yet. Share an insight, caveat, or question.
Erhan Çınlar (1969) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: