Introduction to matrix analytic methods in stochastic modeling, by G. Latouche and V. Ramaswamy

Discrete and continuous-time Markov chains are the most common classes of stochas- tic processes used in modeling randomly evolving systems. A lot is known about the theoretical and computational aspects of these processes, see Kulkarni [1] and the