A singular perturbation approach to modeling and control of Markov chains

Finite state continuous time Markov processes with weak interactions are modeled as singularly perturbed systems. Aggregate states are obtained using a grouping algorithm. Two-time scale expansions simplify cost equations and lead to decentralized optimization algorithms.