Answers are grounded in this paper and cite their sources.
This paper considers undiscounted Markov Decision Problems. For the general multichain case, we obtain necessary and sufficient conditions which guarantee that the maximal total expected reward for a planning horizon of n epochs minus n times the long run average expected reward has a finite limit as n → ∞ for each initial state and each final reward vector. In addition, we obtain a characterization of the chain and periodicity structure of the set of one-step and J-step maximal gain policies. Finally, we discuss the asymptotic properties of the undiscounted value-iteration method.
No takes yet. Share an insight, caveat, or question.
Schweitzer et al. (1977) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: