Key points are not available for this paper at this time.
"Markov Decision Processes: Discrete Stochastic Dynamic Programming." Technometrics, 37(3), p. 353
Laurence A. Baxter (Tue,) studied this question.