Answers are grounded in this paper and cite their sources.
This paper considers an infinite stage linear decision problem with random coefficients. We assume that the randomness can be defined by a finite Markov chain. Under certain assumptions we are able to calculate an upper bound for the optimal value of the decision problem and to use that bound to determine a useful initial decision.
No takes yet. Share an insight, caveat, or question.
Richard C. Grinold (1976) studied this question.
Synapse has enriched 5 related papers. Consider them for comparative context: