Answers are grounded in this paper and cite their sources.
In this paper, we consider discrete-time infinite horizon problems of optimal control to a terminal set of states. These are the problems that are often taken as the starting point for adaptive dynamic programming. Under very general assumptions, we establish the uniqueness of the solution of Bellman's equation, and we provide convergence results for value and policy iterations.
No takes yet. Share an insight, caveat, or question.
Dimitri P. Bertsekas (2015) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: