Answers are grounded in this paper and cite their sources.
The paper discusses convergence issues when training adaptive critic designs (ACD) to control dynamic systems expressed as Markov sequences. We critically review two published convergence results of critic based training and propose to shift emphasis towards more practically valuable convergence proofs. We show a possible way to prove convergence of ACD training.
No takes yet. Share an insight, caveat, or question.
Prokhorov et al. (2002) studied this question.