Answers are grounded in this paper and cite their sources.
We consider a class of finite-time horizon nonlinear stochastic optimal control problem. Although the optimal control admits a path integral representation for this class of control problems, efficient computation of the associated path integrals remains a challenging task. We propose a new Monte Carlo approach that significantly improves upon existing methodology. We tackle the issue of exponential growth in variance with the time horizon by casting optimal control estimation as a smoothing problem for a state-space model, and applying smoothing algorithms based on particle Markov chain Monte Carlo. To further reduce the cost, we then develop a multilevel Monte Carlo method which allows us to obtain an estimator of the optimal control with O(ϵ2) mean squared error with a cost of O(ϵ−2log(ϵ)2). In contrast, a cost of O(ϵ−3) is required for the existing methodology to achieve the same mean squared error. Our approach is illustrated on two numerical examples.
No takes yet. Share an insight, caveat, or question.
Jasra et al. (2020) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: