Answers are grounded in this paper and cite their sources.
This paper considers the multiarmed bandit problem and presents a new proof of the optimality of the Gittins index policy. The proof is intuitive and does not require an interchange argument. The insight it affords is used to give a streamlined summary of previous research and to prove a new result: The optimal value function is a submodular set function of the available projects.
No takes yet. Share an insight, caveat, or question.
Richard Weber (1992) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: