This paper considers the multiarmed bandit problem and presents a new proof of the optimality of the Gittins index policy. The proof is intuitive and does not require an interchange argument. The insight it affords is used to give a streamlined summary of previous research and to prove a new result: The optimal value function is a submodular set function of the available projects.
No takes yet. Share an insight, caveat, or question.
Richard Weber (1992) studied this question.
Synapse has enriched 5 related papers. Consider them for comparative context: