PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
February 10, 20240 citationsOpen Access

Fast UCB-type algorithms for stochastic bandits with heavy and super heavy symmetric noise

View Full Paper
YDYuriy DornAKAlexandr KatrutsaILIlgam Latypov

Key Points

Key points are not available for this paper at this time.

Abstract

In this study, we propose a new method for constructing UCB-type algorithms for stochastic multi-armed bandits based on general convex optimization methods with an inexact oracle. We derive the regret bounds corresponding to the convergence rates of the optimization methods. We propose a new algorithm Clipped-SGD-UCB and show, both theoretically and empirically, that in the case of symmetric noise in the reward, we can achieve an O (TKT T) regret bound instead of O (T^1{1+} K^{1+}) for the case when the reward distribution satisfies Eₗ ₃|X|^1+ ^1+ ( (0, 1]), i. e. perform better than it is assumed by the general lower bound for bandits with heavy-tails. Moreover, the same bound holds even when the reward distribution does not have the expectation, that is, when <0.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Dorn et al. (2024) studied this question.

synapsesocial.com/papers/68e79adbb6db64358770b4cehttps://doi.org/10.48550/arxiv.2402.07062
Ask AI
Helpful
Bookmark
Share
View Full Paper