Optimal algorithms for stochastic multi-armed bandits with heavy tailed rewards
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Lee, K. | - |
dc.contributor.author | Yang, H. | - |
dc.contributor.author | Lim, S. | - |
dc.contributor.author | Oh, S. | - |
dc.date.accessioned | 2022-11-28T01:57:50Z | - |
dc.date.available | 2022-11-28T01:57:50Z | - |
dc.date.issued | 2020-12 | - |
dc.identifier.issn | 1049-5258 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/59357 | - |
dc.description.abstract | In this paper, we consider stochastic multi-armed bandits (MABs) with heavy-tailed rewards, whose p-th moment is bounded by a constant ?p for 1 < p = 2. First, we propose a novel robust estimator which does not require ?p as prior information, while other existing robust estimators demand prior knowledge about ?p. We show that an error probability of the proposed estimator decays exponentially fast. Using this estimator, we propose a perturbation-based exploration strategy and develop a generalized regret analysis scheme that provides upper and lower regret bounds by revealing the relationship between the regret and the cumulative density function of the perturbation. From the proposed analysis scheme, we obtain gap-dependent and gap-independent upper and lower regret bounds of various perturbations. We also find the optimal hyperparameters for each perturbation, which can achieve the minimax optimal regret bound with respect to total rounds. In simulation, the proposed estimator shows favorable performance compared to existing robust estimators for various p values and, for MAB problems, the proposed perturbation strategy outperforms existing exploration methods. © 2020 Neural information processing systems foundation. | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Neural information processing systems foundation | - |
dc.title | Optimal algorithms for stochastic multi-armed bandits with heavy tailed rewards | - |
dc.type | Article | - |
dc.identifier.bibliographicCitation | Advances in Neural Information Processing Systems, v.2020-December | - |
dc.description.isOpenAccess | N | - |
dc.identifier.scopusid | 2-s2.0-85108431916 | - |
dc.citation.title | Advances in Neural Information Processing Systems | - |
dc.citation.volume | 2020-December | - |
dc.type.docType | Conference Paper | - |
dc.publisher.location | 미국 | - |
dc.subject.keywordPlus | Stochastic systems | - |
dc.subject.keywordPlus | Cumulative density functions | - |
dc.subject.keywordPlus | Error probabilities | - |
dc.subject.keywordPlus | Exploration methods | - |
dc.subject.keywordPlus | Exploration strategies | - |
dc.subject.keywordPlus | Multi armed bandit | - |
dc.subject.keywordPlus | Multiarmed bandits (MABs) | - |
dc.subject.keywordPlus | Prior information | - |
dc.subject.keywordPlus | Robust estimators | - |
dc.subject.keywordPlus | Optimization | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.