Stochastic online optimization. Single-point and multi-point non-linear multi-armed bandits. Convex and strongly-convex case
- Authors: Gasnikov A.V.1,2, Krymova E.A.2, Lagunovskaya A.A.3,1, Usmanova I.N.1,2, Fedorenko F.A.1
-
Affiliations:
- Moscow Institute of Physics and Technology (State University)
- Institute for Information Transmission Problems (Kharkevich Institute)
- Keldysh Institute of Applied Mathematics
- Issue: Vol 78, No 2 (2017)
- Pages: 224-234
- Section: Stochastic Systems, Queueing Systems
- URL: https://ogarev-online.ru/0005-1179/article/view/150534
- DOI: https://doi.org/10.1134/S0005117917020035
- ID: 150534
Cite item
Abstract
In this paper the gradient-free modification of the mirror descent method for convex stochastic online optimization problems is proposed. The crucial assumption in the problem setting is that function realizations are observed with minor noises. The aim of this paper is to derive the convergence rate of the proposed methods and to determine a noise level which does not significantly affect the convergence rate.
About the authors
A. V. Gasnikov
Moscow Institute of Physics and Technology (State University); Institute for Information Transmission Problems (Kharkevich Institute)
Author for correspondence.
Email: gasnikov@yandex.ru
Russian Federation, Moscow; Moscow
E. A. Krymova
Institute for Information Transmission Problems (Kharkevich Institute)
Email: gasnikov@yandex.ru
Russian Federation, Moscow
A. A. Lagunovskaya
Keldysh Institute of Applied Mathematics; Moscow Institute of Physics and Technology (State University)
Email: gasnikov@yandex.ru
Russian Federation, Moscow; Moscow
I. N. Usmanova
Moscow Institute of Physics and Technology (State University); Institute for Information Transmission Problems (Kharkevich Institute)
Email: gasnikov@yandex.ru
Russian Federation, Moscow; Moscow
F. A. Fedorenko
Moscow Institute of Physics and Technology (State University)
Email: gasnikov@yandex.ru
Russian Federation, Moscow
Supplementary files
