Abstract:This work is concerned with distributed online bandit learning over a multi-agent network, where a group of agents aim to seek the minimizer of a time-changing global loss function cooperatively. At each epoch, the global loss function can be represented as the sum of local loss functions known privately by individual agent over the network. Furthermore, local functions are sequentially accessible to agents, and all the agents have no knowledge of future loss functions. Thus, agents of the network must interchange messages to pursue an online estimation of the global loss function. In this paper, we are interested in a bandit setup, where only values of local loss functions at sampling points are disclosed to agents. Meanwhile, we consider a more general network with unbalanced digraphs that the corresponding weight matrix is allowed to be only row stochastic. By extending the celebrated mirror descent algorithm, we first design a distributed bandit online leaning method for the online distributed convex problem. We then establish the sublinear expected dynamic regret attained by the algorithm for convex and strongly convex loss functions, respectively, when the accumulative deviation of the minimizer sequence increases sublinearly. Moreover, the expected dynamic regret bound is analysed for strongly convex loss functions. In addition, the expected static regret bound with the order of O(root T) is obtained in the bandit setting while the corresponding static regret bound with the order of O(ln T) is also provided for the strongly convex case. Finally, numerical examples are provided to illustrate the efficiency of the method and to verify the theoretical findings.

Distributed Learning with Multi-Penalty Regularization

Convergence Analysis of Distributed Multi-Penalty Regularized Pairwise Learning

Estimates on Learning Rates for Multi-Penalty Distribution Regression

Distributed Learning with Convex SUM-of -Non-convex Objective

Distributed Learning and Distribution Regression of Coefficient Regularization.

Distributed Semi-supervised Regression Learning with Coefficient Regularization

Robust Regression for Non-Randomly Distributed Big Data with Application to Nonconvex Penalized Learning

Unified algorithms for distributed regularized linear regression model

Distributed non-convex regularization for generalized linear regression

Distributed Regularized Online Optimization Using Forward–backward Splitting

Max-Diversity Distributed Learning: Theory and Algorithms.

Distributed Nash Equilibrium Seeking for Monotone Generalized Noncooperative Games by a Regularized Penalty Method

Distributed Nonsmooth Optimization with Different Local Constraints Via Exact Penalty

Distributed Coordinate Descent for L1-regularized Logistic Regression

The distributed L1/2 regularization

Debiased distributed learning for sparse partial linear models in high dimensions

Penalized Quantile Regression for Distributed Big Data Using the Slack Variable Representation.

Distributed optimization for degenerate loss functions arising from over-parameterization

Learning Theory of Distributed Regression with Bias Corrected Regularization Kernel Network

Smoothing Proximal Gradient Method for General Structured Sparse Learning

Distributed Online Bandit Learning in Dynamic Environments over Unbalanced Digraphs.