Abstract:The training of classification models for fault diagnosis tasks using geographically dispersed data is a crucial task for original equipment manufacturers (OEMs) seeking to provide long-term service contracts (LTSCs) to their customers. Due to privacy and bandwidth constraints, such models must be trained in a federated fashion. Moreover, due to harsh industrial settings the data often suffers from feature and label uncertainty. Therefore, we study the problem of training a distributionally robust (DR) support vector machine (SVM) in a federated fashion over a network comprised of a central server and $G$ clients without sharing data. We consider the setting where the local data of each client $g$ is sampled from a unique true distribution $\mathbb{P}_g$, and the clients can only communicate with the central server. We propose a novel Mixture of Wasserstein Balls (MoWB) ambiguity set that relies on local Wasserstein balls centered at the empirical distribution of the data at each client. We study theoretical aspects of the proposed ambiguity set, deriving its out-of-sample performance guarantees and demonstrating that it naturally allows for the separability of the DR problem. Subsequently, we propose two distributed optimization algorithms for training the global FDR-SVM: i) a subgradient method-based algorithm, and ii) an alternating direction method of multipliers (ADMM)-based algorithm. We derive the optimization problems to be solved by each client and provide closed-form expressions for the computations performed by the central server during each iteration for both algorithms. Finally, we thoroughly examine the performance of the proposed algorithms in a series of numerical experiments utilizing both simulation data and popular real-world datasets.

Byzantine-robust Distributed Support Vector Machine

Distributed Online Semi-Supervised Support Vector Machine

Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates

Efficient Byzantine-Resilient Stochastic Gradient Desce

Byzantine-robust Distributed Sparse Learning for M -Estimation

Asynchronous Byzantine-Robust Stochastic Aggregation with Variance Reduction for Distributed Learning

Communication-Efficient and Byzantine-Robust Distributed Stochastic Learning with Arbitrary Number of Corrupted Workers

Byzantine-tolerant distributed multiclass sparse linear discriminant analysis.

Stochastic Alternating Direction Method of Multipliers for Byzantine-Robust Distributed Learning

Variance Reduced Median-of-Means Estimator for Byzantine-Robust Distributed Inference

Robust Distributed Learning Against Both Distributional Shifts and Byzantine Attacks

Distributed Online One-Class Support Vector Machine for Anomaly Detection over Networks

A Game-Theoretic Approach to Design Secure and Resilient Distributed Support Vector Machines

Distributed Inference for Linear Support Vector Machine.

A Federated Distributionally Robust Support Vector Machine with Mixture of Wasserstein Balls Ambiguity Set for Distributed Fault Diagnosis

Distributed Inference for Linear Support Vector Machine

Distributed Stochastic Subgrandient-based Design for Support Vector Machines

Adaptive Distributed Learning with Byzantine Robustness: A Gradient-Projection-Based Method

Byzantine-tolerant distributed learning of finite mixture models

Towards More Scalable and Robust Machine Learning

Distributed support-vector-machine over dynamic balanced directed networks