Abstract:Although federated learning (FL) represents a distributed machine learning paradigm that ensures privacy protection, the failure of stragglers to upload local models in a timely manner results in an overall degradation of the global model’s performance, and the difficulty of accurately predicting whether clients will succeed in uploading a local model makes client selection still a challenge. To address this issue, existing works mainly focus on increasing the number of clients who participate in training within a fixed time, however, the fact is that the performance of a global model depends on the data used for training. Therefore, increasing the clients’ data contribution to the global model can effectively enhance the global model’s performance. To this end, we propose a Bayesian estimation based FL framework, named FedBoost, to enhance the performance of the model when straggler problem exists. Specifically, we formulate a long-term problem aimed at maximizing clients’ cumulative effective data contributions, while satisfying a long-term fairness constraints, which ensure a minimum selection frequency for clients. By analyzing the stability of virtual queues, we transform the long-term problem into a stepwise one via Lyapunov optimization, reducing its computational complexity. Due to the inability of the server to predict whether clients successfully upload the local model before receiving the actual upload, we use Bayesian estimation based on the observed frequency of successful uploads to estimate this probability. Last, extensive experimental results indicate that the average test accuracy of our FedBoost is up to 5.59% higher than both FedAvg and FedCS on three real-world datasets, and achieves test loss that are at most 0.1646 below the two baselines. Furthermore, the value of Lapunov function remains lower than 1.4, and at least 85% of the estimation of probabilities are in a reasonable range.

A fault‐tolerant and scalable boosting method over vertically partitioned data

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

FedV: Privacy-Preserving Federated Learning over Vertically Partitioned Data

SGBoost: An Efficient and Privacy-Preserving Vertical Federated Tree Boosting Framework

Achieving Model Fairness in Vertical Federated Learning

VF2Boost: Very Fast Vertical Federated Gradient Boosting for Cross-Enterprise Learning

Cascade Vertical Federated Learning

Adaptive Vertical Federated Learning on Unbalanced Features

Decoupled Vertical Federated Learning for Practical Training on Vertically Partitioned Data

FederBoost: Private Federated Learning for GBDT

A Communication Efficient Vertical Federated Learning Framework.

Scalable Vertical Federated Learning via Data Augmentation and Amortized Inference

FedVS: Straggler-Resilient and Privacy-Preserving Vertical Federated Learning for Split Models

OpBoost: A Vertical Federated Tree Boosting Framework Based on Order-Preserving Desensitization

A Hybrid Self-Supervised Learning Framework for Vertical Federated Learning

OpBoost

Secure Vertical Federated Learning Under Unreliable Connectivity

Flexible Vertical Federated Learning With Heterogeneous Parties

FedBoost: Bayesian Estimation based Client Selection for Federated Learning

A Vertical Federated Learning Framework for Horizontally Partitioned Labels

VAFL: a Method of Vertical Asynchronous Federated Learning