Abstract:Although federated learning (FL) represents a distributed machine learning paradigm that ensures privacy protection, the failure of stragglers to upload local models in a timely manner results in an overall degradation of the global model’s performance, and the difficulty of accurately predicting whether clients will succeed in uploading a local model makes client selection still a challenge. To address this issue, existing works mainly focus on increasing the number of clients who participate in training within a fixed time, however, the fact is that the performance of a global model depends on the data used for training. Therefore, increasing the clients’ data contribution to the global model can effectively enhance the global model’s performance. To this end, we propose a Bayesian estimation based FL framework, named FedBoost, to enhance the performance of the model when straggler problem exists. Specifically, we formulate a long-term problem aimed at maximizing clients’ cumulative effective data contributions, while satisfying a long-term fairness constraints, which ensure a minimum selection frequency for clients. By analyzing the stability of virtual queues, we transform the long-term problem into a stepwise one via Lyapunov optimization, reducing its computational complexity. Due to the inability of the server to predict whether clients successfully upload the local model before receiving the actual upload, we use Bayesian estimation based on the observed frequency of successful uploads to estimate this probability. Last, extensive experimental results indicate that the average test accuracy of our FedBoost is up to 5.59% higher than both FedAvg and FedCS on three real-world datasets, and achieves test loss that are at most 0.1646 below the two baselines. Furthermore, the value of Lapunov function remains lower than 1.4, and at least 85% of the estimation of probabilities are in a reasonable range.

FedMix: Boosting with Data Mixture for Vertical Federated Learning

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Data Augmentation Based Federated Learning

pFedAFM: Adaptive Feature Mixture for Batch-Level Personalization in Heterogeneous Federated Learning

FedDGP: Disentangling Global and Personal Models for Federated Learning

Efficient and Privacy-Preserving Feature Importance-based Vertical Federated Learning

Personalized Federated Learning under Mixture of Distributions

A Hybrid Self-Supervised Learning Framework for Vertical Federated Learning

FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregation

Adaptive Vertical Federated Learning on Unbalanced Features

FedV: Privacy-Preserving Federated Learning over Vertically Partitioned Data

Vertical Federated Learning Hybrid Local Pre-training

DiVerFed: Distribution-Aware Vertical Federated Learning for Missing Information

FairVFL: A Fair Vertical Federated Learning Framework with Contrastive Adversarial Learning

Optimizing Parameter Mixing under Constrained Communications in Parallel Federated Learning

Federated Virtual Learning on Heterogeneous Data with Local-global Distillation

FedCVT: Semi-supervised Vertical Federated Learning with Cross-view Training

Personalized federated learning based on feature fusion

FedBoost: Bayesian Estimation based Client Selection for Federated Learning

FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning