Abstract:Federated Learning allows a myriad of clients to train a global model in a collaborative process over a period of rounds without essentially sharing their privately-stored data. The high frequency of communicating model updates to and from the central server, coupled with indiscriminate updating of the global model during training, makes communication a bottleneck for federated learning. Several methods, including model compression techniques, have been introduced to improve the communication efficiency of federated learning. However, some of these methods are computationally expensive and time-consuming whiles others result in information loss and low convergence rates. In this paper, we propose a new federated learning framework, FedSULP, that significantly reduces communication costs by accelerating learning convergence through gradient-based selective updating and clients' loss penalization. Specifically, we first investigate the gradient direction of the global model and then estimate the significance of the local updates to the convergence of the global model. Subsequently, we perform selective updating of the global model based on the estimation outcome. Additionally, we optimally penalize the loss objectives of the clients if their collective gradients and learned parameters largely deviate from the global model. Extensive experiments performed on real-world image classification data sets demonstrated that our proposed framework ensures faster learning convergence and reduces communication up to 2x, compared to other existing baseline and state-of-the-art frameworks, while developing good-performing models.

Communication-Efficient Federated Learning Algorithm with Event Triggering

Federated Optimization Based on Compression and Event-triggered Communication

Communication Efficient ConFederated Learning: An Event-Triggered SAGA Approach

Federated Learning: Strategies for Improving Communication Efficiency

Communication-Efficient Federated Learning with Accelerated Client Gradient

Communication-Efficient Wireless Traffic Prediction with Federated Learning

Delay Minimization for Federated Learning Over Wireless Communication Networks

FedKD: Communication Efficient Federated Learning Via Knowledge Distillation

Communication-Efficient Federated Deep Learning with Asynchronous Model Update and Temporally Weighted Aggregation

Time-triggered Federated Learning over Wireless Networks

Communication-Efficient Federated Learning with Acceleration of Global Momentum

Edge-Based Communication Optimization for Distributed Federated Learning

FLAS: Computation and Communication Efficient Federated Learning via Adaptive Sampling

Communication-Efficient Model Aggregation with Layer Divergence Feedback in Federated Learning

Communication-Efficient Federated Learning: A Variance-Reduced Stochastic Approach with Adaptive Sparsification.

Communication-Efficient Device Scheduling for Federated Learning Using Stochastic Optimization

FedSULP: A Communication-Efficient Federated Learning Framework with Selective Updating and Loss Penalization

Robust Federated Learning with Noisy Communication.

On the Convergence of Communication-Efficient Local SGD for Federated Learning

Communication-Efficient Federated Deep Learning With Layerwise Asynchronous Model Update and Temporally Weighted Aggregation