Abstract:Federated learning (FL) has recently gained tremendous attention in edge computing and Internet of Things, due to its capability of enabling distributed clients to cooperatively train models while keeping raw data locally. However, the existing works usually suffer from limited communication resources, dynamic network conditions and heterogeneous client properties, which hinder efficient FL. To simultaneously tackle the above challenges, we propose a heterogeneity-aware FL framework, called FedCG, with adaptive client selection and gradient compression. Specifically, FedCG introduces diversity to client selection and aims to select a representative client subset considering statistical heterogeneity. These selected clients are assigned different compression ratios based on heterogeneous and time-varying capabilities. After local training, they upload sparse model updates matching their capabilities for global aggregation, which can effectively reduce the communication cost and mitigate the straggler effect. More importantly, instead of naively combining client selection and gradient compression, we highlight that their decisions are tightly coupled and indicate the necessity of joint optimization. We theoretically analyze the impact of both client selection and gradient compression on convergence performance. Guided by the convergence rate, we develop an iteration-based algorithm to jointly optimize client selection and compression ratio decision using submodular maximization and linear programming. On this basis, we propose the quantized extension of FedCG, termed Q-FedCG, which further adjusts quantization levels based on gradient innovation. Extensive experiments on both real-world prototypes and simulations show that FedCG and its extension can provide up to 6.4× speedup.

Cost-Aware Federated Learning in Mobile Edge Networks

Deep Learning Based Coded Over-the-Air Computation for Personalized Federated Learning

Cost-Efficient Federated Learning for Edge Intelligence in Multi-Cell Networks

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking

An Online Learning Approach for Client Selection in Federated Edge Learning under Budget Constraint

AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge Devices

Client Selection for Federated Learning With Non-IID Data in Mobile Edge Computing

A Truthful Procurement Auction for Incentivizing Heterogeneous Clients in Federated Learning

CEFL: Carbon-Efficient Federated Learning

Online Client Scheduling and Resource Allocation for Efficient Federated Edge Learning

Personalized Federated Learning with Auction-Based Client Selection and Edge-Enhanced Model Accuracy

Joint Client Selection and Resource Allocation for Federated Learning in Mobile Edge Networks

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning

Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge

Contextual Client Selection for Efficient Federated Learning over Edge Devices

Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models

Federated Learning With Client Selection and Gradient Compression in Heterogeneous Edge Systems

APCSMA: Adaptive Personalized Client-Selection and Model-Aggregation Algorithm for Federated Learning in Edge Computing Scenarios

Efficient and Less Centralized Federated Learning

Federated Learning with Additional Mechanisms on Clients to Reduce Communication Costs

Incentivizing Federated Learning under Long-Term Energy Constraint via Online Randomized Auctions