Abstract:Federated learning (FL) enables multiple clients to collaborate on a common learning task via only exchanging model updates. With the progressive improvements in deep learning models, communication is becoming a primary bottleneck of FL. Quantization of model updates before transmitting is an effective technique to reduce communication overhead. Most prior literature assumes lossless transmission, but in practice, quantized model updates are distorted by wireless channels due to the variation of client locations. Therefore, this paper focuses on analysis and design of personalized model update quantization with explicitly incorporating channel diversity in wireless FL. We present a novel convergence analysis of quantized FL, which encompasses full and partial client participation, single and multiple local training iterations, and convex and non-convex loss functions. This analysis explicitly embodies the impact of personalized quantization error, channel diversity and model aggregation in FL, and also elucidates their tradeoff on tightening a convergence rate upper bound. An optimization framework, which seeks an optimal allocation scheme given a total budget of quantization bits, is proposed by minimizing an upper bound with respect to channel quality. A nearly optimal solution is derived for this non-convex integer programming problem via analytically solving Karush–Kuhn–Tucker (KKT) optimality conditions and linear search. From a perspective of outlier detection, this channel-aware allocation scheme is also extended to robust model aggregation against client dropouts. Comprehensive numerical evaluation demonstrates the performance enhancement of the proposed scheme over the vanilla allocation scheme with equal quantization bits, particularly in terms of training stability, test accuracy, and robustness.

Joint Client Scheduling and Quantization Optimization in Energy Harvesting-Enabled Federated Learning Networks

Energy Efficient Federated Learning over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission

Online Optimization for Over-the-Air Federated Learning with Energy Harvesting

Federated Learning over Energy Harvesting Wireless Networks

Energy-Efficient Wireless Federated Learning via Doubly Adaptive Quantization

Jointly Optimizing Client Selection and Resource Management in Wireless Federated Learning for Internet of Things

Joint Client Selection and CPU Frequency Control in Wireless Federated Learning Networks with Power Constraints

Energy Efficient Federated Learning Over Wireless Communication Networks

Resource Allocation for Multi-Task Federated Learning Algorithm over Wireless Communication Networks

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

Joint User Scheduling and Resource Allocation for Federated Learning over Wireless Networks

Quantization Bits Allocation for Wireless Federated Learning

Joint Client Selection and Resource Allocation for Federated Learning in Mobile Edge Networks

Deep Reinforcement Learning for Energy Efficiency Maximization in SWIPT-Based Over-the-Air Federated Learning

Joint Accuracy and Resource Allocation for Green Federated Learning Networks

Fuzzy Logic Assisted Client Selection and Energy-Efficient Joint Optimization for Hierarchical Federated Learning

Efficiency-Boosting Federated Learning in Wireless Networks: A Long-Term Perspective

Client Selection and Bandwidth Allocation for Federated Learning: An Online Optimization Perspective

FedAQ: Communication-Efficient Federated Edge Learning via Joint Uplink and Downlink Adaptive Quantization

Cost-Aware Hierarchical Federated Learning via Over-the-Air Computing

Federated Learning With Energy Harvesting Devices: An MDP Framework