Abstract:The widespread adoption of Federated Learning (FL), a privacy-preserving distributed learning methodology, has been impeded by the challenge of high communication overheads, typically arising from the transmission of large-scale models. Existing adaptive quantization methods, designed to mitigate these overheads, operate under the impractical assumption of uniform device participation in every training round. Additionally, these methods are limited in their adaptability due to the necessity of manual quantization level selection and often overlook biases inherent in local devices' data, thereby affecting the robustness of the global model. In response, this paper introduces AQUILA (adaptive quantization in device selection strategy), a novel adaptive framework devised to effectively handle these issues, enhancing the efficiency and robustness of FL. AQUILA integrates a sophisticated device selection method that prioritizes the quality and usefulness of device updates. Utilizing the exact global model stored by devices, it enables a more precise device selection criterion, reduces model deviation, and limits the need for hyperparameter adjustments. Furthermore, AQUILA presents an innovative quantization criterion, optimized to improve communication efficiency while assuring model convergence. Our experiments demonstrate that AQUILA significantly decreases communication costs compared to existing methods, while maintaining comparable model performance across diverse non-homogeneous FL settings, such as Non-IID data and heterogeneous model architectures.

SQuaFL: Sketch-Quantization Inspired Communication Efficient Federated Learning

Deep Learning Based Coded Over-the-Air Computation for Personalized Federated Learning

Asynchronous Federated Learning over Wireless Communication Networks.

FedSQ: Sparse-Quantized Federated Learning for Communication Efficiency

QSFL: A Two-Level Uplink Communication Optimization Framework for Federated Learning.

A Generalized Look at Federated Learning: Survey and Perspectives

Split-FL: An Efficient Online Federated Learning Framework with Constrained Computation and Streaming Data

FedAQ: Communication-Efficient Federated Edge Learning via Joint Uplink and Downlink Adaptive Quantization

Two Birds with One Stone: Toward Communication and Computation Efficient Federated Learning

Sketch-based Adaptive Communication Optimization in Federated Learning

NQFL: Nonuniform Quantization for Communication Efficient Federated Learning

Efficient and Less Centralized Federated Learning

Efficient asynchronous federated learning with sparsification and quantization

Communication-Efficient Federated Learning with Sparsity and Quantization

FedVQCS: Federated Learning via Vector Quantized Compressed Sensing

Secure Smart Communication Efficiency in Federated Learning: Achievements and Challenges

To Talk or to Work: Delay Efficient Federated Learning over Mobile Edge Devices

AQUILA: Communication Efficient Federated Learning with Adaptive Quantization in Device Selection Strategy

Resilient and Communication Efficient Learning for Heterogeneous Federated Systems

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Communication-Efficient Federated Learning in Channel Constrained Internet of Things