Abstract:Asynchronous federated learning (AsynFL) can effectively mitigate the impact of heterogeneity of edge nodes on joint training while satisfying participant user privacy protection and data security. However, the frequent exchange of massive data can lead to excess communication overhead between edge and central nodes regardless of whether the federated learning (FL) algorithm uses synchronous or asynchronous aggregation. Therefore, there is an urgent need for a method that can simultaneously take into account device heterogeneity and edge node energy consumption reduction. This paper proposes a novel Fixed-point Asynchronous Federated Learning (FixedAsynFL) algorithm, which could mitigate the resource consumption caused by frequent data communication while alleviating the effect of device heterogeneity. FixedAsynFL uses fixed-point quantization to compress the local and global models in AsynFL. In order to balance energy consumption and learning accuracy, this paper proposed a quantization scale selection mechanism. This paper examines the mathematical relationship between the quantization scale and energy consumption of the computation/communication process in the FixedAsynFL. Based on considering the upper bound of quantization noise, this paper optimizes the quantization scale by minimizing communication and computation consumption. This paper performs pertinent experiments on the MNIST dataset with several edge nodes of different computing efficiency. The results show that the FixedAsynFL algorithm with an 8-bit quantization can significantly reduce the communication data size by 81.3% and save the computation energy in the training phase by 74.9% without significant loss of accuracy. According to the experimental results, we can see that the proposed AsynFixedFL algorithm can effectively solve the problem of device heterogeneity and energy consumption limitation of edge nodes.

QuAsyncFL: Asynchronous Federated Learning with Quantization for CloudEdgeTerminal Collaboration Enabled AIoT

QuAsyncFL: Asynchronous Federated Learning With Quantization for Cloud–Edge–Terminal Collaboration Enabled AIoT

Efficient asynchronous federated learning with sparsification and quantization

FedAQ: Communication-Efficient Federated Edge Learning via Joint Uplink and Downlink Adaptive Quantization

Wireless Federated Learning with Asynchronous and Quantized Updates

Communication Efficient Federated Learning with Adaptive Quantization

Lazily Aggregated Quantized Gradient Innovation for Communication-Efficient Federated Learning.

FedFQ: Federated Learning with Fine-Grained Quantization

Asynchronous Federated Learning over Wireless Communication Networks.

Hierarchical Federated Learning with Quantization: Convergence Analysis and System Design

A Secure and Effective Energy-Aware Fixed-Point Quantization Scheme for Asynchronous Federated Learning

SQuaFL: Sketch-Quantization Inspired Communication Efficient Federated Learning

Adaptive Asynchronous Federated Learning in Resource-Constrained Edge Computing

AQUILA: Communication Efficient Federated Learning with Adaptive Quantization in Device Selection Strategy

Towards Mitigating Device Heterogeneity in Federated Learning via Adaptive Model Quantization

Hierarchical Quantized Federated Learning: Convergence Analysis and System Design

FedSQ: Sparse-Quantized Federated Learning for Communication Efficiency

Asynchronous Decentralized Federated Learning for Heterogeneous Devices

Communication-Efficient Federated Learning with Sparsity and Quantization

NQFL: Nonuniform Quantization for Communication Efficient Federated Learning

Quantized Distributed Federated Learning for Industrial Internet of Things