Abstract:Federated learning allows collaborative workers to solve a machine learning problem while preserving data privacy. Recent studies have tackled various challenges in federated learning, but the joint optimization of communication overhead, learning reliability, and deployment efficiency is still an open problem. To this end, we propose a new scheme named federated learning via plurality vote (FedVote). In each communication round of FedVote, workers transmit binary or ternary weights to the server with low communication overhead. The model parameters are aggregated via weighted voting to enhance the resilience against Byzantine attacks. When deployed for inference, the model with binary or ternary weights is resource-friendly to edge devices. We show that our proposed method can reduce quantization error and converges faster compared with the methods directly quantizing the model updates.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to jointly optimize the communication overhead, learning reliability, and deployment efficiency in federated learning. Specifically: 1. **Communication Overhead**: In federated learning, transmitting high - dimensional vectors between clients and servers can lead to significant communication overhead. Existing research reduces communication overhead by directly quantizing the original gradients, but this solution may not provide the best trade - off between communication efficiency and model accuracy. 2. **Learning Reliability (Robustness against Byzantine Attacks)**: The traditional Federated Averaging (FedAvg) method is vulnerable to Byzantine attacks in the aggregation rule. Previous works have enhanced the robustness of the algorithm by using robust statistical methods (such as coordinate median and geometric median) or detecting and rejecting updates from malicious attackers, but this will increase additional computational complexity. To solve the above problems, the authors propose a new federated learning scheme - **Federated Learning based on Majority Voting (FedVote)**. The main features of this scheme are as follows: - **Low Communication Overhead**: Clients only transmit binary or ternary weights to the server in each round of communication, thus significantly reducing the communication overhead. - **Enhanced Robustness**: Aggregating model parameters by weighted voting enhances the resistance to Byzantine attacks. - **Resource - friendly Inference**: When performing inference on edge devices, binary or ternary weight models are more resource - saving. Through these improvements, FedVote can not only reduce quantization errors but also converge faster than methods that directly quantize model updates. ### Main Contributions of the Paper 1. **Proposing a New Federated Learning Solution FedVote**: By performing quantized model optimization on the client side and aggregation on the server side, jointly optimizing communication overhead, learning reliability, and deployment efficiency. 2. **Theoretically and Experimentally Verifying the Effectiveness of FedVote**: Especially in the case of bandwidth - limited situations, FedVote can maintain good test accuracy while achieving a high compression ratio. 3. **Extending FedVote to Deal with Byzantine Attacks**: Proposing a reputation - based voting strategy (Byzantine - FedVote), which shows better robustness in the presence of nearly half of the attackers without introducing excessive computational overhead. Through these innovations, FedVote provides an effective solution for communication efficiency and security in federated learning.

Federated Learning via Plurality Vote

Projected Federated Averaging with Heterogeneous Differential Privacy.

FedQV: Leveraging Quadratic Voting in Federated Learning

HQsFL: A Novel Training Strategy for Constructing High-performance and Quantum-safe Federated Learning

Voting Consensus Based Decentralized Federated Learning

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Federated Learning via Over-the-Air Computation

Communication-Efficient and Privacy-Preserving Large-Scale Federated Learning Counteracting Heterogeneity

FedSQ: Sparse-Quantized Federated Learning for Communication Efficiency

Distributed additive encryption and quantization for privacy preserving federated deep learning

Quantization Bits Allocation for Wireless Federated Learning

Federated Learning: Strategies for Improving Communication Efficiency

Peer-to-peer privacy-preserving vertical federated learning without trusted third-party coordinator

Towards Communication-Efficient and Privacy-Preserving Federated Representation Learning

FedDBO: A Novel Federated Learning Approach for Communication Cost and Data Heterogeneity Using Dung Beetle Optimizer

Fairness and Accuracy in Federated Learning

Resource-constrained Federated Learning with Heterogeneous Data: Formulation and Analysis

PVD-FL: A Privacy-Preserving and Verifiable Decentralized Federated Learning Framework

EPFed: Achieving Optimal Balance between Privacy and Efficiency in Federated Learning

A New Implementation of Federated Learning for Privacy and Security Enhancement

A Communication Efficient Vertical Federated Learning Framework.