Abstract:Although federated learning improves privacy of training data by exchanging local gradients or parameters rather than raw data, the adversary still can leverage local gradients and parameters to obtain local training data by launching reconstruction and membership inference attacks. To defend against such privacy attacks, many noises perturbed methods (like differential privacy or CountSketch matrix) have been widely designed. However, the strong defence ability and high learning accuracy of these schemes cannot be ensured at the same time, which will impede the wide application of FL in practice (especially for medical or financial institutions that require both high accuracy and strong privacy guarantee). To overcome this issue, we propose an efficient model perturbation method for federated learning to defend against reconstruction and membership inference attacks launched by curious clients. On the one hand, similar to the differential privacy, our method also selects random numbers as perturbed noises added to the global model parameters, and thus it is very efficient and easy to be integrated in practice. Meanwhile, the random selected noises are positive real numbers and the corresponding value can be arbitrarily large, and thus the strong defence ability can be ensured. On the other hand, unlike differential privacy or other perturbation methods that cannot eliminate added noises, our method allows the server to recover the true aggregated gradients by eliminating the added noises. Therefore, our method does not hinder learning accuracy at all. Extensive experiments demonstrate that for both regression and classification tasks, our method achieves the same accuracy as non-private approaches and outperforms the state-of-the-art defence schemes. Besides, the defence ability of our method against reconstruction and membership inference attack is significantly better than the state-of-the-art related defence schemes.

A Sensitivity-aware and Block-wise Pruning Method for Privacy-preserving Federated Learning

PriPrune: Quantifying and Preserving Privacy in Pruned Federated Learning

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

Shield Against Gradient Leakage Attacks: Adaptive Privacy-Preserving Federated Learning

A Lightweight and Accuracy-Lossless Privacy-Preserving Method in Federated Learning

Communication-Efficient and Private Federated Learning with Adaptive Sparsity-Based Pruning on Edge Computing

Performance Analysis and Optimization in Privacy-Preserving Federated Learning

FedDAA: a robust federated learning framework to protect privacy and defend against adversarial attack

A Communication-Efficient, Privacy-Preserving Federated Learning Algorithm Based on Two-Stage Gradient Pruning and Differentiated Differential Privacy

An Accuracy-Lossless Perturbation Method for Defending Privacy Attacks in Federated Learning

Provable Defense against Privacy Leakage in Federated Learning from Representation Perspective

A Fine-Grained Differentially Private Federated Learning Against Leakage from Gradients

Efficient federated learning privacy preservation method with heterogeneous differential privacy

Differentially Private Federated Learning with an Adaptive Noise Mechanism

Research on Privacy Protection in Federated Learning Combining Distillation Defense and Blockchain

Privacy-Preserving Federated Learning on Partitioned Attributes

When Federated Learning Meets Privacy-Preserving Computation

Practical Locally Private Federated Learning with Communication Efficiency

Efficient DP-FL: Efficient Differential Privacy Federated Learning Based on Early Stopping Mechanism

A Practical Privacy-preserving Method in Federated Deep Learning

Defense Against Gradient Leakage Attacks via Learning to Obscure Data