Abstract:Federated learning (FL) enables multiple local clients to collaboratively train a global model, which can reduce privacy leakage by sharing model parameters instead of private datasets. However, recent works have revealed that gradient-based data reconstruction attacks, e.g., deep leakage from gradients (DLG), improved DLG (iDLG), and inverting gradients (IG), may still reveal private information by exploiting model parameters from a local client. Current privacy-preserving FL strategies, e.g., differential privacy or gradient compression, can handle such attacks to some extent, but seriously sacrifice their model accuracy. In this work, we propose a novel privacy-preserving FL method, named privacy-encoded FL (PEFL), to combat such data reconstruction attacks without degrading the model performance. The key concept of PEFL is that each large weight matrix of the neural network model is decomposed into multiple cascading sub-matrices, which thus establishes a novel privacy-encoded mechanism by introducing an entangling nonlinear mapping between model gradients and raw data. As such, multiple sub-matrices are directly trained in parallel at the local clients, but only partial sub-matrices are reported to a global server, which suffices to reconstruct the global model whilst increasing the complexity of the coupling between the model parameters and raw data. We provide a detailed analysis of the accuracy, security, and complexity of our method. As shown, it breaks the limit of classical defensive methods, by significantly reducing the risk of data reconstruction attacks yet not degrading the model performance. Compared to classical defenses, the proposed PEFL decreases the peak-signal-to-noise ratio (PSNR) between the reconstructed data and the raw data by ~ 20dB, without sacrificing the test accuracy. As a new paradigm for privacy-preserving FL, our proposed method has great potential in privacy-demanding learning applications.

FedGG: Leveraging Generative Adversarial Networks and Gradient Smoothing for Privacy Protection in Federated Learning.

Protect Privacy from Gradient Leakage Attack in Federated Learning

Guardian: Guarding Against Gradient Leakage with Provable Defense for Federated Learning.

FedCG: Leverage Conditional GAN for Protecting Privacy and Maintaining Competitive Performance in Federated Learning

Defense Against Gradient Leakage Attacks via Learning to Obscure Data

Securing Distributed SGD Against Gradient Leakage Threats

Gradients Stand-in for Defending Deep Leakage in Federated Learning

Shield Against Gradient Leakage Attacks: Adaptive Privacy-Preserving Federated Learning

FedDAA: a robust federated learning framework to protect privacy and defend against adversarial attack

Gradient leakage attacks in federated learning

Gradient-based Defense Methods for Data Leakage in Vertical Federated Learning

Gradient Obfuscation Gives a False Sense of Security in Federated Learning

Gradient-Leakage Resilient Federated Learning

FL-AGN: A Privacy-Enhanced Federated Learning Method Based on Adaptive Gaussian Noise for Resisting Gradient Inference Attacks

Fast Generation-Based Gradient Leakage Attacks against Highly Compressed Gradients.

Encoded Gradients Aggregation against Gradient Leakage in Federated Learning

Privacy-Encoded Federated Learning Against Gradient-Based Data Reconstruction Attacks.

Fast Generation-Based Gradient Leakage Attacks: An Approach to Generate Training Data Directly From the Gradient

Gradient Leakage Defense with Key-Lock Module for Federated Learning

An Efficient Federated Convolutional Neural Network Scheme with Differential Privacy.

Concealing Sensitive Samples against Gradient Leakage in Federated Learning