Abstract:Federated Learning (FL) emerged as a paradigm for conducting machine learning across broad and decentralized datasets, promising enhanced privacy by obviating the need for direct data sharing. However, recent studies show that attackers can steal private data through model manipulation or gradient analysis. Existing attacks are constrained by low theft quantity or low-resolution data, and they are often detected through anomaly monitoring in gradients or weights. In this paper, we propose a novel data-reconstruction attack leveraging malicious code injection, supported by two key techniques, i.e., distinctive and sparse encoding design and block partitioning. Unlike conventional methods that require detectable changes to the model, our method stealthily embeds a hidden model using parameter sharing to systematically extract sensitive data. The Fibonacci-based index design ensures efficient, structured retrieval of memorized data, while the block partitioning method enhances our method's capability to handle high-resolution images by dividing them into smaller, manageable units. Extensive experiments on 4 datasets confirmed that our method is superior to the five state-of-the-art data-reconstruction attacks under the five respective detection methods. Our method can handle large-scale and high-resolution data without being detected or mitigated by state-of-the-art data reconstruction defense methods. In contrast to baselines, our method can be directly applied to both FedAVG and FedSGD scenarios, underscoring the need for developers to devise new defenses against such vulnerabilities. We will open-source our code upon acceptance.

Investigating Privacy Attacks in the Gray-Box Setting to Enhance Collaborative Learning Schemes

Privacy-Preserving Collaborative Model Learning: the Case of Word Vector Training

GELU-Net: A Globally Encrypted, Locally Unencrypted Deep Neural Network for Privacy-Preserved Learning.

Training Encrypted Models with Privacy-preserved Data on Blockchain

Pencil: Private and Extensible Collaborative Learning without the Non-Colluding Assumption

PPCL: Privacy-preserving collaborative learning for mitigating indirect information leakage

Hidden Data Privacy Breaches in Federated Learning

Fool Attackers by Imperceptible Noise: A Privacy-Preserving Adversarial Representation Mechanism for Collaborative Learning

Privacy Threats Analysis to Secure Federated Learning

On the Efficiency of Privacy Attacks in Federated Learning

HybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learning

Fedlabx: a Practical and Privacy-Preserving Framework for Federated Learning

Crypto-Nets: Neural Networks over Encrypted Data

Privacy Attack in Federated Learning is Not Easy: An Experimental Study

Gradient Leakage Defense with Key-Lock Module for Federated Learning

SecureML: A System for Scalable Privacy-Preserving Machine Learning

Securing Federated Learning: A Covert Communication-based Approach

FLUE: Federated Learning with Un-Encrypted model weights

Defending Our Privacy With Backdoors

A Blockchain-Based Fairness Guarantee Approach for Privacy-Preserving Collaborative Training in Computing Force Network

White-box Inference Attacks against Centralized Machine Learning and Federated Learning