Abstract:Abstract Vertical federated learning (VFL), a variant of federated learning, has recently attracted increasing attention. An active party having the true labels jointly trains a model with other parties (referred to as passive parties ) in order to use more features to achieve higher model accuracy. During the prediction phase, all the parties collaboratively compute the predicted confidence scores of each target record and the results will be finally returned to the active party. However, a recent study by Luo et al . [28] pointed out that the active party can use these confidence scores to reconstruct passive-party features and cause severe privacy leakage. In this paper, we conduct a comprehensive analysis of privacy leakage in VFL frameworks during the prediction phase. Our study improves on previous work [28] regarding two aspects. We first design a general gradient-based reconstruction attack framework that can be flexibly applied to simple logistic regression models as well as multi-layer neural networks. Moreover, besides performing the attack under the white-box setting, we give the first attempt to conduct the attack under the black-box setting. Extensive experiments on a number of real-world datasets show that our proposed attack is effective under different settings and can achieve at best twice or thrice of a reduction of attack error compared to previous work [28]. We further analyze a list of potential mitigation approaches and compare their privacy-utility performances. Experimental results demonstrate that privacy leakage from the confidence scores is a substantial privacy risk in VFL frameworks during the prediction phase, which cannot be simply solved by crypto-based confidentiality approaches. On the other hand, processing the confidence scores with information compression and randomization approaches can provide strengthened privacy protection.

Label Inference Attacks Against Vertical Federated Learning

Label Leakage in Vertical Federated Learning: A Survey

FLSG: A Novel Defense Strategy Against Inference Attacks in Vertical Federated Learning

Defending Label Inference and Backdoor Attacks in Vertical Federated Learning.

Privacy-Preserving Federated Learning Against Label-Flipping Attacks on Non-IID Data

Vulnerabilities of Data Protection in Vertical Federated Learning Training and Countermeasures

Threshold Filtering for Detecting Label Inference Attacks in Vertical Federated Learning

Secure Vertical Federated Learning Based on Feature Disentanglement

BadVFL: Backdoor Attacks in Vertical Federated Learning

Your Labels Are Selling You Out: Relation Leaks in Vertical Federated Learning

Eliminating Label Leakage in Tree-Based Vertical Federated Learning

Beyond Model Splitting: Preventing Label Inference Attacks in Vertical Federated Learning with Dispersed Training

Cascade Vertical Federated Learning Towards Straggler Mitigation and Label Privacy over Distributed Labels

Practical and General Backdoor Attacks against Vertical Federated Learning

Residue-based Label Protection Mechanisms in Vertical Logistic Regression

Comprehensive Analysis of Privacy Leakage in Vertical Federated Learning During Prediction

Label Inference Attack against Split Learning under Regression Setting

Label Inference Attacks against Node-level Vertical Federated GNNs

Towards Few-Label Vertical Federated Learning

Mutual Information Regularization for Vertical Federated Learning

Defending Batch-Level Label Inference and Replacement Attacks in Vertical Federated Learning