Abstract:Abstract Vertical federated learning (VFL), a variant of federated learning, has recently attracted increasing attention. An active party having the true labels jointly trains a model with other parties (referred to as passive parties ) in order to use more features to achieve higher model accuracy. During the prediction phase, all the parties collaboratively compute the predicted confidence scores of each target record and the results will be finally returned to the active party. However, a recent study by Luo et al . [28] pointed out that the active party can use these confidence scores to reconstruct passive-party features and cause severe privacy leakage. In this paper, we conduct a comprehensive analysis of privacy leakage in VFL frameworks during the prediction phase. Our study improves on previous work [28] regarding two aspects. We first design a general gradient-based reconstruction attack framework that can be flexibly applied to simple logistic regression models as well as multi-layer neural networks. Moreover, besides performing the attack under the white-box setting, we give the first attempt to conduct the attack under the black-box setting. Extensive experiments on a number of real-world datasets show that our proposed attack is effective under different settings and can achieve at best twice or thrice of a reduction of attack error compared to previous work [28]. We further analyze a list of potential mitigation approaches and compare their privacy-utility performances. Experimental results demonstrate that privacy leakage from the confidence scores is a substantial privacy risk in VFL frameworks during the prediction phase, which cannot be simply solved by crypto-based confidentiality approaches. On the other hand, processing the confidence scores with information compression and randomization approaches can provide strengthened privacy protection.

VPPLR: Privacy-preserving logistic regression on vertically partitioned data using vectorization sharing

PEVLR: A New Privacy-Preserving and Efficient Approach for Vertical Logistic Regression.

Privacy-preserving multi-party logistic regression in cloud computing

Privacy-preserving two-parties logistic regression on vertically partitioned data using asynchronous gradient sharing

Privacy-Preserving Vertical Collaborative Logistic Regression without Trusted Third-Party Coordinator

VFLR: An Efficient and Privacy-Preserving Vertical Federated Framework for Logistic Regression

Privacy-Preserving Vertical Federated Logistic Regression without Trusted Third-Party Coordinator

Peer-to-peer privacy-preserving vertical federated learning without trusted third-party coordinator

Efficient Privacy Preserving Logistic Regression for Horizontally Distributed Data

FedV: Privacy-Preserving Federated Learning over Vertically Partitioned Data

Performance-Enhanced Federated Learning with Differential Privacy for Internet of Things

Privacy-preserving logistic regression with secret sharing

Iprivjoin: an ID-Private Data Join Framework for Privacy-Preserving Machine Learning.

Privacy-preserving Logistic Regression with Improved Efficiency

PPSFL: Privacy-Preserving Split Federated Learning for heterogeneous data in edge-based Internet of Things

Comprehensive Analysis of Privacy Leakage in Vertical Federated Learning During Prediction

Online Efficient Secure Logistic Regression based on Function Secret Sharing

OpenVFL: A Vertical Federated Learning Framework With Stronger Privacy-Preserving

Evaluating Privacy Leakage in Split Learning

VPFL: A verifiable privacy-preserving federated learning scheme for edge computing systems

A flexible and privacy-preserving federated learning framework based on logistic regression