Abstract:Vertical federated learning is a collaborative machine learning framework to train deep leaning models on vertically partitioned data with privacy-preservation. It attracts much attention both from academia and industry. Unfortunately, applying most existing vertical federated learning methods in real-world applications still faces two daunting challenges. First, most existing vertical federated learning methods have a strong assumption that at least one party holds the complete set of labels of all data samples, while this assumption is not satisfied in many practical scenarios, where labels are horizontally partitioned and the parties only hold partial labels. Existing vertical federated learning methods can only utilize partial labels, which may lead to inadequate model update in end-to-end backpropagation. Second, computational and communication resources vary in parties. Some parties with limited computational and communication resources will become the stragglers and slow down the convergence of training. Such straggler problem will be exaggerated in the scenarios of horizontally partitioned labels in vertical federated learning. To address these challenges, we propose a novel vertical federated learning framework named Cascade Vertical Federated Learning (CVFL) to fully utilize all horizontally partitioned labels to train neural networks with privacy-preservation. To mitigate the straggler problem, we design a novel optimization objective which can increase straggler's contribution to the trained models. We conduct a series of qualitative experiments to rigorously verify the effectiveness of CVFL. It is demonstrated that CVFL can achieve comparable performance (e.g., accuracy for classification tasks) with centralized training. The new optimization objective can further mitigate the straggler problem comparing with only using the asynchronous aggregation mechanism during training.

PEVLR: A New Privacy-Preserving and Efficient Approach for Vertical Logistic Regression.

Privacy-Preserving Vertical Federated Logistic Regression without Trusted Third-Party Coordinator

VFLR: An Efficient and Privacy-Preserving Vertical Federated Framework for Logistic Regression

VPPLR: Privacy-preserving logistic regression on vertically partitioned data using vectorization sharing

Privacy-preserving two-parties logistic regression on vertically partitioned data using asynchronous gradient sharing

Privacy-Preserving Vertical Collaborative Logistic Regression without Trusted Third-Party Coordinator

Peer-to-peer privacy-preserving vertical federated learning without trusted third-party coordinator

Efficient and Privacy-Preserving Logistic Regression Prediction over Vertically Partitioned Data

FedV: Privacy-Preserving Federated Learning over Vertically Partitioned Data

Comprehensive Analysis of Privacy Leakage in Vertical Federated Learning During Prediction

ELXGB: an Efficient and Privacy-Preserving XGBoost for Vertical Federated Learning

Privacy-preserving multi-party logistic regression in cloud computing

Privacy-Preserving Asynchronous Federated Learning Algorithms for Multi-Party Vertically Collaborative Learning

ACCEL: an Efficient and Privacy-Preserving Federated Logistic Regression Scheme over Vertically Partitioned Data

Privacy Preserving Vertical Federated Learning for Tree-based Models

PIVODL: Privacy-Preserving Vertical Federated Learning over Distributed Labels

Efficient and Privacy-Preserving Feature Importance-based Vertical Federated Learning

A Vertical Federated Learning Framework for Horizontally Partitioned Labels

Privet: A Privacy-Preserving Vertical Federated Learning Service for Gradient Boosted Decision Tables

Full Data-Processing Power Load Forecasting Based on Vertical Federated Learning

EFMVFL: An Efficient and Flexible Multi-party Vertical Federated Learning without a Third Party