Abstract:Vertical federated learning is a collaborative machine learning framework to train deep leaning models on vertically partitioned data with privacy-preservation. It attracts much attention both from academia and industry. Unfortunately, applying most existing vertical federated learning methods in real-world applications still faces two daunting challenges. First, most existing vertical federated learning methods have a strong assumption that at least one party holds the complete set of labels of all data samples, while this assumption is not satisfied in many practical scenarios, where labels are horizontally partitioned and the parties only hold partial labels. Existing vertical federated learning methods can only utilize partial labels, which may lead to inadequate model update in end-to-end backpropagation. Second, computational and communication resources vary in parties. Some parties with limited computational and communication resources will become the stragglers and slow down the convergence of training. Such straggler problem will be exaggerated in the scenarios of horizontally partitioned labels in vertical federated learning. To address these challenges, we propose a novel vertical federated learning framework named Cascade Vertical Federated Learning (CVFL) to fully utilize all horizontally partitioned labels to train neural networks with privacy-preservation. To mitigate the straggler problem, we design a novel optimization objective which can increase straggler's contribution to the trained models. We conduct a series of qualitative experiments to rigorously verify the effectiveness of CVFL. It is demonstrated that CVFL can achieve comparable performance (e.g., accuracy for classification tasks) with centralized training. The new optimization objective can further mitigate the straggler problem comparing with only using the asynchronous aggregation mechanism during training.

Secure and fast asynchronous Vertical Federated Learning via cascaded hybrid optimization

FedV: Privacy-Preserving Federated Learning over Vertically Partitioned Data

Cascade Vertical Federated Learning

Efficient Asynchronous Multi-Participant Vertical Federated Learning

Desirable Companion for Vertical Federated Learning: New Zeroth-Order Gradient Based Algorithm

Efficient Vertical Federated Unlearning via Fast Retraining

Achieving Model Fairness in Vertical Federated Learning

VAFL: a Method of Vertical Asynchronous Federated Learning

Secure Vertical Federated Learning Under Unreliable Connectivity

Hijack Vertical Federated Learning Models As One Party

A Vertical Federated Learning Framework for Horizontally Partitioned Labels

Secure Bilevel Asynchronous Vertical Federated Learning with Backward Updating

Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updates

Efficient Vertical Federated Learning with Secure Aggregation

Vertical Federated Learning: Concepts, Advances, and Challenges

Vertical Federated Learning: Concepts, Advances and Challenges

VFLR: An Efficient and Privacy-Preserving Vertical Federated Framework for Logistic Regression

A Communication Efficient Vertical Federated Learning Framework.

Adaptive and Efficient Participant Selection in Vertical Federated Learning

Cascade Vertical Federated Learning Towards Straggler Mitigation and Label Privacy over Distributed Labels

Accelerating Vertical Federated Learning