Abstract:Vertical federated learning is a collaborative machine learning framework to train deep leaning models on vertically partitioned data with privacy-preservation. It attracts much attention both from academia and industry. Unfortunately, applying most existing vertical federated learning methods in real-world applications still faces two daunting challenges. First, most existing vertical federated learning methods have a strong assumption that at least one party holds the complete set of labels of all data samples, while this assumption is not satisfied in many practical scenarios, where labels are horizontally partitioned and the parties only hold partial labels. Existing vertical federated learning methods can only utilize partial labels, which may lead to inadequate model update in end-to-end backpropagation. Second, computational and communication resources vary in parties. Some parties with limited computational and communication resources will become the stragglers and slow down the convergence of training. Such straggler problem will be exaggerated in the scenarios of horizontally partitioned labels in vertical federated learning. To address these challenges, we propose a novel vertical federated learning framework named Cascade Vertical Federated Learning (CVFL) to fully utilize all horizontally partitioned labels to train neural networks with privacy-preservation. To mitigate the straggler problem, we design a novel optimization objective which can increase straggler's contribution to the trained models. We conduct a series of qualitative experiments to rigorously verify the effectiveness of CVFL. It is demonstrated that CVFL can achieve comparable performance (e.g., accuracy for classification tasks) with centralized training. The new optimization objective can further mitigate the straggler problem comparing with only using the asynchronous aggregation mechanism during training.

Research on Image Classification Algorithm Based on Horizontal Federated Learning

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Improved Algorithm for Image Classification Datasets Using Federated Transfer Learning.

FedSLD: Federated Learning with Shared Label Distribution for Medical Image Classification

MpFedcon : Model-Contrastive Personalized Federated Learning with the Class Center

Federated learning with hyper-network—a case study on whole slide image analysis

Vertical Federated Image Segmentation

Horizontal Federated Computer Vision

Federated Learning Versus Classical Machine Learning: A Convergence Comparison

A Novel Framework of Horizontal-Vertical Hybrid Federated Learning for EdgeIoT

AdaFedFR: Federated Face Recognition with Adaptive Inter-Class Representation Learning

A Communication-efficient Federated Learning Assisted by Central Data: Implementation of Vertical Training into Horizontal Federated Learning

Benchmarking FedAvg and FedCurv for Image Classification Tasks

Evaluating Federated Learning Simulators: A Comparative Analysis of Horizontal and Vertical Approaches

Federated Distillation for Medical Image Classification: Towards Trustworthy Computer-Aided Diagnosis

A Vertical Federated Learning Framework for Horizontally Partitioned Labels

Distributed Fire Detection and Localization Model Using Federated Learning

Investigation of Federated Learning Algorithms for Retinal Optical Coherence Tomography Image Classification with Statistical Heterogeneity

FedSR: A Semi-Decentralized Federated Learning Algorithm for Non-IIDness in IoT System

FedBABU: Towards Enhanced Representation for Federated Image Classification

Federated Multiple Label Hashing (FedMLH): Communication Efficient Federated Learning on Extreme Classification Tasks