Abstract:Federated learning (FL) enables independent parties to collaboratively build machine learning (ML) models while protecting data privacy. Vertical federated learning (VFL), a variant of FL, has recently drawn increasing attention as the VFL matches the enterprises' demands of leveraging more valuable features to achieve better model performance without jeopardizing data privacy. However, conventional VFL may run into data deficiency as it is only able to exploit aligned samples (belonging to different parties) with labels, leaving often the majority of unaligned and unlabeled samples unused. The data deficiency hampers the effort of the federation. In this work, we propose a Federated Hybrid Self-Supervised Learning framework, coined FedHSSL, to utilize all available data (including unaligned and unlabeled samples) of participants to train the joint VFL model. The core idea of FedHSSL is to utilize cross-party views (i.e., dispersed features) of samples aligned among parties and local views (i.e., augmentations) of samples within each party to improve the representation learning capability of the joint VFL model through SSL (e.g., SimSiam). FedHSSL further exploits generic features shared among parties to boost the performance of the joint model through partial model aggregation. We empirically demonstrate that our FedHSSL achieves significant performance gains compared with baseline methods, especially when the number of labeled samples is small. We provide an in-depth analysis of FedHSSL regarding privacy leakage, which is rarely discussed in existing self-supervised VFL works. We investigate the protection mechanism for FedHSSL. The results show our protection can thwart the state-of-the-art label inference attack.

How Global Observation Embedding in Vertical-Horizontal Federated Learning

How global observation works in Federated Learning: Integrating vertical training into Horizontal Federated Learning

A Communication-efficient Federated Learning Assisted by Central Data: Implementation of Vertical Training into Horizontal Federated Learning

FedDGP: Disentangling Global and Personal Models for Federated Learning

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Vertical Federated Learning: Challenges, Methodologies and Experiments

Distributed and Deep Vertical Federated Learning with Big Data

Vertical Federated Learning: Concepts, Advances, and Challenges

Vertical Federated Learning: Concepts, Advances and Challenges

A Hybrid Self-Supervised Learning Framework for Vertical Federated Learning

Secure Vertical Federated Learning Based on Feature Disentanglement

A Survey on Vertical Federated Learning: From a Layered Perspective

Hijack Vertical Federated Learning Models As One Party

VAFL: a Method of Vertical Asynchronous Federated Learning

A Generalized Look at Federated Learning: Survey and Perspectives

Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey

Vertical Federated Learning Hybrid Local Pre-training

Secure Vertical Federated Learning Under Unreliable Connectivity

Beyond Model Splitting: Preventing Label Inference Attacks in Vertical Federated Learning with Dispersed Training

FedV: Privacy-Preserving Federated Learning over Vertically Partitioned Data