Abstract:Vertical Federated Learning (VFL) enables multiple data owners, each holding a different subset of features about a largely overlapping set of data samples, to collaboratively train a global model. The quality of data owners' local features affects the performance of the VFL model, which makes feature selection vitally important. However, existing feature selection methods for VFL either assume the availability of prior knowledge on the number of noisy features or prior knowledge on the post-training threshold of useful features to be selected, making them unsuitable for practical applications. To bridge this gap, we propose the Federated Stochastic Dual-Gate based Feature Selection (FedSDG-FS) approach. It consists of a Gaussian stochastic dual-gate to efficiently approximate the probability of a feature being selected. FedSDG-FS further designs a local embedding perturbation approach to achieve differential privacy for local training data. To reduce overhead, we propose a feature importance initialization method based on Gini impurity, which can accomplish its goals with only two parameter transmissions between the server and the clients. The enhanced version, FedSDG-FS++, protects the privacy for both the clients' training data and the server's labels through Partially Homomorphic Encryption (PHE) without relying on a trusted third-party. Theoretically, we analyze the convergence rate, privacy guarantees and security analysis of our methods. Extensive experiments on both synthetic and real-world datasets show that FedSDG-FS and FedSDG-FS++ significantly outperform existing approaches in terms of achieving more accurate selection of high-quality features as well as improving VFL performance in a privacy-preserving manner.

Efficient and Privacy-Preserving Feature Importance-based Vertical Federated Learning

FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning

Privacy-preserving Data Selection for Horizontal and Vertical Federated Learning

FedV: Privacy-Preserving Federated Learning over Vertically Partitioned Data

Secure Feature Selection for Vertical Federated Learning in Ehealth Systems

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Achieving Model Fairness in Vertical Federated Learning

Flexible Differentially Private Vertical Federated Learning with Adaptive Feature Embeddings

A Hybrid Self-Supervised Learning Framework for Vertical Federated Learning

Secure Vertical Federated Learning Under Unreliable Connectivity

SecureVFL: privacy-preserving multi-party vertical federated learning based on blockchain and RSS

Secure Vertical Federated Learning Based on Feature Disentanglement

BlindFL: Vertical Federated Machine Learning Without Peeking into Your Data

Adaptive and Efficient Participant Selection in Vertical Federated Learning

FedFed: Feature Distillation Against Data Heterogeneity in Federated Learning

OpenVFL: A Vertical Federated Learning Framework With Stronger Privacy-Preserving

Vertical Federated Learning: Concepts, Advances, and Challenges

VFLR: An Efficient and Privacy-Preserving Vertical Federated Framework for Logistic Regression

Vertical Federated Learning: Concepts, Advances and Challenges

Enhancing Generalization Robustness of Federated Learning in Highly Heterogeneous Environments

FedPH: Privacy-enhanced Heterogeneous Federated Learning