Abstract:Vertical Federated Learning (VFL) enables multiple data owners, each holding a different subset of features about a largely overlapping set of data samples, to collaboratively train a global model. The quality of data owners' local features affects the performance of the VFL model, which makes feature selection vitally important. However, existing feature selection methods for VFL either assume the availability of prior knowledge on the number of noisy features or prior knowledge on the post-training threshold of useful features to be selected, making them unsuitable for practical applications. To bridge this gap, we propose the Federated Stochastic Dual-Gate based Feature Selection (FedSDG-FS) approach. It consists of a Gaussian stochastic dual-gate to efficiently approximate the probability of a feature being selected. FedSDG-FS further designs a local embedding perturbation approach to achieve differential privacy for local training data. To reduce overhead, we propose a feature importance initialization method based on Gini impurity, which can accomplish its goals with only two parameter transmissions between the server and the clients. The enhanced version, FedSDG-FS++, protects the privacy for both the clients' training data and the server's labels through Partially Homomorphic Encryption (PHE) without relying on a trusted third-party. Theoretically, we analyze the convergence rate, privacy guarantees and security analysis of our methods. Extensive experiments on both synthetic and real-world datasets show that FedSDG-FS and FedSDG-FS++ significantly outperform existing approaches in terms of achieving more accurate selection of high-quality features as well as improving VFL performance in a privacy-preserving manner.

FedRMS: Privacy-Preserving Federated Knowledge Graph Embedding Through Randomization

FedRKG: A Privacy-preserving Federated Recommendation Framework via Knowledge Graph Enhancement

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Improving Federated Relational Data Modeling via Basis Alignment and Weight Penalty

Differentially Private Federated Knowledge Graphs Embedding

FedE: Embedding Knowledge Graphs in Federated Setting

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Personalized Federated Knowledge Graph Embedding with Client-Wise Relation Graph

Federated Knowledge Graph Completion Via Embedding-Contrastive Learning

Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearning

Federated Knowledge Graph Completion via Latent Embedding Sharing and Tensor Factorization

Randomization is all you need: A privacy-preserving federated learning framework for news recommendation

Masked Random Noise for Communication Efficient Federated Learning

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation

EPFed: Achieving Optimal Balance between Privacy and Efficiency in Federated Learning

Communication-Efficient Federated Knowledge Graph Embedding with Entity-Wise Top-K Sparsification

Quantifying and Defending against Privacy Threats on Federated Knowledge Graph Embedding

FedMKGC: Privacy-Preserving Federated Multilingual Knowledge Graph Completion

Efficient and Privacy-Preserving Feature Importance-based Vertical Federated Learning

FedSampling: A Better Sampling Strategy for Federated Learning

FedGL: Federated graph learning framework with global self-supervision