Abstract:In real life, a large amount of data describing the same learning task may be stored in different institutions (called participants), and these data cannot be shared among participants due to privacy protection. The case that different attributes/features of the same instance are stored in different institutions is called vertically distributed data. The purpose of vertical‐federated feature selection (FS) is to reduce the feature dimension of vertical distributed data jointly without sharing local original data so that the feature subset obtained has the same or better performance as the original feature set. To solve this problem, in the paper, an embedded vertical‐federated FS algorithm based on particle swarm optimisation (PSO‐EVFFS) is proposed by incorporating evolutionary FS into the SecureBoost framework for the first time. By optimising both hyper‐parameters of the XGBoost model and feature subsets, PSO‐EVFFS can obtain a feature subset, which makes the XGBoost model more accurate. At the same time, since different participants only share insensitive parameters such as model loss function, PSO‐EVFFS can effectively ensure the privacy of participants' data. Moreover, an ensemble ranking strategy of feature importance based on the XGBoost tree model is developed to effectively remove irrelevant features on each participant. Finally, the proposed algorithm is applied to 10 test datasets and compared with three typical vertical‐federated learning frameworks and two variants of the proposed algorithm with different initialisation strategies. Experimental results show that the proposed algorithm can significantly improve the classification performance of selected feature subsets while fully protecting the data privacy of all participants.

A Federated Feature Selection Algorithm Based on Particle Swarm Optimization under Privacy Protection

An Embedded Vertical‐federated Feature Selection Algorithm Based on Particle Swarm Optimisation

A BSO-based Feature Selection Algorithm under Privacy Protection

Feature Selection Based on Adaptive Particle Swarm Optimization with Leadership Learning

A Novel Feature-Selection Approach Based on Particle Swarm Optimization Algorithm for Intrusion Detection Systems (Workshop Paper)

Surrogate Sample-Assisted Particle Swarm Optimization for Feature Selection on High-Dimensional Data

Privacy Preserving Feature Selection in Distributed Environment

Feature selection using bare-bones particle swarm optimization with mutual information

Efficient and Privacy-Preserving Feature Importance-based Vertical Federated Learning

Many-objective optimization of feature selection based on two-level particle cooperation

Feature subset selection via an improved discretization-based particle swarm optimization

An evolutionary feature selection method based on probability-based initialized particle swarm optimization

FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning

Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models

Feature Selection Based on Rough Sets and Particle Swarm Optimization

A Federated Learning Approach for Privacy Protection in Context-Aware Recommender Systems.

Intrusion Feature Selection Algorithm Based On Particle Swarm Optimization

Achieving Privacy-Preserving Cross-Silo Anomaly Detection Using Federated XGBoost

An Effective Federated Recommendation Framework with Differential Privacy

Multi-objective particle swarm optimization with adaptive strategies for feature selection

Multiobjective Particle Swarm Optimization for Feature Selection With Fuzzy Cost