Adaptive Aggregative Multitask Competitive Particle Swarm Optimization with Bi-Directional Asymmetric Flip Strategy for High-Dimensional Feature Selection

Yong Zhang,Ke-Jing Du,Yi Jiang,Li-Min Wang,Hua Wang,Zhi-Hui Zhan

DOI: https://doi.org/10.1145/3638529.3654021

2024-01-01

Abstract:Evolutionary multitask optimization (EMTO) has been increasingly employed in addressing high-dimensional feature selection challenges, but current EMTO algorithms still have three deficiencies: First, in task generation, they just consider the linear correlation among features but ignore the nonlinear correlation. Second, they commonly encounter negative knowledge transfer. Third, they are hard to strike an optimal balance between global search capability and computational efficiency. This paper proposes an adaptive aggregative multitask competitive swarm optimization (AAMCSO) for high-dimensional feature selection, which contains three novel and effective strategies to address the above deficiencies. Firstly, AAMCSO proposes a linear-and-nonlinear-correlation-based task generation strategy to generate multiple tasks while considering both linear and nonlinear correlation between features and labels. Secondly, AAMCSO proposes an adaptive aggregative knowledge transfer strategy to adaptively transfer positive knowledge among related tasks. Thirdly, AAMCSO proposes a bi-directional asymmetric flip strategy to guide the population to search for a smaller feature subset with better classification performance. We have conducted extensive comparative experiments on AAMCSO and multiple state-of-the-art feature selection algorithms in high-dimensional feature selection problems with up to 10000 dimensions. The results show that AAMCSO achieves significantly superior performance to the state-of-the-art comparison algorithms in terms of both classification accuracy and feature number.