Abstract:In real-world applications, feature selection is crucial for enhancing the performance of data science and machine learning models. Typically, feature selection is a complex combinatorial optimization problem and a multi-objective optimization problem. Its primary goals are to reduce the dimensionality of the dataset and enhance the performance of machine learning algorithms. The selection of features in high-dimensional datasets is challenging due to the intricate relationships between features, which pose significant challenges to the performance and computational efficiency of algorithms. This paper introduces a Knowledge-Guided Competitive Co-Evolutionary Algorithm (KCCEA) for feature selection, especially for high-dimensional features. In the proposed algorithm, we make improvements to the foundational dominance-based multi-objective evolutionary algorithm in two aspects. First, the use of feature correlation as knowledge to guide evolution enhances the search speed and quality of traditional multi-objective evolutionary algorithm solutions. Second, a dynamically allocated competitive–cooperative evolutionary mechanism is proposed, integrating the improved knowledge-guided evolution with traditional evolutionary algorithms, further enhancing the search efficiency and diversity of solutions. Through rigorous empirical testing on various datasets, the KCCEA demonstrates superior performance compared to basic multi-objective evolutionary algorithms, providing effective solutions to multi-objective feature selection problems while enhancing the interpretability and effectiveness of prediction models.

A Survey on Evolutionary Computation Approaches to Feature Selection

Evolutionary Computation for Feature Selection in Classification: A Comprehensive Survey of Solutions, Applications and Challenges

A Survey for Study of Feature Selection Algorithms

Feature selection based on improved quantum evolutionary algorithm

Feature Selection: A Data Perspective

A Survey on Evolutionary Multiobjective Feature Selection in Classification: Approaches, Applications, and Challenges

A Survey of Feature Selection Algorithm

A Brief Survey on Nature-Inspired Metaheuristics for Feature Selection in Classification in This Decade.

A Comprehensive Survey on the Process, Methods, Evaluation, and Challenges of Feature Selection

Multiobjective Differential Evolution for Feature Selection in Classification

A binary individual search strategy-based bi-objective evolutionary algorithm for high-dimensional feature selection

Feature clustering-Assisted feature selection with differential evolution

A Privacy-Preserving Evolutionary Computation Framework for Feature Selection.

Evolutionary Computation Meets Machine Learning: A Survey

A Knowledge-Guided Competitive Co-Evolutionary Algorithm for Feature Selection

Feature Selection Based on a Large-Scale Many-Objective Evolutionary Algorithm

Feature Selection by Applying Parallel Collaborative Evolutionary Ga

A Dividing-Based Many-Objective Evolutionary Algorithm for Large-Scale Feature Selection.

Feature Subspace Learning-based Binary Differential Evolution Algorithm for Unsupervised Feature Selection

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

An evolutionary multiobjective method based on dominance and decomposition for feature selection in classification