Abstract:Feature selection (FS) has garnered significant attention because of its pivotal role in enhancing the efficiency and effectiveness of various machine learning and data mining algorithms. Concurrently, multiobjective feature selection (MOFS) algorithms strive to balance the complexity of multiple optimization objectives during the FS process. These include minimizing the number of selected features while maximizing classification performance. Nonetheless, managing the complexity of feature combinations presents a formidable challenge, particularly in high-dimensional datasets. Evolutionary algorithms (EAs) are increasingly adopted in MOFS owing to their exceptional global search capabilities and robustness. Despite their strengths, EAs face difficulties in navigating expansive solution spaces and achieving a balance between exploration and exploitation. To address these challenges, this study introduces a novel information gain-based EA for MOFS, designated as IGEA. This approach utilizes a clustering method for selecting a diverse parent population, thereby enhancing individual variability and maintaining a high-quality population. Considerably, IGEA employs information gain as a metric to evaluate the contribution of features to classification tasks. This metric informs crucial operations such as crossover and mutation. Moreover, the study extensively examines the actual solutions derived from IGEA, focusing on feature correlation and redundancy. This analysis illuminates IGEA's adept handling of these aspects to refine MOFS. Experimental results on 23 widely used classification datasets confirm IGEA's superiority over five other state-of-the-art algorithms, demonstrating its enhanced effectiveness and efficiency in complex MOFS scenarios.

An Effective Feature Selection Scheme via Genetic Algorithm Using Mutual Information

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Feature selection in SVM based on the hybrid of enhanced genetic algorithm and mutual information

Feature Selection with Conditional Mutual Information Considering Feature Interaction

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Ant Colony Optimization Combining with Mutual Information for Feature Selection in Support Vector Machines

A GA-like Dynamic Probability Method With Mutual Information for Feature Selection

A hybrid genetic algorithm for feature selection wrapper based on mutual information

A Feature Selection Method Based on Adaptive Simulated Annealing Genetic Algorithm

Feature Selection Based on Adaptive Multi-Population Genetic Algorithm

Similarity measurement and feature selection using genetic algorithm

Selection for Feature Gene Subset in Microarray Expression Profiles Based on an Improved Genetic Algorithm

A many-objective integrated evolutionary algorithm for feature selection in anomaly detection

Input Feature Selection Method Based on Feature Set Equivalence and Mutual Information Gain Maximization

Research on Genetic Algorithm Based on Mutual Information in the Spectrum Selection

Heuristic Genetic Algorithm for Feature Selection in Incomplete Information Systems

Feature Selection Using Mutual Information: An Experimental Study

Information Gain-based Multi-objective Evolutionary Algorithm for Feature Selection

A correlation guided genetic algorithm and its application to feature selection

Improved Inputted Feature Selection Classification Algorithm Based on Regular Mutual Information

Feature Selection With Dynamic Mutual Information