Abstract:Feature selection is an effective preprocessing technique to reduce data dimension. For feature selection, rough set theory provides many measures, among which mutual information is one of the most important attribute measures. However, mutual information based importance measures are computationally expensive and inaccurate, especially in hypersample instances, and it is undoubtedly a NP-hard problem in high-dimensional hyperhigh-dimensional data sets. Although many representative group intelligent algorithm feature selection strategies have been proposed so far to improve the accuracy, there is still a bottleneck when using these feature selection algorithms to process high-dimensional large-scale data sets, which consumes a lot of performance and is easy to select weakly correlated and redundant features. In this study, we propose an incremental mutual information based improved swarm intelligent optimization method (IMIICSO), which uses rough set theory to calculate the importance of feature selection based on mutual information. This method extracts decision table reduction knowledge to guide group algorithm global search. By exploring the computation of mutual information of supersamples, we can not only discard the useless features to speed up the internal and external computation, but also effectively reduce the cardinality of the optimal feature subset by using IMIICSO method, so that the cardinality is minimized by comparison. The accuracy of feature subsets selected by the improved cockroach swarm algorithm based on incremental mutual information is better or almost the same as that of the original swarm intelligent optimization algorithm. Experiments using 10 datasets derived from UCI, including large scale and high dimensional datasets, confirmed the efficiency and effectiveness of the proposed algorithm.

A multi-objective evolutionary algorithm for feature selection based on mutual information with a new redundancy measure

Feature Selection with Conditional Mutual Information Considering Feature Interaction

A feature selection algorithm based on redundancy analysis and interaction weight

Feature selection based on improved quantum evolutionary algorithm

Differential Evolution Based Feature Selection: A Niching-based Multi-objective Approach

An Information-Based Elite-Guided Evolutionary Algorithm for Multi-Objective Feature Selection

Multi-population differential evolution approach for feature selection with mutual information ranking

A many-objective integrated evolutionary algorithm for feature selection in anomaly detection

Feature Selection Using Diversity-Based Multi-objective Binary Differential Evolution

An evolutionary multiobjective method based on dominance and decomposition for feature selection in classification

A New Feature Selection Algorithm Based on Mutual Information with Pairwise Constraints

Multiobjective Differential Evolution for Feature Selection in Classification

A binary individual search strategy-based bi-objective evolutionary algorithm for high-dimensional feature selection

Multi-Label Feature Selection with Conditional Mutual Information

A New Method for Redundancy Analysis in Feature Selection

Information Gain-based Multi-objective Evolutionary Algorithm for Feature Selection

Feature selection algorithm based on incremental mutual information and cockroach swarm optimization

A new improved maximal relevance and minimal redundancy method based on feature subset

Feature selection based on mutual information with correlation coefficient

Feature Selection Based on a Large-Scale Many-Objective Evolutionary Algorithm

Differential Evolution With Duplication Analysis for Feature Selection in Classification