Abstract:A novel feature selection algorithm based on classification complementarity is proposed in this paper, in order to atone for the shortcomings of using the filter or wrapper feature selection approach alone. The filter feature selection method can select features fast but has low accuracy, while the wrapper method can get better performance on feature selection but it costs lots of time. Thus, the proposed algorithm combines both the filter approach and the wrapper approach together. The algorithm includes two steps. In the first step, it removes the irrelevant features using ReliefF estimation and symmetric uncertainty estimation, which are two correlation measures on feature performance estimations in classical feature selection methods. Features with low correlation with class variance would be excluded as irrelevant features. Then symmetric uncertainty estimation is used to remove the redundant features. Features with high symmetric uncertainty to each other means there exists redundancy between them and the worst of them should be excluded.In the second step, it selects the target feature subset by using a wrapper feature selection algorithm based on classification complementarity estimation. We proposed the classification complementarity concept, a new estimation to the combination of feature sets. Classification complementarity indicates whether combination of feature set could improve classification performance. By this estimation feature sets are combined together iteratively until no better feature set could be found.Experiment results indicate that the proposed algorithm has advantages of high accuracy and low time cost and is effective in practical applications.

A Novel Wrapper Method for Feature Selection and Its Applications

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Novel Linear Search for Support Vector Machine Parameter Selection

FS_SFS: A Novel Feature Selection Method for Support Vector Machines

A Novel Wrapper Approach for Feature Selection in Object-Based Image Classification Using Polygon-Based Cross-Validation

BPSO-SVM Wrapper for Feature Subset Selection

A Gaussian radial basis function based feature selection algorithm

An Improved Wrapper Method for Feature Selection

An Approximate Markov Blanket Feature Selection Algorithm

A Feature Selection Method for Nonparallel Plane Support Vector Machine Classification

A Novel SVM and Its Application to Breast Cancer Diagnosis

Feature subset selection for support vector machines through sensitivity analysis

Search Space Division Method for Wrapper Feature Selection on High-Dimensional Data Classification

Kernel Parameter Selection for Support Vector Machine Classification

A Hybrid Particle Swarm Optimization Algorithm with Dynamic Adjustment of Inertia Weight Based on a New Feature Selection Method to Optimize SVM Parameters

A novel feature selection method based on quantum support vector machine

A simple and reliable instance selection for fast training support vector machine: Valid Border Recognition

Simultaneous Feature Selection and SVM Parameter by Using Artificial Bee Colony Algorithm

A feature selection algorithm based on classification complementarity