Abstract:In text classification field, many classifiers cannot deal with the features with large dimensions, thus it is very important to filter the redundant information from the original feature space efficiently and achieve the features with best qualities. On this basis, a new two-step based feature selection method is proposed in this paper. Firstly, some definitions (word semantic correlation, set semantic correlation, semantic correlative and semantic correlative set) are introduced, and the algorithm of generating the semantic correlative sets is given. Secondly, the process of the two-step based feature selection method is described: in the first step, a feature subset is obtained by using an optimal feature selection method, and a set of semantic correlative sets is generated by using the selected feature subset; in the second step, the redundant information of the selected features is filtered by using the generated semantic correlative sets. Finally, in order to avoid local optimum when searching the best threshold, the conception of memory recall position is introduced and an improved memory recall mechanism based fruit fly optimization algorithm is proposed. In the experiments, two typical classifiers: support vector machine and naïve bayes are used on four datasets: Reuters50, SMSSPAS, WebKB and 20-Newsgroups, and the 10-cross validation is carried out when the measurements of F 1 and receiver operating curve are used. Experimental results show that the proposed method achieves higher accuracy than several representative traditional feature selection methods and runs faster than typical mutual information based feature selection methods, illustrating its effectiveness on achieving the best features in text classification filed.

Redundant Feature Elimination By Using Approximate Markov Blanket Based On Discriminative Contribution

A Novel Metric For Redundant Gene Elimination Based On Discriminative Contribution

An Approximate Markov Blanket Feature Selection Algorithm

A Supervised Solution for Redundant Feature Detection Depending on Instances

A comparative study of redundant feature detection based feature selection methods

De-redundancy Relative Discrimination Criterion-based Feature Selection for Text Data

Dimension reduction with redundant gene elimination for tumor classification

A New Method for Redundancy Analysis in Feature Selection

A New Feature Selection Method for Handling Redundant Information in Text Classification

Feature Selection Algorithm for High Dimensional Biomedical Data Classification Based on Redundant Removal

Dynamic Interaction-Based Feature Selection Algorithm for Maximal Relevance Minimal Redundancy

Strong Approximate Markov Blanket and Its Application on Filter-Based Feature Selection

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Feature Redundancy Term Variation for Mutual Information-Based Feature Selection

Adaptive Feature Redundancy Minimization

Redundant feature selection by conditional linear correlation

Two-step Based Feature Selection Method for Filtering Redundant Information

Feature Selection with Integrated Relevance and Redundancy Optimization

Multi-label Feature Selection Via Redundancy of the Selected Feature Set

Feature selection based on min-redundancy and max-consistency

Joint Feature Selection Method Based on Relevance and Redundancy