Abstract:In text classification field, many classifiers cannot deal with the features with large dimensions, thus it is very important to filter the redundant information from the original feature space efficiently and achieve the features with best qualities. On this basis, a new two-step based feature selection method is proposed in this paper. Firstly, some definitions (word semantic correlation, set semantic correlation, semantic correlative and semantic correlative set) are introduced, and the algorithm of generating the semantic correlative sets is given. Secondly, the process of the two-step based feature selection method is described: in the first step, a feature subset is obtained by using an optimal feature selection method, and a set of semantic correlative sets is generated by using the selected feature subset; in the second step, the redundant information of the selected features is filtered by using the generated semantic correlative sets. Finally, in order to avoid local optimum when searching the best threshold, the conception of memory recall position is introduced and an improved memory recall mechanism based fruit fly optimization algorithm is proposed. In the experiments, two typical classifiers: support vector machine and naïve bayes are used on four datasets: Reuters50, SMSSPAS, WebKB and 20-Newsgroups, and the 10-cross validation is carried out when the measurements of F 1 and receiver operating curve are used. Experimental results show that the proposed method achieves higher accuracy than several representative traditional feature selection methods and runs faster than typical mutual information based feature selection methods, illustrating its effectiveness on achieving the best features in text classification filed.

An improvement direction for filter selection techniques using information theory measures and quadratic optimization

Feature Selection with Conditional Mutual Information Considering Feature Interaction

A Filter Approach to Feature Selection Based on Mutual Information

An Improved Feature Selection Algorithm for Ordinal Classification.

Two-step Based Feature Selection Method for Filtering Redundant Information

Conditional mutual information-based feature selection analyzing for synergy and redundancy

A new filter-based gene selection approach in the DNA microarray domain

Feature redundancy removal for text classification using correlated feature subsets

A feature selection algorithm based on classification complementarity

Interaction-based clustering algorithm for feature selection: a multivariate filter approach

Feature Selection with Integrated Relevance and Redundancy Optimization

Fuzzy joint mutual information feature selection based on ideal vector

Feature Selection for Classification using Principal Component Analysis and Information Gain

Input Feature Selection Method Based on Feature Set Equivalence and Mutual Information Gain Maximization

A combinatorial optimization approach to scenario filtering in portfolio selection

A novel hybrid feature selection method based on dynamic feature importance

Half-Quadratic Minimization for Unsupervised Feature Selection on Incomplete Data.

An Information Bottleneck Approach for Multi-View Feature Selection

Feature Selection Considering Weighted Relevancy

Fuzzy Mutual Information Based Min-Redundancy and Max-Relevance Heterogeneous Feature Selection

A new band selection approach based on information theory and support vector machine for hyperspectral images reduction and classification