Abstract:In text classification field, many classifiers cannot deal with the features with large dimensions, thus it is very important to filter the redundant information from the original feature space efficiently and achieve the features with best qualities. On this basis, a new two-step based feature selection method is proposed in this paper. Firstly, some definitions (word semantic correlation, set semantic correlation, semantic correlative and semantic correlative set) are introduced, and the algorithm of generating the semantic correlative sets is given. Secondly, the process of the two-step based feature selection method is described: in the first step, a feature subset is obtained by using an optimal feature selection method, and a set of semantic correlative sets is generated by using the selected feature subset; in the second step, the redundant information of the selected features is filtered by using the generated semantic correlative sets. Finally, in order to avoid local optimum when searching the best threshold, the conception of memory recall position is introduced and an improved memory recall mechanism based fruit fly optimization algorithm is proposed. In the experiments, two typical classifiers: support vector machine and naïve bayes are used on four datasets: Reuters50, SMSSPAS, WebKB and 20-Newsgroups, and the 10-cross validation is carried out when the measurements of F 1 and receiver operating curve are used. Experimental results show that the proposed method achieves higher accuracy than several representative traditional feature selection methods and runs faster than typical mutual information based feature selection methods, illustrating its effectiveness on achieving the best features in text classification filed.

Feature Selection Based on Distance Correlation: a Filter Algorithm

A Hybrid Feature Selection Approach by Correlation-Based Filters and SVM-RFE

Distance Correlation-Based Feature Selection in Random Forest

Feature selection with distance correlation

A Fast Hybrid Feature Selection Based on Correlation-Guided Clustering and Particle Swarm Optimization for High-Dimensional Data

Improving Effectiveness of Intrusion Detection by Correlation Feature Selection

Gene Selection Algorithm Based on Correlation Analysis

Novel Feature Selection Algorithms Based on Crowding Distance and Pearson Correlation Coefficient

Feature Selection Algorithm Based on Sparse Score and Correlation Analysis

TCIC_FS: Total Correlation Information Coefficient-Based Feature Selection Method for High-Dimensional Data

A Feature Selection Method Using Conditional Correlation Dispersion and Redundancy Analysis

Feature redundancy removal for text classification using correlated feature subsets

FS_SFS: A Novel Feature Selection Method for Support Vector Machines

A fusion of centrality and correlation for feature selection

An efficient algorithm for feature selection with feature correlation

Supervised Feature Selection by Preserving Class Correlation

Feature Selection Based on Wasserstein Distance

Feature selection based on mutual information with correlation coefficient

Two-step Based Feature Selection Method for Filtering Redundant Information

A Contrast Based Feature Selection Algorithm for High-dimensional Data set in Machine Learning