Abstract:Feature selection is an effective approach to dimensionality reduction. Feature selection based on rough sets and fuzzy rough sets is extensively realized by introducing diversified heuristic information. Most existing heuristic feature selection methods ignore the fact that different features have distinct classification abilities when constructing feature evaluation functions. Due to the limitations of search strategies, locally optimal feature subsets are probably selected out. Embedded feature selection based on regression analysis can avoid falling into locally optimal feature subsets to a certain extent. However, only linear relationships between feature space and decision space have been involved. To overcome those problems, a pointwise mutual information sparsely embedded feature selection model (PMISEFS) is proposed in this paper. In this model, the pointwise fuzzy mutual information matrix is constructed based on fuzzy information granules to characterize the discernibility of features as well as the nonlinear relationship between the feature space and decision space for a data set. A classification information matrix is introduced to further describe the consistency between the predicted decision and real decisions of samples. The fuzzy mutual information tensor is embedded sparsely into the decision matrix and the sparsely embedded coefficients, called information fusion coefficients (IFCs) of features, are adaptively learnt by imposing a smooth constraint to avoid over-fitting. An embedded feature selection algorithm is designed to adaptively learn optimal IFCs. Extensive experiments on various benchmark data sets are conducted and experimental results demonstrate the superiority of the proposed model over the state-of-the-art heuristic as well as embedded feature selection methods.

Feature Subset Selection Combining Maximal Information Entropy and Maximal Information Coefficient

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Fuzzy Entropy Based Max-Relevancy and Min-Redundancy Feature Selection.

Feature selection method with joint maximal information entropy between features and class.

Feature Selection Algorithm Based on Maximum Information Coefficient

Input Feature Selection Method Based on Feature Set Equivalence and Mutual Information Gain Maximization

Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy

A Filter Approach to Feature Selection Based on Mutual Information

Feature Selection by Maximizing Part Mutual Information

An Ensemble Multi-Label Feature Selection Algorithm Based on Information Entropy

Feature Selection by Maximizing Independent Classification Information.

A Novel Hybrid Algorithm for Feature Selection

Feature Selection Using Information Distance Measure for Gene Expression Data

Higher Order Mutual Information Approximation for Feature Selection

Feature selection based on complementarity of feature classification capability

Mic_fs : A Novel Model For Feature Selection By Mutual Information Guided By Clustering

Feature Selection Using Mutual Information: An Experimental Study

Feature selection based on survival Cauchy-Schwartz mutual information

A fusion of centrality and correlation for feature selection

Size Adaptive Selection of Most Informative Features

Pointwise Mutual Information Sparsely Embedded Feature Selection