Abstract:The rapid development of computer and database technologies has led to the high growth of large-scale datasets. This produces an important issue for data mining applications called the curse of dimensionality, where the number of features is much higher than the number of patterns. One of the dimensionality reduction approaches is feature selection, which can increase the accuracy of these applications and reduce their computational complexity. This paper proposes a novel feature selection method to reduce the dimensionality and computational complexity in high-dimensional data processing. First, based on the centrality and Fisher score, a probabilistic strategy metric is proposed to measure the influence of features. Second, a new discriminant function is proposed to determine whether one feature should be selected. It can automatically calculate weight parameters to balance the relevance of a feature to class labels and the redundancy of the selected feature subset. Finally, a new method is proposed by combining the maximum information coefficient (MIC), total information (TI) and centrality technique, named MTC_FS. The experimental results show that the average accuracy of the MTC_FS improves by 1.8% compared with the best baseline, and the comprehensive performance of the MTC_FS is superior to all baselines on 12 public datasets. MTC_FS has a shorter runtime on all datasets than all baselines. In addition, the performance of the MTC_FS method is the most stable on the NBayes classifier.

Mic_fs : A Novel Model For Feature Selection By Mutual Information Guided By Clustering

Feature Selection with Conditional Mutual Information Considering Feature Interaction

A Filter Approach to Feature Selection Based on Mutual Information

Feature Selection Based on Data Clustering

Feature selection and threshold method based on fuzzy joint mutual information

Feature selection based on survival Cauchy-Schwartz mutual information

A New Unsupervised Feature Selection Algorithm Using Similarity-Based Feature Clustering.

A fusion of centrality and correlation for feature selection

A New Approach for Feature Selection from Microarray Data Based on Mutual Information.

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Feature selection based on Mutual Information in supervised learning

Feature Selection with Attributes Clustering by Maximal Information Coefficient

Higher Order Mutual Information Approximation for Feature Selection

A Constrained Feature Selection Approach Based on Feature Clustering and Hypothesis Margin Maximization

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

Mutual Information-Based Unsupervised Feature Transformation for Heterogeneous Feature Subset Selection

Interaction-based clustering algorithm for feature selection: a multivariate filter approach

Ant Colony Optimization Combining with Mutual Information for Feature Selection in Support Vector Machines

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Fuzzy joint mutual information feature selection based on ideal vector

Input Feature Selection Method Based on Feature Set Equivalence and Mutual Information Gain Maximization