Abstract:Feature interaction is an important issue in feature subset selection. However, most of the existing algorithms only focus on dealing with irrelevant and redundant features. In this paper, a propositional FOIL rule based algorithm FRFS, which not only retains relevant features and excludes irrelevant and redundant ones but also considers feature interaction, is proposed for selecting feature subset for high dimensional data. FRFS first merges the features appeared in the antecedents of all FOIL rules, achieving a candidate feature subset which excludes redundant features and reserves interactive ones. Then, it identifies and removes irrelevant features by evaluating features in the candidate feature subset with a new metric CoverRatio, and obtains the final feature subset. The efficiency and effectiveness of FRFS are extensively tested upon both synthetic and real world data sets, and it is compared with other six representative feature subset selection algorithms, including CFS, FCBF, Consistency, Relief-F, INTERACT, and the rule-based FSBAR, in terms of the number of selected features, runtime and the classification accuracies of the four well-known classifiers including Naive Bayes, C4.5, PART and IB1 before and after feature selection. The results on the five synthetic data sets show that FRFS can effectively identify irrelevant and redundant features while reserving interactive ones. The results on the 35 real world high dimensional data sets demonstrate that compared with other six feature selection algorithms, FRFS cannot only efficiently reduce the feature space, but also can significantly improve the performance of the four well-known classifiers.

Feature selection for interval-valued data via FRIC-model

An Unsupervised Feature Selection Method Based on Improved ReliefF and Bisecting K-means

Feature selection for a set-valued decision information system based on fuzzy rough iterative computation model

Maximum Information Coefficient Feature Selection Method for Interval-Valued Data

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Interval Dominance-Based Feature Selection for Interval-Valued Ordered Data

Feature selection for multiset-valued data based on fuzzy conditional information entropy using iterative model and matrix operation

Interactive and Complementary Feature Selection Via Fuzzy Multigranularity Uncertainty Measures

Class Specific Feature Selection for Interval Valued Data Through Interval K-Means Clustering

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

Unsupervised feature selection algorithm framework based on neighborhood interval disturbance fusion

Intuitionistic Fuzzy Quantifier and Its Application in Feature Selection

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

Analytical-solution-based interval fuzzy utility acquisition and decision making with interval-valued fuzzy preference relations based on additive consistency

Selecting Feature Subset for High Dimensional Data Via the Propositional Foil Rules

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Information entropy-assisted intuitionistic fuzzy rough feature subset selection

An Optimal Feature Subset Selection Method Based On Distance Discriminant And Distribution Overlapping

Modeling methods for deep fuzzy inference systems based on feature selection

Incremental feature selection based on fuzzy rough sets

High-order interaction feature selection for classification learning: A robust knowledge metric perspective