Abstract:<p>Feature selection is a widely used dimension reduction technique to select feature subsets because of its interpretability. Many methods have been proposed and achieved good results, in which the relationships between adjacent data points are mainly concerned. But the possible associations between data pairs that are not adjacent are always neglected. Different from previous methods, we propose a novel and very simple approach for unsupervised feature selection, named MMFS (Multi-step Markov Probability Relationship for Feature Selection). The idea is using multi-step Markov transition probability to describe the relation between any data pair. Two ways from the positive and negative viewpoints are employed respectively to keep the data structure after feature selection. From the positive viewpoint, the maximum transition probability that can be reached in a certain number of steps is used to describe the relation between two points. Then, the features which can keep the compact data structure are selected. From the viewpoint of negative, the minimum transition probability that can be reached in a certain number of steps is used to describe the relation between two points. On the contrary, the features that least maintain the loose data structure are selected. The two ways can also be combined. Thus three algorithms are proposed. Our main contributions are a novel feature section approach which uses multi-step transition probability to characterize the data structure, and three algorithms proposed from the positive and negative aspects for keeping data structure and select the features to preserve such structure. The performance of our approach is compared with the state-of-the-art methods on eight real-world data sets, and the experimental results show that the proposed MMFS is effective in unsupervised feature selection.</p>

An information-theoretic feature selection method based on estimation of Markov blanket

An Approximate Markov Blanket Feature Selection Algorithm

Feature Selection with Conditional Mutual Information Considering Feature Interaction

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Strong Approximate Markov Blanket and Its Application on Filter-Based Feature Selection

Feature Selection Based on Data Clustering

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

Accelerating information entropy-based feature selection using rough set theory with classified nested equivalence classes

Feature selection for multiset-valued data based on fuzzy conditional information entropy using iterative model and matrix operation

Interactive and Complementary Feature Selection Via Fuzzy Multigranularity Uncertainty Measures

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

Feature selection and threshold method based on fuzzy joint mutual information

An Emerging Fuzzy Feature Selection Method Using Composite Entropy-Based Uncertainty Measure and Data Distribution

Unsupervised feature selection via multi-step markov probability relationship

Higher Order Mutual Information Approximation for Feature Selection

Entropy based measure and its algorithms for scalable feature selection

Effective fuzzy joint mutual information feature selection based on uncertainty region for classification problem

Supervised feature selection method via potential value estimation

MetaFS: An Effective Wrapper Feature Selection via Meta Learning