Abstract:BACKGROUND:Modeling high-dimensional data involving thousands of variables is particularly important for gene expression profiling experiments, nevertheless,it remains a challenging task. One of the challenges is to implement an effective method for selecting a small set of relevant genes, buried in high-dimensional irrelevant noises. RELIEF is a popular and widely used approach for feature selection owing to its low computational cost and high accuracy. However, RELIEF based methods suffer from instability, especially in the presence of noisy and/or high-dimensional outliers.RESULTS:We propose an innovative feature weighting algorithm, called LHR, to select informative genes from highly noisy data. LHR is based on RELIEF for feature weighting using classical margin maximization. The key idea of LHR is to estimate the feature weights through local approximation rather than global measurement, which is typically used in existing methods. The weights obtained by our method are very robust in terms of degradation of noisy features, even those with vast dimensions. To demonstrate the performance of our method, extensive experiments involving classification tests have been carried out on both synthetic and real microarray benchmark datasets by combining the proposed technique with standard classifiers, including the support vector machine (SVM), k-nearest neighbor (KNN), hyperplane k-nearest neighbor (HKNN), linear discriminant analysis (LDA) and naive Bayes (NB).CONCLUSION:Experiments on both synthetic and real-world datasets demonstrate the superior performance of the proposed feature selection method combined with supervised learning in three aspects: 1) high classification accuracy, 2) excellent robustness to noise and 3) good stability using to various classification algorithms.

Feature weighting by RELIEF based on local hyperplane approximation

Feature Weight Estimation for Gene Selection: a Local Hyperlinear Learning Approach

An Unsupervised Feature Selection Method Based on Improved ReliefF and Bisecting K-means

Improvement Of Relieff Algorithm For Feature Weighting Fingerprint-Based Localization

Optimal Combination of Feature Weight Learning and Classification Based on Local Approximation

Sparse kernel-based feature weighting

Feature Selection using ReliefF Algorithm

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Relief-Based Feature Selection: Introduction and Review

Improvements over Adaptive Local Hyperplane to Achieve Better Classification.

Feature Selection for Cross-Scene Hyperspectral Image Classification Using Cross-Domain I-ReliefF

Feature Selection for Cross-Scene Hyperspectral Image Classification Using Cross-Domain ReliefF

A feature group weighting method for subspace clustering of high-dimensional data

An adaption of relief for redundant feature elimination

Feature Selection Considering Weighted Relevancy

Local Feature Discriminant Projection

Feature Weighting Algorithm Based on Margin and Linear Programming

Object-oriented feature selection of high spatial resolution images using an improved Relief algorithm.

Neighborhood Component Feature Selection for High-Dimensional Data.

Flexible Auto-Weighted Local-Coordinate Concept Factorization: A Robust Framework for Unsupervised Clustering

ReliefE: feature ranking in high-dimensional spaces via manifold embeddings