Abstract:This paper presents a novel feature selection approach to deal with issues of high dimensionality in biomedical data classification. Extensive research has been performed in the field of pattern recognition and machine learning. Dozens of feature selection methods have been developed in the literature, which can be classified into three main categories: filter, wrapper and hybrid approaches. Filter methods apply an independent test without involving any learning algorithm, while wrapper methods require a predetermined learning algorithm for feature subset evaluation. Filter and wrapper methods have their, respectively, drawbacks and are complementary to each other in that filter approaches have low computational cost with insufficient reliability in classification while wrapper methods tend to have superior classification accuracy but require great computational power. The approach proposed in this paper integrates filter and wrapper methods into a sequential search procedure with the aim to improve the classification performance of the features selected. The proposed approach is featured by (1) adding a pre-selection step to improve the effectiveness in searching the feature subsets with improved classification performances and (2) using Receiver Operating Characteristics (ROC) curves to characterize the performance of individual features and feature subsets in the classification. Compared with the conventional Sequential Forward Floating Search (SFFS), which has been considered as one of the best feature selection methods in the literature, experimental results demonstrate that (i) the proposed approach is able to select feature subsets with better classification performance than the SFFS method and (ii) the integrated feature pre-selection mechanism, by means of a new selection criterion and filter method, helps to solve the over-fitting problems and reduces the chances of getting a local optimal solution.

Stochastic Feature Selection for the Discrimination of Biomedical Spectra

Biomedical Spectral Classification Using Stochastic Feature Selection and Fuzzy Aggregation

Classification of magnetic resonance spectra using parallel randomized feature selection

Classification of Biomedical Spectra Using Fuzzy Interquartile Encoding and Stochastic Feature Selection

Randomized Feature Selection Using Scopira

Aggregating Multiple Classification Results Using Fuzzy Integration and Stochastic Feature Selection

Unsupervised Spectral Feature Selection Algorithms for High Dimensional Data

Representation and Classification of High-Dimensional Biomedical Spectral Data

A Hybrid Feature Selection Algorithm and Its Application in Bioinformatics

A Novel Feature Selection Approach for Biomedical Data Classification

Unsupervised Feature Selection by Preserving Stochastic Neighbors

A novel feature selection approach for biomedical data classification.

Sparse Discriminative Feature Selection for Multi-class Alzheimer’s Disease Classification

Optimal Feature Selection in High-Dimensional Discriminant Analysis

A Hybrid Feature Selection Algorithm Combining ReliefF and Particle Swarm Optimization for High-Dimensional Medical Data

Feature Selection Algorithm for High Dimensional Biomedical Data Classification Based on Redundant Removal

A Novel Feature Selection Method Based on MRMR and Enhanced Flower Pollination Algorithm for High Dimensional Biomedical Data

An Automatic Feature Selection Algorithm for High Dimensional Data Based on the Stochastic Complexity Regularization

A kernel-based multivariate feature selection method for microarray data classification.

An Adaptive Feature Selection Method for Microarray Data Analysis

A Novel Approach for Stable Selection of Informative Redundant Features from High Dimensional fMRI Data