Abstract:High dimensionality and small sample sizes, and their inherent risk of overfitting, pose great challenges for constructing efficient classifiers in microarray data classification. Therefore a feature selection technique should be conducted prior to data classification to enhance prediction performance. In general, filter methods can be considered as principal or auxiliary selection mechanism because of their simplicity, scalability, and low computational complexity. However, a series of trivial examples show that filter methods result in less accurate performance because they ignore the dependencies of features. Although few publications have devoted their attention to reveal the relationship of features by multivariate-based methods, these methods describe relationships among features only by linear methods. While simple linear combination relationship restrict the improvement in performance. In this paper, we used kernel method to discover inherent nonlinear correlations among features as well as between feature and target. Moreover, the number of orthogonal components was determined by kernel Fishers linear discriminant analysis (FLDA) in a self-adaptive manner rather than by manual parameter settings. In order to reveal the effectiveness of our method we performed several experiments and compared the results between our method and other competitive multivariate-based features selectors. In our comparison, we used two classifiers (support vector machine, [Formula: see text]-nearest neighbor) on two group datasets, namely two-class and multi-class datasets. Experimental results demonstrate that the performance of our method is better than others, especially on three hard-classify datasets, namely Wang's Breast Cancer, Gordon's Lung Adenocarcinoma and Pomeroy's Medulloblastoma.

A Multi-class Feature Selection Algorithm Based on Support Vector Machine

Feature selection algorithm in support vector machine

Feature Selection Via Scaling Factor Integrated Multi-Class Support Vector Machines

New Fast Feature Selection Methods Based on Multiple Support Vector Data Description

Group Feature Selection with Multiclass Support Vector Machine

A feature-selection algorithm based on Support Vector Machine-Multiclass for hyperspectral visible spectral analysis

Feature Selection For Multi-Class Problems Using Support Vector Machines

A kernel-based multivariate feature selection method for microarray data classification.

A Doubly Sparse Multiclass Support Vector Machine with Simultaneous Feature and Sample Screening

Feature Selection Algorithm Based on the Multi-Colony Fairness Model

A Hybrid Feature Selection Approach by Correlation-Based Filters and SVM-RFE

Feature Selection Algorithm Based on Sparse Score and Correlation Analysis

Feature Selection for High Dimensional Imbalanced Class Data Based on F-measure Optimization

Feature selection using feature ranking, correlation analysis and chaotic binary particle swarm optimization

A New Hybrid Feature Selection Based on Multi-Filter Weights and Multi-Feature Weights

An Adaptive Feature Selection Method for Multi-Class Classification.

Feature selection with kernelized multi-class support vector machine

Multi-class feature selection via Sparse Softmax with a discriminative regularization

A New Multi-Colony Fairness Algorithm for Feature Selection

Feature subset selection for support vector machines through sensitivity analysis

A Novel Hybrid Algorithm for Feature Selection