Abstract:BackgroundSupport vector machines (SVM) are a powerful tool to analyze data with a number of predictors approximately equal or larger than the number of observations. However, originally, application of SVM to analyze biomedical data was limited because SVM was not designed to evaluate importance of predictor variables. Creating predictor models based on only the most relevant variables is essential in biomedical research. Currently, substantial work has been done to allow assessment of variable importance in SVM models but this work has focused on SVM implemented with linear kernels. The power of SVM as a prediction model is associated with the flexibility generated by use of non-linear kernels. Moreover, SVM has been extended to model survival outcomes. This paper extends the Recursive Feature Elimination (RFE) algorithm by proposing three approaches to rank variables based on non-linear SVM and SVM for survival analysis.ResultsThe proposed algorithms allows visualization of each one the RFE iterations, and hence, identification of the most relevant predictors of the response variable. Using simulation studies based on time-to-event outcomes and three real datasets, we evaluate the three methods, based on pseudo-samples and kernel principal component analysis, and compare them with the original SVM-RFE algorithm for non-linear kernels. The three algorithms we proposed performed generally better than the gold standard RFE for non-linear kernels, when comparing the truly most relevant variables with the variable ranks produced by each algorithm in simulation studies. Generally, the RFE-pseudo-samples outperformed the other three methods, even when variables were assumed to be correlated in all tested scenarios.ConclusionsThe proposed approaches can be implemented with accuracy to select variables and assess direction and strength of associations in analysis of biomedical data using SVM for categorical or time-to-event responses. Conducting variable selection and interpreting direction and strength of associations between predictors and outcomes with the proposed approaches, particularly with the RFE-pseudo-samples approach can be implemented with accuracy when analyzing biomedical data. These approaches, perform better than the classical RFE of Guyon for realistic scenarios about the structure of biomedical data.

Support Vector Machine-Recursive Feature Elimination for Localized Feature Selection

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Multiclass Cancer Classification by Using Fuzzy Support Vector Machine and Binary Decision Tree with Gene Selection

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

SVM-RFE With MRMR Filter for Gene Selection

SVM-T-RFE: a Novel Gene Selection Algorithm for Identifying Metastasis-Related Genes in Colorectal Cancer Using Gene Expression Profiles.

Multiclass feature selection algorithms base on R-SVM

Gene Selection for Cancer Classification using Support Vector Machines

A Cancer Gene Selection Algorithm Based on the K-S Test and CFS

Accelerated Recursive Feature Elimination Based on Support Vector Machine for Key Variable Identification

A New Svm-Rfe Approach Towards Ranking Problem

Gene Selection Algorithm Based on Correlation Analysis

SVM-RFE: selection and visualization of the most relevant features through non-linear kernels

MGRFE: Multilayer Recursive Feature Elimination Based on an Embedded Genetic Algorithm for Cancer Classification

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Gene selection for cancer classification using a hybrid of univariate and multivariate feature selection methods

Gene selection and classification for cancer microarray data based on machine learning and similarity measures

Feature Selection and Classification of MAQC-II Breast Cancer and Multiple Myeloma Microarray Gene Expression Data

An Effective Gene Selection Method for Cancer Subtype Classification Based on Predatory Search Genetic Algorithm and Support Vector Machine

Gene selection algorithm by combining reliefF and mRMR