Abstract:In many pattern recognition applications, high-dimensional feature vectors impose a high computational cost as well as the risk of ''overfitting''. Feature Selection addresses the dimensionality reduction problem by determining a subset of available features which is most essential for classification. This paper presents a novel feature selection method named filtered and supported sequential forward search (FS_SFS) in the context of support vector machines (SVM). In comparison with conventional wrapper methods that employ the SFS strategy, FS_SFS has two important properties to reduce the time of computation. First, it dynamically maintains a subset of samples for the training of SVM. Because not all the available samples participate in the training process, the computational cost to obtain a single SVM classifier is decreased. Secondly, a new criterion, which takes into consideration both the discriminant ability of individual features and the correlation between them, is proposed to effectively filter out nonessential features. As a result, the total number of training is significantly reduced and the overfitting problem is alleviated. The proposed approach is tested on both synthetic and real data to demonstrate its effectiveness and efficiency. .

Feature Analysis: Support Vector Machines Approaches

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Feature subset selection for support vector machines through sensitivity analysis

M-estimator Based Support Vector Machine and Its Application

Feature Selection for Support Vector Machines in Text Categorization

Feature Ranking for Support Vector Machine Classification and Its Application to Machinery Fault Diagnosis

A Survey for Study of Feature Selection Algorithms

Support Feature Machines

Support Vector Machine-Recursive Feature Elimination for Localized Feature Selection

FS_SFS: A Novel Feature Selection Method for Support Vector Machines

A New Svm-Rfe Approach Towards Ranking Problem

Classification of Src Kinase Inhibitors Based on Support Vector Machine

Accelerated Recursive Feature Elimination Based on Support Vector Machine for Key Variable Identification

SVM Classification:Its Contents and Challenges

A feature-selection algorithm based on Support Vector Machine-Multiclass for hyperspectral visible spectral analysis

Discretization Based Feature Selection for Support Vector Machines

A SVM-based Feature Selection Method and Its Applications

A Comparative Study of Relevant Vector Machine and Support Vector Machine in Uncertainty Analysis

Credit Scoring by Feature-Weighted Support Vector Machines

RANDOM FOREST AND SUPPORT VECTOR MACHINE ON FEATURES SELECTION FOR REGRESSION ANALYSIS

Fs-Svm Based Intrusion Detection Feature Selection And Classification