Abstract:When applying the support vector machine (SVM) to high-dimensional classification problems, we often impose a sparse structure in the SVM to eliminate the influences of the irrelevant predictors. The lasso and other variable selection techniques have been successfully used in the SVM to perform automatic variable selection. In some problems, there is a natural hierarchical structure among the variables. Thus, in order to have an interpretable SVM classifier, it is important to respect the heredity principle when enforcing the sparsity in the SVM. Many variable selection methods, however, do not respect the heredity principle. In this paper we enforce both sparsity and the heredity principle in the SVM by using the so-called structured variable selection (SVS) framework originally proposed in Yuan, Joseph and Zou (2007). We minimize the empirical hinge loss under a set of linear inequality constraints and a lasso-type penalty. The solution always obeys the desired heredity principle and enjoys sparsity. The new SVM classifier can be efficiently fitted, because the optimization problem is a linear program. Another contribution of this work is to present a nonparametric extension of the SVS framework, and we propose nonparametric heredity SVMs. Simulated and real data are used to illustrate the merits of the proposed method.

Structure Selection of Neurofuzzy Networks Based on Support Vector Regression

A neurofuzzy network structure for nonlinear system modeling

Flatheaded support vector machine for regression

Fuzzy neural network control of tcsc

Noise model based ν-support vector regression with its application to short-term wind speed forecasting

Neuro-Fuzzy Network Based on Rough Sets and Its Applications

Fuzzy support vector clustering

Support Vector Regression Based Nonlinear Model Reference Adaptive Control

Optimal Method of Neuro-Fuzzy Network and Its Application Based on Variable Precision Rough Set

A Study of Modelling Non-Stationary Time Series Using Support Vector Machines with Fuzzy Segmentation Information

Neuro-fuzzy System Modeling Based on Automatic Fuzzy Clustering

A Multi-SVR Based Fuzzy Modeling Method for Non-Stationary Time Series

Traffic Flow Predicting Of Chaos Time Series Using Support Vector Learning Mechanism For Fuzzy Rule-Based Modeling

Modelling of river discharges using neural networks derived from support vector regression.

Fuzzy Support Vector Machine For Regression Estimation

A model reference control structure using a fuzzy neural network

Hierarchical 1-FSVM Algorithm Based on SMO

Structure Selection of Polynomial NARX Models using Two Dimensional (2D) Particle Swarms

A Self-Organizing Neural-Network-based Fuzzy System

Extracting Inherent Model Structures and Identifying Parameters of Time-Varying Systems Using Local Linear Neuro-Fuzzy Networks

Structured variable selection in support vector machines