Abstract:A novel training method has been proposed for increasing efficiency and generalization of support vector machine (SVM). The efficiency of SVM in classification is directly determined by the number of the support vectors used, which is often huge in the complicated classification problem in order to represent a highly convoluted separation hypersurface for better nonlinear classification. However, the separation hypersurface of SVM might be unnecessarily over-convoluted around extreme outliers, as these outliers can easily dominate the objective function of SVM. This situation eventually affects the efficiency and generalization of SVM in classifying unseen testing samples. To avoid this problem, we propose a novel objective function for SVM, i.e., an adaptive penalty term is designed to suppress the effects of extreme outliers, thus simplifying the separation hypersurface and increasing the classification efficiency. Since maximization of the margin distance of hypersurface is no longer dominated by those extreme outliers, our generated SVM tends to have a wider margin, i.e., better generalization ability. Importantly, as our designed objective function can be reformulated as a dual problem, similar to that of standard SVM, any existing SVM training algorithm can be borrowed for the training of our proposed SVM. The performances of our method have been extensively tested on the UCI machine learning repository, as well as a real clinical problem, i.e., tissue classification in prostate ultrasound images. Experimental results show that our method is able to simultaneously increase the classification efficiency and the generalization ability of the SVM.

Generalization Performance Analysis of M-SVMs

An Analysis of SVMs Generalization Performance

M-estimator Based Support Vector Machine and Its Application

Construction methods for H-SVMs

The generalization error of the symmetric and scaled support vector machines.

SVM Classification:Its Contents and Challenges

SVM Generalization Performance Measuring Model Based on Geometry Analysis

Research and Analysis of Methods for Multiclass Support Vector Machines

The Generalization Ability of SVM Classification Based on Markov Sampling

General Scaled Support Vector Machines

An Adaptive Error Penalization Method for Training an Efficient and Generalized SVM.

Generalization Capacity of Multi-class SVM Based on Markovian Resampling

Researches on Algorithm for Confidence Evaluation and Decision Modification of Svm

General Vector Machine

On Improvement on Generalization Performance of Classifier by Using Empirical Risk

Improving the Generalization Performance of Multi-class SVM Via Angular Regularization

The Generalization Performance of Regularized Regression Algorithms Based on Markov Sampling

Explanation Based Generalized (Epsilon)-Svm And Its Application In Intelligent Project Management

Assessing Personal Performance with M-SVMs

A New Principle For Measuring The Generalization Performance Of Svms

An Overview on Semi-Supervised Support Vector Machine