Abstract:Classical support vector machine (SVM) and its twin variant twin support vector machine (TWSVM) utilize the Hinge loss that shows linear behaviour, whereas the least squares version of SVM (LSSVM) and twin least squares support vector machine (LSTSVM) uses L2-norm of error which shows quadratic growth. The robust Huber loss function is considered as the generalization of Hinge loss and L2-norm loss that behaves like the quadratic L2-norm loss for closer error points and the linear Hinge loss after a specified distance. Three functional iterative approaches based on generalized Huber loss function are proposed in this paper to solve support vector classification problems of which one is based on SVM, i.e. generalized Huber support vector machine and the other two are in the spirit of TWSVM, namely generalized Huber twin support vector machine and regularization on generalized Huber twin support vector machine. The proposed approaches iteratively find the solutions and eliminate the requirements to solve any quadratic programming problem (QPP) as for SVM and TWSVM. The main advantages of the proposed approach are: firstly, utilize the robust Huber loss function for better generalization and for lesser sensitivity towards noise and outliers as compared to quadratic loss; secondly, it uses functional iterative scheme to find the solution that eliminates the need to solving QPP and also makes the proposed approaches faster. The efficacy of the proposed approach is established by performing numerical experiments on several real-world datasets and comparing the result with related methods, viz. SVM, TWSVM, LSSVM and LSTSVM. The classification results are convincing.

A Novel Semi-Supervised Support Vector Machine with Asymmetric Squared Loss.

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

M-estimator Based Support Vector Machine and Its Application

An Incremental Updating Method for Support Vector Machines

A Novel Loss Function-based Support Vector Machine for Binary Classification

Asymmetric Least Squares Support Vector Machine Classifiers

Non-smooth optimization algorithm to solve the LINEX soft support vector machine

Asymmetric and robust loss function driven least squares support vector machine

A sparse semismooth Newton based augmented Lagrangian method for large-scale support vector machines

Distributed Online Semi-Supervised Support Vector Machine

Probabilistic Labeled Semi-supervised SVM

Improved Generalized-Pinball-Loss-Based Laplacian Twin Support Vector Machine for Data Classification

Unified Locally Linear Classifiers with Diversity-Promoting Anchor Points

Symmetric LINEX loss twin support vector machine for robust classification and its fast iterative algorithm

Nonlinear kernel-free quadratic hyper-surface support vector machine with 0-1 loss function

A Novel Robust Smooth Support Vector Machine

Optimization meets Machine Learning: An Exact Algorithm for Semi-Supervised Support Vector Machines

Sparse Least Absolute Deviation Support Vector Machine

A nonlinear kernel SVM classifier via L 0 / 1 soft-margin loss with classification performance

Functional iterative approaches for solving support vector classification problems based on generalized Huber loss

Semi-supervised Learning Using Label Mean.