Abstract:Multi-class classification is an important and on-going research subject in data mining and machine learning.Recently,a new structural method named K-SVCR was proposed for tackling multi-class classification problems.Compared with others,the remarkable advantage of this method is that it allows all the information to be incorporated into the remaining training patterns when a multi-class problem is considered during the decomposition scheme.However,as the same as the most popular one-against-one method,for a K-class classification problem,K(K-1)/2 quadratic programs need to be solved to assign a new pattern to a proper class.So it is extremely important to develop an algorithm that can solve these quadratic programs efficiently.In this paper,we start with a new formulation which is proposed based on the K-SVCR method.We then transform it as a complementarity problem and further a strongly convex unconstrained optimization problem by using the implicit Lagrangian function.Then a fast Newton algorithm with global and finite termination properties is established for solving the resulting optimization problem.In addition, for many a multi-class classification problems,the total number of patterns 1 is much larger than the dimensionality of the pattern n.We exploit this property by inverting a(n+1)×(n+1) matrix instead of the potentially much large 1×1 matrix in the algorithm via the Sherman-Morrison-Woodbury identity.This indicates that the algorithm can be implemented efficiently in practice.Preliminary numerical experiments on benchmark datasets show that the algorithm has good performance on both accuracy and training speed.

Linear Multi-Class Classification Support Vector Machine

A New Support Vector Machine for Multi-class Classification

A Multi-Class Large Margin Classifier

Support Vector Machines for Multi-class Classification Problems

Multi-classification Algorithm and Its Realization Based on Least Square Support Vector Machine Algorithm

Support Vector Machines for Classification Problems

Multiple Birth Support Vector Machine for Multi-Class Classification

A Parallel Multi-Class Classification Support Vector Machine Based on Sequential Minimal Optimization

A Twin Multi-Class Classification Support Vector Machine

Multi-Class Support Vector Machine Via Maximizing Multi-Class Margins

Non-parallel planes support vector machine for multi-class classification

A Finite Newton Algorithm for Multi-class Support Vector Machines

Least squares recursive projection twin support vector machine for multi-class classification

Multi-View Scaling Support Vector Machines for Classification and Feature Selection.

Latticesvm-A New Method For Multi-Class Support Vector Machines

A New Multi-Class Support Vector Algorithm

Using Novel Support Vector Machines for Efficient Classification

A Multi-class Classification Algorithm Based on the Proximal Support Vector Machine

LINEX Support Vector Machine for Large-Scale Classification.

Research and Analysis of Methods for Multiclass Support Vector Machines

Multi-task Least Squares Twin Support Vector Machine for Classification