Abstract:Multi-class classification is an important and on-going research subject in data mining and machine learning.Recently,a new structural method named K-SVCR was proposed for tackling multi-class classification problems.Compared with others,the remarkable advantage of this method is that it allows all the information to be incorporated into the remaining training patterns when a multi-class problem is considered during the decomposition scheme.However,as the same as the most popular one-against-one method,for a K-class classification problem,K(K-1)/2 quadratic programs need to be solved to assign a new pattern to a proper class.So it is extremely important to develop an algorithm that can solve these quadratic programs efficiently.In this paper,we start with a new formulation which is proposed based on the K-SVCR method.We then transform it as a complementarity problem and further a strongly convex unconstrained optimization problem by using the implicit Lagrangian function.Then a fast Newton algorithm with global and finite termination properties is established for solving the resulting optimization problem.In addition, for many a multi-class classification problems,the total number of patterns 1 is much larger than the dimensionality of the pattern n.We exploit this property by inverting a(n+1)×(n+1) matrix instead of the potentially much large 1×1 matrix in the algorithm via the Sherman-Morrison-Woodbury identity.This indicates that the algorithm can be implemented efficiently in practice.Preliminary numerical experiments on benchmark datasets show that the algorithm has good performance on both accuracy and training speed.

A total multi-class support vector machine

A Multi-Class Large Margin Classifier

A New Multi-Class Support Vector Algorithm

A New Support Vector Machine for Multi-class Classification

A support vector domain classification algorithm with gray information

On-line support vector regression with multiple samples

A Twin Multi-Class Classification Support Vector Machine

K-RSVCR: A rough margin-based multi-class support vector machine

A Finite Newton Algorithm for Multi-class Support Vector Machines

New multi-class support vector machine based on support vector data description

Linear Multi-Class Classification Support Vector Machine

Support Vector Machines for Multi-class Classification Problems

A New Multi-Class Support Vector Machines

Research on multi-class classification of support vector data description

Researches on Algorithm for Confidence Evaluation and Decision Modification of Svm

Multi-class classification using support vector regression machine with consistency

A Comparision of Multiclass Support Vector Machine Algorithms

A Doubly Sparse Multiclass Support Vector Machine with Simultaneous Feature and Sample Screening

An Improved Multiclass Algorithm For Svms

A New Classification Algorithm Research

An Efficient Algorithm for Multi-Class Support Vector Machines