Abstract:The binary tree support vector machine (SVM) algorithm is one of the mainstream algorithms for multi-class classification in the fields of pattern recognition and machine learning. In order to reduce the training and testing time of one-against-all SVM (OAA-SVM) and reduced OAA-SVM (R-OAA-SVM), in this study, two OAA partition based binary tree SVM algorithms are proposed for multi-class classification. One is the single-space-mapped binary tree SVM (SBT-SVM) and the other is the multi-space-mapped binary tree SVM (MBT-SVM). In the proposed two algorithms, the best OAA partition is determined for each non-leaf node and the k-fold cross validation strategy is adopted to obtain the optimal classifiers. A set of experiments is conducted on nine UCI datasets and two face recognition datasets to demonstrate their performances. The results show that in term of testing accuracy, MBT-SVM is comparable with one-against-one SVM (OAO-SVM), R-OAA-SVM and OAA-SVM and superior to SBT-SVM. In term of testing time, MBT-SVM is superior to OAO-SVM, binary tree of SVM (BTS), R-OAA-SVM and OAA-SVM and slightly longer than SBT-SVM. In term of training time, MBT-SVM is superior to BTS, R-OAA-SVM and OAA-SVM and comparable with SBT-SVM. For the datasets with smaller class number and training sample number, the training time of MBT-SVM is comparable with that of OAO-SVM. For the datasets with larger class number or training sample number, in most cases, the training time of MBT-SVM is longer than that of OAO-SVM.

Binary tree support vector machine based on kernel fisher discriminant for multi-classification

Multivariate time series classification based on μσ-DWC feature and tree-structured M-SVM

Tree-Structured Support Vector Machines for Multi-class Classification

The One-Against-All Partition Based Binary Tree Support Vector Machine Algorithms for Multi-Class Classification

An Improved Binary Tree SVM for Multi-Classification

Nesting Algorithm for Multi-Classification Problems

Weighted Multi-Class Support Vector Machine Based on Binary Tree

An Improved Binary Tree SVM Multi-class Classification Algorithm

A Comparision of Multiclass Support Vector Machine Algorithms

Multi-class Classification of Support Vector Machines Based on Double Binary Tree

Nesting Support Vector Machinte For Mute-Classification

An Efficient Algorithm for Multi-Class Support Vector Machines

Novel Design of Decision-Tree-Based Support Vector Machines Multi-Class Classifier

Twi-Map support vector machine for multi-classification problems

Nesting Support Vector Machinte for Muti-Classification [machinte Read Machine]

Modifying the Decision Function in One-Against-All Algorithm for Multi-Classification

A Hierarchical SVM Based Multiclass Classification by Using Similarity Clustering

Multi-Class Image Recognition Based on Relevance Vector Machine

Multi-class Classifier of Non-Linear SVM Decision Tree

Decision Tree Support Vector Machine Based on Genetic Algorithm for Multi-Class Classification

Support Vector Machine Algorithm Based on Kernel Hierarchical Clustering for Multiclass Classification