Abstract:The binary tree support vector machine (SVM) algorithm is one of the mainstream algorithms for multi-class classification in the fields of pattern recognition and machine learning. In order to reduce the training and testing time of one-against-all SVM (OAA-SVM) and reduced OAA-SVM (R-OAA-SVM), in this study, two OAA partition based binary tree SVM algorithms are proposed for multi-class classification. One is the single-space-mapped binary tree SVM (SBT-SVM) and the other is the multi-space-mapped binary tree SVM (MBT-SVM). In the proposed two algorithms, the best OAA partition is determined for each non-leaf node and the k-fold cross validation strategy is adopted to obtain the optimal classifiers. A set of experiments is conducted on nine UCI datasets and two face recognition datasets to demonstrate their performances. The results show that in term of testing accuracy, MBT-SVM is comparable with one-against-one SVM (OAO-SVM), R-OAA-SVM and OAA-SVM and superior to SBT-SVM. In term of testing time, MBT-SVM is superior to OAO-SVM, binary tree of SVM (BTS), R-OAA-SVM and OAA-SVM and slightly longer than SBT-SVM. In term of training time, MBT-SVM is superior to BTS, R-OAA-SVM and OAA-SVM and comparable with SBT-SVM. For the datasets with smaller class number and training sample number, the training time of MBT-SVM is comparable with that of OAO-SVM. For the datasets with larger class number or training sample number, in most cases, the training time of MBT-SVM is longer than that of OAO-SVM.

Study on GA-based SVM multi-class classification decision-tree optimization algorithm

Improved support vector machine for multi-class classification problems

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Study on a GA-based SVM Decision-tree Multi-Classification Strategy

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

SVMdecision-tree multi-classification strategy based on genetic algorithm with cumulative fitness

A new improved support vector machine: QGA-SVM

A New Algorithm for Designing SVM with Decision Tree Architecture

An Optimized Multi-class Classification Algorithm Based on SVM Decision Tree

Novel Design of Decision-Tree-Based Support Vector Machines Multi-Class Classifier

Multi-class Support Vector Machine for Fault Diagnosis

Decision Tree Support Vector Machine Based on Genetic Algorithm for Multi-Class Classification

A Method to Optimize Classifiers by Using Genetic Algorithms

Solution and Application of GA for Object-Oriented Multi-Optimization

An Improved Binary Tree SVM for Multi-Classification

SVM Parameter Optimization using Grid Search and Genetic Algorithm to Improve Classification Performance

An Improved Binary Tree SVM Multi-class Classification Algorithm

Simultaneous Feature with Support Vector Selection and Parameters Optimization Using GA-based SVM Solve the Binary Classification

Decision Tree Support Vector Machine Based On Genetic Algorithm For Fault Diagnosis

Parameter Optimization of Support Vector Machine for Classification Using Niche Genetic Algorithm

The One-Against-All Partition Based Binary Tree Support Vector Machine Algorithms for Multi-Class Classification