Abstract:Using binary classification techniques to perform multi-class classification of data is still of great practical interest due to the robustness and simplicity of binary classifiers. These techniques produce a single multi-class classification decision based on many binary decisions. Our work relies on the simple observation that as dimensionality increases so does the data sparsity and, consequently, a single binary classifier may separate multiple classes. Therefore, we claim that the number of binary decisions can be significantly reduced. We present Divide and Conquer Support Vector Machines (DCSVM), an efficient algorithm for multi-class classification using Support Vector Machines. DCSVM is a divide and conquer algorithm which relies on data sparsity in high dimensional space and performs a smart partitioning of the whole training data set into disjoint subsets that are easily separable. A single prediction performed between two partitions eliminates at once one or more classes in one partition, leaving only a reduced number of candidate classes for subsequent steps. The algorithm continues recursively, reducing the number of classes at each step, until a final binary decision is made between the last two classes left in the competition. In the best case scenario, our algorithm makes a final decision between k classes in (O(log k)) decision steps and in the worst case scenario DCSVM makes a final decision in (k{-}1) steps, which is not worse than the existent techniques.

Multi-Class SVM Classifier Based on Pairwise Coupling

Face Recognition Using Improved Pairwise Coupling Support Vector Machines

Pairwise Coupling Support Vector Machine and Its Application on Handwritten Digital Recognition

Preprocess Method of Pairwise Coupling Based on Multi-Spheres

A Multi-Class Large Margin Classifier

Fast recognition of handwritten digital using pairwise coupling support vector machine

Image Classification Method by Combining Multi-features and Sparse Coding

Product Images Classification with Mul-tiple Features Combination

Multivariate time series classification based on μσ-DWC feature and tree-structured M-SVM

Novel One-Vs-rest Classifier Based on SVM and Multi-Spheres

Multi-sphere Classification Algorithm Based on 1-SVM

A Coupled Similarity Kernel for Pairwise Support Vector Machine

Pairwise Classifier Combination and Its Application on Chinese Character Recognition

Two-stage sparse multi-kernel optimization classifier method for more accurate and explainable prediction

An adaptive feature fusion framework for multi-class classification based on SVM

Within-class Penalty Based Multi-Class Support Vector Machine.

Multi-View Scaling Support Vector Machines for Classification and Feature Selection.

Multi-Classification using One-versus-One Deep Learning Strategy with Joint Probability Estimates

Combined Multi-Kernel Support Vector Machine and Wavelet Analysis for Hyperspectral Remote Sensing Image Classification

DCSVM: fast multi-class classification using support vector machines

Image classification based on support vector machine and the fusion of complementary features