Abstract:Decision tree algorithms have been proved to be a powerful and popular approach in classification tasks. However, they do not have reasonable classification performance in multi-class scenarios. In the present study, decision tree algorithms are combined with the one-vs-all (OVA) binarization technique to improve the generalization capabilities of the scheme. However, unlike previous literature that has focused on aggregation strategies, the present study is focused on the process of building base classifiers over the OVA scheme. A novel split criterion, entitled by the splitting point correction matrix (SPCM), is proposed in this regards, which can effectively deal with the unbalance problem caused by the OVA scheme. The SPCM is a kind of hybrid scheme, which integrates distribution and permutation information from the training data at each splitting point. Therefore, compared to other classical split criteria, such as the C4.5, the proposed method can make the right choice about the optimal splitting point at the root or internal nodes from multi-angle. In order to evaluate the effectiveness of the SPCM approach, extensive experiments are carried out compared to the classical and state-of-the-art methods. The experiments are performed on sixteen datasets, where the effectiveness and the accuracy of the proposed method is verified. It is concluded that the SPCM method not only has excellent classification performance but also produces a more compact decision tree. Moreover, it is found that the SPCM method has especially a considerable improvement in the depth of tree. (C) 2020 Elsevier B.V. All rights reserved.

Decision Tree Support Vector Machine Based on Genetic Algorithm for Multi-Class Classification

Decision Tree Support Vector Machine Based On Genetic Algorithm For Fault Diagnosis

Multi-class Support Vector Machine for Fault Diagnosis

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Improved support vector machine for multi-class classification problems

The Best Separating Decision Tree Twin Support Vector Machine for Multi-Class Classification.

Novel Design of Decision-Tree-Based Support Vector Machines Multi-Class Classifier

Multivariate time series classification based on μσ-DWC feature and tree-structured M-SVM

Support Vector Machine Algorithm Based on Kernel Hierarchical Clustering for Multiclass Classification

Multiclass Cancer Classification by Using Fuzzy Support Vector Machine and Binary Decision Tree with Gene Selection

Multi-class fault diagnosis based on support vector machines with sequenced binary tree archtecture

2PTMC Classification Algorithm Based on Support Vector Machines and Its Application to Fault Diagnosis

Nsvm Decision Tree for Multi-Class Classification

A New Multi-class Classification Based on Non-linear SVM and Decision Tree

Improved DDAGSVM Multi-Class Classification

An Optimized Multi-class Classification Algorithm Based on SVM Decision Tree

Multi-class Support Vector Machine Based on Directed Acyclic Graph

A Hybrid Scheme-Based One-Vs-all Decision Trees for Multi-Class Classification Tasks

Study on a GA-based SVM Decision-tree Multi-Classification Strategy

Support Vector Machine Based on Optimal Decision Tree and Use in Fault Diagnosis

Multi-class Classifier of Non-Linear SVM Decision Tree