Abstract:Imbalanced problems have recently attracted much attention due to their prevalence in numerous domains of great importance to the data mining community. However, conventional bi-class classification approaches, e.g., Support vector machine (SVM), generally perform poorly on imbalanced datasets as they are originally designed to generalize from the training data, and pay little attention to the minority class. In the paper, we extend traditional support vector domain description (SVDD) and propose a novel density-sensitive SVDD classifier based on maximum soft margin (DSMSM-SVDD) for imbalanced datasets. In the proposed approach, the relative density-based penalty weights are incorporated into the optimization objective function to represent the importance of the data samples. Through optimizing the objective function with the relative density-based penalty weights, the training majority samples with high relative densities are more likely to lie inside the hypersphere, thus eliminating noise effects on traditional SVDD. In addition, to make full use of the minority class samples to refine the boundary in training, the maximum soft margin regularization term is also introduced in the proposed technique inspired by the idea of maximizing soft margin of traditional SVM. This method allows the optimal domain description boundary to more skew toward the minority class than traditional SVDD and thus improves the classification accuracy. Eventually, AdaBoost ensemble version of DSMSM-SVDD is developed so as to further improve the generalization performance and stability in dealing with imbalanced datasets. The extensive experimental results on various datasets demonstrate that the proposed approach significantly outperforms other existing algorithms when dealing with the imbalanced classification problems in terms of G-Mean, F-Measure and AUC performance measures.

Optimal Combination of SVM and Bayesian Density Model Using Dempster-Shafer Theory

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

A Bayesian Approach to Support Vector Machines for the Binary Classification

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Decision by Maximum of Posterior Probability Average with Weights: a Method of Multiple Classifiers Combination

Optimal Classifier Fusion in a Non-Bayesian Probabilistic Framework

Method of combining multi-class SVMs using dempster-shafer theory and its application

On Combining Distributed SVMs by Simple Bayesian Formalism Rules

Probabilistic SVM classifier ensemble selection based on GMDH-type neural network

Classification algorithm based on Copula theory and Bayesian decision theory

Combining MLC and SVM Classifiers for Learning Based Decision Making: Analysis and Evaluations.

The Ensemble of Density-Sensitive SVDD Classifier Based on Maximum Soft Margin for Imbalanced Datasets.

A Bayesian Approach for Joint Discriminative Dictionary and Classifier Learning

Combination of Heterogeneous Multiple Classifiers Based on Evidence Theory

A Hybrid Method for Learning Multi-Dimensional Bayesian Network Classifiers Based on an Optimization Model

An Algorithm to Combine Classifiers Based on Dempster-Shafer Theory

Svm Classification Based On Supervised Subset Density Clustering

Density-convoluted Tensor Support Vector Machines

Combining Multiple Support Vector Machines Using Fuzzy Integral For Classification

A New Multiple Classifiers Combination Algorithm

Bayesian Classifier Based on D-vine Copula Theory