Abstract:Imbalanced problems have recently attracted much attention due to their prevalence in numerous domains of great importance to the data mining community. However, conventional bi-class classification approaches, e.g., Support vector machine (SVM), generally perform poorly on imbalanced datasets as they are originally designed to generalize from the training data, and pay little attention to the minority class. In the paper, we extend traditional support vector domain description (SVDD) and propose a novel density-sensitive SVDD classifier based on maximum soft margin (DSMSM-SVDD) for imbalanced datasets. In the proposed approach, the relative density-based penalty weights are incorporated into the optimization objective function to represent the importance of the data samples. Through optimizing the objective function with the relative density-based penalty weights, the training majority samples with high relative densities are more likely to lie inside the hypersphere, thus eliminating noise effects on traditional SVDD. In addition, to make full use of the minority class samples to refine the boundary in training, the maximum soft margin regularization term is also introduced in the proposed technique inspired by the idea of maximizing soft margin of traditional SVM. This method allows the optimal domain description boundary to more skew toward the minority class than traditional SVDD and thus improves the classification accuracy. Eventually, AdaBoost ensemble version of DSMSM-SVDD is developed so as to further improve the generalization performance and stability in dealing with imbalanced datasets. The extensive experimental results on various datasets demonstrate that the proposed approach significantly outperforms other existing algorithms when dealing with the imbalanced classification problems in terms of G-Mean, F-Measure and AUC performance measures.

A New Classifier for Imbalanced Data Based on a Generalized Density Ratio Model

Density-Based Discriminative Nonnegative Representation Model for Imbalanced Classification

Discriminative Density-ratio Estimation

A hybrid imbalanced classification model based on data density

Probability Density Machine: A New Solution of Class Imbalance Learning

A Density-Based Random Forest for Imbalanced Data Classification

2v-SSPC:a new classification method for class-imbalanced data

Estimating the Density Ratio between Distributions with High Discrepancy using Multinomial Logistic Regression

A Density-based Under-sampling Algorithm for Imbalance Classification

Fuzzy Support Vector Machine with Relative Density Information for Classifying Imbalanced Data

LRID: A New Metric of Multi-Class Imbalance Degree Based on Likelihood-Ratio Test

Feature Reduction of Unbalanced Data Classification Based on Density Clustering

A New Sampling Approach for Classification of Imbalanced Data Sets with High Density.

The Ensemble of Density-Sensitive SVDD Classifier Based on Maximum Soft Margin for Imbalanced Datasets.

Density Ratio Peak Clustering

Class Imbalance Oriented Logistic Regression

Adaptive ensemble of classifiers with regularization for imbalanced data classification

Combating the class imbalance problemin sparse representation learning.

Reliability-Based Imbalanced Data Classification with Dempster-Shafer Theory

A measure oriented training scheme for imbalanced classification problems

Cost-Sensitive Large Margin Distribution Machine for Classification of Imbalanced Data