Abstract:Imbalanced problems have recently attracted much attention due to their prevalence in numerous domains of great importance to the data mining community. However, conventional bi-class classification approaches, e.g., Support vector machine (SVM), generally perform poorly on imbalanced datasets as they are originally designed to generalize from the training data, and pay little attention to the minority class. In the paper, we extend traditional support vector domain description (SVDD) and propose a novel density-sensitive SVDD classifier based on maximum soft margin (DSMSM-SVDD) for imbalanced datasets. In the proposed approach, the relative density-based penalty weights are incorporated into the optimization objective function to represent the importance of the data samples. Through optimizing the objective function with the relative density-based penalty weights, the training majority samples with high relative densities are more likely to lie inside the hypersphere, thus eliminating noise effects on traditional SVDD. In addition, to make full use of the minority class samples to refine the boundary in training, the maximum soft margin regularization term is also introduced in the proposed technique inspired by the idea of maximizing soft margin of traditional SVM. This method allows the optimal domain description boundary to more skew toward the minority class than traditional SVDD and thus improves the classification accuracy. Eventually, AdaBoost ensemble version of DSMSM-SVDD is developed so as to further improve the generalization performance and stability in dealing with imbalanced datasets. The extensive experimental results on various datasets demonstrate that the proposed approach significantly outperforms other existing algorithms when dealing with the imbalanced classification problems in terms of G-Mean, F-Measure and AUC performance measures.

Several SVM Ensemble Methods Integrated with Under-Sampling for Imbalanced Data Learning

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

Imbalanced Data Classification Algorithm Based on Integrated Sampling and Ensemble Learning.

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Instance Importance Based SVM for Solving Imbalanced Data Classification

Improved SVM algorithm for imbalanced dataset classification

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification

Two-step ensemble under-sampling algorithm for massive imbalanced data classification

The Ensemble of Density-Sensitive SVDD Classifier Based on Maximum Soft Margin for Imbalanced Datasets.

A hybrid ensemble and evolutionary algorithm for imbalanced classification and its application on bioinformatics

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Class Imbalance Problem: A Wrapper-Based Approach using Under-Sampling with Ensemble Learning

Improving SVM Classification with Imbalance Data Set

Under-sampling class imbalanced datasets by combining clustering analysis and instance selection

A hybrid data-level ensemble to enable learning from highly imbalanced dataset

Towards Deeper Insights into Deep Learning from Imbalanced Data.

Entropy‐based hybrid sampling ensemble learning for imbalanced data

Exploratory Undersampling for Class-Imbalance Learning

Boosted Near-miss Under-sampling on SVM ensembles for concept detection in large-scale imbalanced datasets