Abstract:Imbalanced problems have recently attracted much attention due to their prevalence in numerous domains of great importance to the data mining community. However, conventional bi-class classification approaches, e.g., Support vector machine (SVM), generally perform poorly on imbalanced datasets as they are originally designed to generalize from the training data, and pay little attention to the minority class. In the paper, we extend traditional support vector domain description (SVDD) and propose a novel density-sensitive SVDD classifier based on maximum soft margin (DSMSM-SVDD) for imbalanced datasets. In the proposed approach, the relative density-based penalty weights are incorporated into the optimization objective function to represent the importance of the data samples. Through optimizing the objective function with the relative density-based penalty weights, the training majority samples with high relative densities are more likely to lie inside the hypersphere, thus eliminating noise effects on traditional SVDD. In addition, to make full use of the minority class samples to refine the boundary in training, the maximum soft margin regularization term is also introduced in the proposed technique inspired by the idea of maximizing soft margin of traditional SVM. This method allows the optimal domain description boundary to more skew toward the minority class than traditional SVDD and thus improves the classification accuracy. Eventually, AdaBoost ensemble version of DSMSM-SVDD is developed so as to further improve the generalization performance and stability in dealing with imbalanced datasets. The extensive experimental results on various datasets demonstrate that the proposed approach significantly outperforms other existing algorithms when dealing with the imbalanced classification problems in terms of G-Mean, F-Measure and AUC performance measures.

An Improved Diverse Density Algorithm for Multiple Overlapped Instances

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Instance-Ranking: A New Perspective to Consider the Instance Dependency for Classification

EM-DD: an Improved Multiple-Instance Learning Technique

Object Oriented High Resolution Remote Sensing Image Classification Based on Multiple Instance Learning

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

Class-imbalanced positive instances augmentation via three-line hybrid

A Density-based Under-sampling Algorithm for Imbalance Classification

Greedy Multiple Instance Learning via Codebook Learning and Nearest Neighbor Voting

A New Multiple Instance Algorithm Using Structural Information.

A bag-to-class divergence approach to multiple-instance learning

Diversified Dictionaries for Multi-Instance Learning

Handling Class Imbalance and Overlap with a Hesitation-based Instance Selection Method

Multiple Instance Tracking Based on Hierarchical Maximizing Bag's Margin Boosting

SNN-PDM: An Improved Probability Density Machine Algorithm Based on Shared Nearest Neighbors Clustering Technique

Multiple instance learning from similarity-confidence bags

The Ensemble of Density-Sensitive SVDD Classifier Based on Maximum Soft Margin for Imbalanced Datasets.

A hybrid sampling method for highly imbalanced and overlapped data classification with complex distribution

Non-I.I.D. Multi-Instance Dimensionality Reduction by Learning a Maximum Bag Margin Subspace

Density peaks clustering algorithm based on improved similarity and allocation strategy

Solving the Multi-Instance Problem with Neural Networks