Abstract:Imbalanced problems have recently attracted much attention due to their prevalence in numerous domains of great importance to the data mining community. However, conventional bi-class classification approaches, e.g., Support vector machine (SVM), generally perform poorly on imbalanced datasets as they are originally designed to generalize from the training data, and pay little attention to the minority class. In the paper, we extend traditional support vector domain description (SVDD) and propose a novel density-sensitive SVDD classifier based on maximum soft margin (DSMSM-SVDD) for imbalanced datasets. In the proposed approach, the relative density-based penalty weights are incorporated into the optimization objective function to represent the importance of the data samples. Through optimizing the objective function with the relative density-based penalty weights, the training majority samples with high relative densities are more likely to lie inside the hypersphere, thus eliminating noise effects on traditional SVDD. In addition, to make full use of the minority class samples to refine the boundary in training, the maximum soft margin regularization term is also introduced in the proposed technique inspired by the idea of maximizing soft margin of traditional SVM. This method allows the optimal domain description boundary to more skew toward the minority class than traditional SVDD and thus improves the classification accuracy. Eventually, AdaBoost ensemble version of DSMSM-SVDD is developed so as to further improve the generalization performance and stability in dealing with imbalanced datasets. The extensive experimental results on various datasets demonstrate that the proposed approach significantly outperforms other existing algorithms when dealing with the imbalanced classification problems in terms of G-Mean, F-Measure and AUC performance measures.

Density-convoluted Tensor Support Vector Machines

A Multi-Class Large Margin Classifier

CTSVM: A robust twin support vector machine with correntropy-induced loss function for binary classification problems

Multiple Rank Multi-Linear SVM for Matrix Data Classification.

Multiscale Symmetric Dense Micro-Block Difference for Texture Classification

Multi-task Nonparallel Support Vector Machine for Classification

The Ensemble of Density-Sensitive SVDD Classifier Based on Maximum Soft Margin for Imbalanced Datasets.

Density-Dependent Quantized Least Squares Support Vector Machine for Large Data Sets.

Support Multimode Tensor Machine for Multiple Classification on Industrial Big Data

Weighted least squares twin support vector machine based on density peaks

Kernelized Support Tensor Train Machines

A tensor factorization based least squares support tensor machine for classification

Double Discrete Cosine Transform-Oriented Multi-View Subspace Clustering

CappedL1-norm Distance Metric-Based Fast Robust Twin Bounded Support Vector Machine

A Low-Rank Approximation-Based Transductive Support Tensor Machine for Semisupervised Classification

A coordinate descent margin based-twin support vector machine for classification.

A Tensor-Variate Gaussian Process for Classification of Multidimensional Structured Data

Weighted Mahalanobis Distance Kernels for Support Vector Machines

Maximum Margin of Twin Spheres Support Vector Machine for Imbalanced Data Classification

Density Estimation Based on Support Vector Machines

General Scaled Support Vector Machines