Abstract:Traditional classification algorithms can be limited in their performance on highly imbalanced and overlapping data sets, In this paper, we focus on modifying support vector machines (SVMs) to make it suitable for highly imbalanced and overlapping (HIO) classification. Based on the analysis of most SVM learning algorithms for imbalanced classification, we argue that in SVM-based algorithms, due to the linearity property of SVM, the key problem is that the increase of the number of correctly predicted minority samples will lead to even more majority samples be misclassified. Then a novel algorithm HIO-SVM is developed, it can recognize all minority samples while minimizing the error rate of majority ones. The proposed approach can identify the non-overlapping samples in one feature space, furthermore, by iteratively shifting kernel spaces, all non-overlapping samples in different kernel spaces are recognized. Because of the highly imbalanced distribution, the remaining overlapping samples can be regarded as minority. Then all minority samples can be predicted correctly and the error rate of majority samples can be guaranteed minimized simultaneously. Finally, numerous case studies show the properties and effectiveness of the proposed HIO-SVM algorithm.

Estimation of the Misclassification Error for Multicategory Support Vector Machine Classification

Weighted Support Vector Machine for Classification with Uneven Training Class Sizes

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

A Multi-Class Large Margin Classifier

M-estimator Based Support Vector Machine and Its Application

SVM-Based Cost-sensitive Classification Algorithm with Error Cost and Class-dependent Reject Cost

Cost Sensitive Support Vector Machines

Estimating the Confidence Interval for Prediction Errors of Support Vector Machine Classifiers

Asymmetric Support Vector Machine For The Classification Problem With Asymmetric Cost Of Misclassification

On support vector machines under a multiple-cost scenario

Logistic Regression with Misclassification in Binary Outcome Variables: a Method and Software

Bayesian Multicategory Support Vector Machines.

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Research and Analysis of Methods for Multiclass Support Vector Machines

Robust Top-k Multiclass SVM for Visual Category Recognition

Multiclass Probabilistic Classification Vector Machine

Chance constrained conic-segmentation support vector machine with uncertain data

Mining Knowledge from Unbalanced Data Based on Ν-Support Vector Machine

Fuzzy Support Vector Machine For Regression Estimation

Probabilistic Classification Vector Machine for Multi-Class Classification

Generalization Performance Analysis of M-SVMs