Abstract:Traditional classification algorithms can be limited in their performance on highly imbalanced and overlapping data sets, In this paper, we focus on modifying support vector machines (SVMs) to make it suitable for highly imbalanced and overlapping (HIO) classification. Based on the analysis of most SVM learning algorithms for imbalanced classification, we argue that in SVM-based algorithms, due to the linearity property of SVM, the key problem is that the increase of the number of correctly predicted minority samples will lead to even more majority samples be misclassified. Then a novel algorithm HIO-SVM is developed, it can recognize all minority samples while minimizing the error rate of majority ones. The proposed approach can identify the non-overlapping samples in one feature space, furthermore, by iteratively shifting kernel spaces, all non-overlapping samples in different kernel spaces are recognized. Because of the highly imbalanced distribution, the remaining overlapping samples can be regarded as minority. Then all minority samples can be predicted correctly and the error rate of majority samples can be guaranteed minimized simultaneously. Finally, numerous case studies show the properties and effectiveness of the proposed HIO-SVM algorithm.

Single Sequential Minimal Optimization: an Improved SVMs Training Algorithm

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Fast Training of Support Vector Machines using Sequential Minimal Optimization

Fast training of support vector machines using sequential minimal optimization, advances in kernel methods

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

Fast Training Support Vector Machines Using Parallel Sequential Minimal Optimization

A Sampling-based SMO Algorithm

Sequential minimal optimization for SVM with pinball loss.

A Fast Iterative Single Data Approach to Training Unconstrained Least Squares Support Vector Machines

An Incremental Updating Method for Support Vector Machines

A new improved support vector machine: QGA-SVM

Recursive Training Algorithm for One-Class Support Vector Machine Based on Active Set Method

A New Cache Replacement Algorithm In Smo

An Improved SMO Algorithm Based on Trade-off Strategy

A new strategy for selecting working sets applied in SMO

Improved Conjugate Gradient Implementation for Least Squares Support Vector Machines

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Hierarchical 1-FSVM Algorithm Based on SMO

A Novel Model of Working Set Selection for SMO Decomposition Methods

SVM algorithm with different error costs based on SMO