Abstract:Traditional classification algorithms can be limited in their performance on highly imbalanced and overlapping data sets, In this paper, we focus on modifying support vector machines (SVMs) to make it suitable for highly imbalanced and overlapping (HIO) classification. Based on the analysis of most SVM learning algorithms for imbalanced classification, we argue that in SVM-based algorithms, due to the linearity property of SVM, the key problem is that the increase of the number of correctly predicted minority samples will lead to even more majority samples be misclassified. Then a novel algorithm HIO-SVM is developed, it can recognize all minority samples while minimizing the error rate of majority ones. The proposed approach can identify the non-overlapping samples in one feature space, furthermore, by iteratively shifting kernel spaces, all non-overlapping samples in different kernel spaces are recognized. Because of the highly imbalanced distribution, the remaining overlapping samples can be regarded as minority. Then all minority samples can be predicted correctly and the error rate of majority samples can be guaranteed minimized simultaneously. Finally, numerous case studies show the properties and effectiveness of the proposed HIO-SVM algorithm.

An Improved SMO Algorithm Based on Trade-off Strategy

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

A new improved support vector machine: QGA-SVM

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Recursive Training Algorithm for One-Class Support Vector Machine Based on Active Set Method

A Sampling-based SMO Algorithm

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

Single Sequential Minimal Optimization: an Improved SVMs Training Algorithm

An Improved APSO-SQP with Adaptive Transition Strategy for Dynamic Optimization

An Incremental Learning Algorithm Based on Support Vector Domain Classifier

An Incremental Updating Method for Support Vector Machines

Fast Training Support Vector Machines Using Parallel Sequential Minimal Optimization

Fast Training of Support Vector Machines using Sequential Minimal Optimization

Fast training of support vector machines using sequential minimal optimization, advances in kernel methods

A new strategy for selecting working sets applied in SMO

An improved training algorithm for support vector machines

Application of Support Vector Machines to Accelerate the Solution Speed of Metaheuristic Algorithms

On-line Support Vector Machine Training Algorithm and Its Application

SVM algorithm with different error costs based on SMO

Improved Conjugate Gradient Implementation for Least Squares Support Vector Machines

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression