Abstract:Traditional classification algorithms can be limited in their performance on highly imbalanced and overlapping data sets, In this paper, we focus on modifying support vector machines (SVMs) to make it suitable for highly imbalanced and overlapping (HIO) classification. Based on the analysis of most SVM learning algorithms for imbalanced classification, we argue that in SVM-based algorithms, due to the linearity property of SVM, the key problem is that the increase of the number of correctly predicted minority samples will lead to even more majority samples be misclassified. Then a novel algorithm HIO-SVM is developed, it can recognize all minority samples while minimizing the error rate of majority ones. The proposed approach can identify the non-overlapping samples in one feature space, furthermore, by iteratively shifting kernel spaces, all non-overlapping samples in different kernel spaces are recognized. Because of the highly imbalanced distribution, the remaining overlapping samples can be regarded as minority. Then all minority samples can be predicted correctly and the error rate of majority samples can be guaranteed minimized simultaneously. Finally, numerous case studies show the properties and effectiveness of the proposed HIO-SVM algorithm.

A New Support Vector Machine Algorithm with Scalable Penalty Coefficients for Training Samples

A Parallel and Scalable Digital Architecture for Training Support Vector Machines

A Novel Approach to Incremental SVM Learning Algorithm

A Scalable Hardware Implementation of the Support Vector Machine

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Weighted Support Vector Machines for Regression and Its Application

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

A Sampling-based SMO Algorithm

An Incremental Updating Method for Support Vector Machines

A new improved support vector machine: QGA-SVM

M-estimator Based Support Vector Machine and Its Application

Fast Training Support Vector Machines Using Parallel Sequential Minimal Optimization

Single Sequential Minimal Optimization: an Improved SVMs Training Algorithm

A new strategy for selecting working sets applied in SMO

On-line Support Vector Machine Training Algorithm and Its Application

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

A New Cache Replacement Algorithm In Smo

A New Method of Sample Reduction for Support Vector Classification

Application of Support Vector Machines to Accelerate the Solution Speed of Metaheuristic Algorithms

Sequential minimal optimization for SVM with pinball loss.