Abstract:A support vector machine (SVM) plays a prominent role in classic machine learning, especially classification and regression. Through its structural risk minimization, it has enjoyed a good reputation in effectively reducing overfitting, avoiding dimensional disaster, and not falling into local minima. Nevertheless, existing SVMs do not perform well when facing class imbalance and large-scale samples. Undersampling is a plausible alternative to solve imbalanced problems in some way, but suffers from soaring computational complexity and reduced accuracy because of its enormous iterations and random sampling process. To improve their classification performance in dealing with data imbalance problems, this work proposes a weighted undersampling (WU) scheme for SVM based on space geometry distance, and thus produces an improved algorithm named WU-SVM. In WU-SVM, majority samples are grouped into some subregions (SRs) and assigned different weights according to their Euclidean distance to the hyper plane. The samples in an SR with higher weight have more chance to be sampled and put to use in each learning iteration, so as to retain the data distribution information of original data sets as much as possible. Comprehensive experiments are performed to test WU-SVM via 21 binary-class and six multiclass publically available data sets. The results show that it well outperforms the state-of-the-art methods in terms of three popular metrics for imbalanced classification, i.e., area under the curve, F-Measure, and G-Mean.

μSVM - A new method for solving the problem of imbalanced dataset classification

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Instance Importance Based SVM for Solving Imbalanced Data Classification

Research on Classifying Technique for Imbalanced Dataset Based on Support Vector Machines

An Unbalanced Dataset Classification Approach Based On V-Support Vector Machine

Improved SVM algorithm for imbalanced dataset classification

Hybrid SVM algorithm oriented to classifying imbalanced datasets

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Improving SVM Classification with Imbalance Data Set

The SVM Classifier for Unbalanced Data Based on Combination of RU-Undersample and SMOTE

An Improved SVM Based Under-Sampling Method for Classifying Imbalanced Data

Optimizing the classification accuracy of imbalanced dataset based on SVM

Support Vector Machine based on the sample spatial distance

A New Support Vector Machine Method for Unbalanced Data Treatment

Support Vector Machine for Unbalanced Data Based on Sample Properties Under-Sampling Approaches

An Adaptive Pre-clustering Support Vector Machine for Binary Imbalanced Classification.

A Distance-Based Weighted Undersampling Scheme for Support Vector Machines and Its Application to Imbalanced Classification

A Structural Svm Based Approach for Binary Classification under Class Imbalance

Enhanced SVM-SMOTE with Cluster Consistency for Imbalanced Data Classification.

An incremental sparse LS-SVM classification method for imbalanced data sets

Classification of Imbalanced Hyperspectral Imagery Data Using Support Vector Sampling.