Abstract:To improve the classification performance of support vector machines (SVMs) on imbalanced datasets, cost-sensitive learning methods have been proposed, e.g., Different Error Costs (DEC) and Fuzzy SVM for Class Imbalance Learning (FSVM-CIL). They relocate the hyperplane by adjusting the costs associated with misclassifying samples. However, the error costs are determined either empirically or by performing an exhaustive search in the parameter space. Both strategies can not guarantee effectiveness and efficiency simultaneously. In this paper, we propose ATEC, a solution that can efficiently find a preferable hyperplane by automatically tuning the error cost for between-class samples. ATEC distinguishes itself from all existing parameter tuning strategies by two main features: (1) it can evaluate how effective an error cost is in terms of classification accuracy; and (2) it changes the error cost in the right direction if it is not effective. Extensive experiments show that compared with the state-of-art methods, SVMs that are equipped with ATEC can not only obtain comparable improvements in terms of F1 score of minority class, area under the precision-recall curve (AUC-PR) and area under the ROC curve (AUC-ROC) scores, but also outperform the grid-search parameter tuning strategy by two orders of magnitude in terms of the training time when a high F1 score is required.

SVM algorithm with different error costs based on SMO

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Weighted Support Vector Machines for Regression and Its Application

An Unbalanced Dataset Classification Approach Based On V-Support Vector Machine

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Optimizing Cost-Sensitive SVM for Imbalanced Data : Connecting Cluster to Classification.

SVM-Based Cost-sensitive Classification Algorithm with Error Cost and Class-dependent Reject Cost

A Fast Training Method for OC-SVM Based on the Random Sampling Lemma

A Sampling-based SMO Algorithm

Expediting the Accuracy-Improving Process of SVMs for Class Imbalance Learning

Single Sequential Minimal Optimization: an Improved SVMs Training Algorithm

SVM-based Cost Sensitive Mining

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Cost Sensitive Support Vector Machines

Improving SVM Classification with Imbalance Data Set

Improved SVM algorithm for imbalanced dataset classification

An Improved SMO Algorithm Based on Trade-off Strategy

Sequential minimal optimization for SVM with pinball loss.

Non-smooth optimization algorithm to solve the LINEX soft support vector machine

A New Weighted Least Squares Support Vector Machines and Its Sequential Minimal Optimization Algorithm

Optimization of C-SVM in case of samples with unequal numbers in their different varieties