Abstract:Imbalanced data classification poses a major challenge in data mining community. Although standard support vector machine can generally show relatively robust performance in dealing with the classification problems of imbalanced data set, it is a typical overall accuracy-oriented algorithm which results in the final decision boundary biasing toward the majority class. Some ensemble methods have emerged as meta-techniques for improving the generalization performance of existing learning algorithms. In this paper, we propose a novel self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification. In the proposed approach, to guarantee the consistency of optimization objectives between weak learners and boosting scheme, we not only apply cost-sensitive SVMs as basic weak leaner but also simultaneously modify the standard boosting scheme to cost-sensitive ones. In order to ensure more training minority instances for successive classifiers, especially borderline minority instances, we also present a self-adaptive sequential misclassification cost weights determination method. The method can self-adaptively consider the different contribution of minority instances to the form of SVM classifiers at each iteration based on the preceding obtained classifier during boosting, which can allow it to produce diverse classifiers and thus improve its generalization performance. In the experiments, we analyze and discuss the effect of different parameters on the performance and some suggestions are also provided. The extensive experimental results on the different imbalanced datasets demonstrate that the proposed approach can achieve better generalization performance in terms of G-Mean and F-Measure as compared to the other existing imbalanced dataset classification techniques.

Asymmetric Support Vector Machine For The Classification Problem With Asymmetric Cost Of Misclassification

Cost Sensitive Support Vector Machines

Weighted Support Vector Machine for Classification with Uneven Training Class Sizes

SVM-Based Cost-sensitive Classification Algorithm with Error Cost and Class-dependent Reject Cost

Asymmetric Least Squares Support Vector Machine Classifiers

On support vector machines under a multiple-cost scenario

SVM-based Cost Sensitive Mining

M-estimator Based Support Vector Machine and Its Application

Asymmetrical support vector machine based on moving optimal separating hyperplane

Adjusted Support Vector Machines Based on a New Loss Function

Hybrid SVM algorithm oriented to classifying imbalanced datasets

Binary Classification Algorithm with Class-Dependent Reject Cost

Self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification

Cost-Sensitive Semi-Supervised Support Vector Machine

An uncertain support vector machine based on soft margin method

Estimation of the Misclassification Error for Multicategory Support Vector Machine Classification

Angle-Based Cost-Sensitive Multicategory Classification

Optimizing Cost-Sensitive SVM for Imbalanced Data : Connecting Cluster to Classification.

Cost-Sensitive Alternating Direction Method Of Multipliers For Large-Scale Classification

Expediting the Accuracy-Improving Process of SVMs for Class Imbalance Learning

CTSVM: A robust twin support vector machine with correntropy-induced loss function for binary classification problems