Abstract:Imbalanced data classification poses a major challenge in data mining community. Although standard support vector machine can generally show relatively robust performance in dealing with the classification problems of imbalanced data set, it is a typical overall accuracy-oriented algorithm which results in the final decision boundary biasing toward the majority class. Some ensemble methods have emerged as meta-techniques for improving the generalization performance of existing learning algorithms. In this paper, we propose a novel self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification. In the proposed approach, to guarantee the consistency of optimization objectives between weak learners and boosting scheme, we not only apply cost-sensitive SVMs as basic weak leaner but also simultaneously modify the standard boosting scheme to cost-sensitive ones. In order to ensure more training minority instances for successive classifiers, especially borderline minority instances, we also present a self-adaptive sequential misclassification cost weights determination method. The method can self-adaptively consider the different contribution of minority instances to the form of SVM classifiers at each iteration based on the preceding obtained classifier during boosting, which can allow it to produce diverse classifiers and thus improve its generalization performance. In the experiments, we analyze and discuss the effect of different parameters on the performance and some suggestions are also provided. The extensive experimental results on the different imbalanced datasets demonstrate that the proposed approach can achieve better generalization performance in terms of G-Mean and F-Measure as compared to the other existing imbalanced dataset classification techniques.

The Influence of Class Imbalance on Cost-Sensitive Learning: an Empirical Study.

Training cost-sensitive neural networks with methods addressing the class imbalance problem

On Multi-Class Cost-Sensitive Learning

Cost-sensitive hierarchical classification for imbalance classes

A Study on the Effiect of Class Distribution Using Cost-Sensitive Learning

Adaptive Sampling With Optimal Cost For Class-Imbalance Learning

Towards cost-sensitive learning for real-world applications

A study on cost behaviors of binary classification measures in class-imbalanced problems

iCost: A Novel Instance Complexity Based Cost-Sensitive Learning Framework for Imbalanced Classification

Imbalanced Research of Deep Belief Network Based on Dynamic Cost Sensitive

Rethinking Class Imbalance in Machine Learning

Self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification

RUE: A Robust Personalized Cost Assignment Strategy for Class Imbalance Cost-sensitive Learning

iCost: A Novel Instance Complexity Based Cost-Sensitive Learning Framework

Empirical analysis of performance assessment for imbalanced classification

Classes Are Not Equal: An Empirical Study on Image Recognition Fairness

Adaptive cost-sensitive learning: Improving the convergence of intelligent diagnosis models under imbalanced data

Measuring Class-Imbalance Sensitivity of Deterministic Performance Evaluation Metrics

Optimization of Selective Ensemble for Cost-Sensitive Classification: an Empirical Study

A Statistical Approach to Cost-Sensitive AdaBoost for Imbalanced Data Classification

A New Strategy of Cost-Free Learning in the Class Imbalance Problem