Abstract:Imbalanced data classification poses a major challenge in data mining community. Although standard support vector machine can generally show relatively robust performance in dealing with the classification problems of imbalanced data set, it is a typical overall accuracy-oriented algorithm which results in the final decision boundary biasing toward the majority class. Some ensemble methods have emerged as meta-techniques for improving the generalization performance of existing learning algorithms. In this paper, we propose a novel self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification. In the proposed approach, to guarantee the consistency of optimization objectives between weak learners and boosting scheme, we not only apply cost-sensitive SVMs as basic weak leaner but also simultaneously modify the standard boosting scheme to cost-sensitive ones. In order to ensure more training minority instances for successive classifiers, especially borderline minority instances, we also present a self-adaptive sequential misclassification cost weights determination method. The method can self-adaptively consider the different contribution of minority instances to the form of SVM classifiers at each iteration based on the preceding obtained classifier during boosting, which can allow it to produce diverse classifiers and thus improve its generalization performance. In the experiments, we analyze and discuss the effect of different parameters on the performance and some suggestions are also provided. The extensive experimental results on the different imbalanced datasets demonstrate that the proposed approach can achieve better generalization performance in terms of G-Mean and F-Measure as compared to the other existing imbalanced dataset classification techniques.

Constructing effective SVM ensembles for image classification

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

An ensemble learning method based on Bagging-SVM for intelligent sensor

A Type-2 Fuzzy Logic Ensemble SVM Classifier Based on Feature Weighting

Constructing Support Vector Machine Ensembles for Cancer Classification Based on Proteomic Profiling

A Multi-Class Large Margin Classifier

Novel One-Vs-rest Classifier Based on SVM and Multi-Spheres

Designing Ensemble Learning Algorithms Using Kernel Methods

Semisupervised SVM Batch Mode Active Learning with Applications to Image Retrieval

SVM and SVM Ensembles in Breast Cancer Prediction

Probabilistic SVM classifier ensemble selection based on GMDH-type neural network

Ensemble Learning with Advanced Fast Image Filtering Features for Semi-Global Matching

From Kernel Machines to Ensemble Learning

Automatic image annotation by incorporating feature hierarchy and boosting to scale up SVM classifiers.

Rotation-Based Support Vector Machine Ensemble in Classification of Hyperspectral Data with Limited Training Samples

EnsembleSVM: A Library for Ensemble Learning Using Support Vector Machines

Subspace Ensembles for Classification

Several SVM Ensemble Methods Integrated with Under-Sampling for Imbalanced Data Learning

Boosting Support Vector Machines Successfully.

Self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification

Multiple boosting SVM active learning for image retrieval