Abstract:Imbalanced data classification poses a major challenge in data mining community. Although standard support vector machine can generally show relatively robust performance in dealing with the classification problems of imbalanced data set, it is a typical overall accuracy-oriented algorithm which results in the final decision boundary biasing toward the majority class. Some ensemble methods have emerged as meta-techniques for improving the generalization performance of existing learning algorithms. In this paper, we propose a novel self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification. In the proposed approach, to guarantee the consistency of optimization objectives between weak learners and boosting scheme, we not only apply cost-sensitive SVMs as basic weak leaner but also simultaneously modify the standard boosting scheme to cost-sensitive ones. In order to ensure more training minority instances for successive classifiers, especially borderline minority instances, we also present a self-adaptive sequential misclassification cost weights determination method. The method can self-adaptively consider the different contribution of minority instances to the form of SVM classifiers at each iteration based on the preceding obtained classifier during boosting, which can allow it to produce diverse classifiers and thus improve its generalization performance. In the experiments, we analyze and discuss the effect of different parameters on the performance and some suggestions are also provided. The extensive experimental results on the different imbalanced datasets demonstrate that the proposed approach can achieve better generalization performance in terms of G-Mean and F-Measure as compared to the other existing imbalanced dataset classification techniques.

Novel Selective Support Vector Machine Ensemble Learning Algorithm

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Clonal selection algorithm based on feature antibodies for feature selection and parameter optimization of support vector machines

A Type-2 Fuzzy Logic Ensemble SVM Classifier Based on Feature Weighting

Probabilistic SVM classifier ensemble selection based on GMDH-type neural network

A hybrid ensemble method with negative correlation learning for regression

Bagging-Based Selective Clusterer Ensemble

Multiple clustering and selecting algorithms with combining strategy for selective clustering ensemble

Self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification

Evolutionary Random Neural Ensembles Based on Negative Correlation Learning

Optimization of Selective Ensemble for Cost-Sensitive Classification: an Empirical Study

Cost Sensitive Support Vector Machines

Selective Ensemble Of Decision Trees

Selective Ensemble under Regularization Framework

Genetic Algorithm based Selective Neural Network Ensemble.

Application of adaptive ensemble algorithm based on correctness and diversity

A selective ensemble learning algorithm for imbalanced dataset

An Efficient Instance Selection Algorithm to Reconstruct Training Set for Support Vector Machine

Solving One-Class Problem with Outlier Examples by Svm