Abstract:In the class imbalanced learning scenario, traditional machine learning algorithms focusing on optimizing the overall accuracy tend to achieve poor classification performance especially for the minority class in which we are most interested. To solve this problem, many effective approaches have been proposed. Among them, the bagging ensemble methods with integration of the under-sampling techniques have demonstrated better performance than some other ones including the bagging ensemble methods integrated with the over-sampling techniques, the cost-sensitive methods, etc. Although these under-sampling techniques promote the diversity among the generated base classifiers with the help of random partition or sampling for the majority class, they do not take any measure to ensure the individual classification performance, consequently affecting the achievability of better ensemble performance. On the other hand, evolutionary under-sampling EUS as a novel undersampling technique has been successfully applied in searching for the best majority class subset for training a good-performance nearest neighbor classifier. Inspired by EUS, in this paper, we try to introduce it into the under-sampling bagging framework and propose an EUS based bagging ensemble method EUS-Bag by designing a new fitness function considering three factors to make EUS better suited to the framework. With our fitness function, EUS-Bag could generate a set of accurate and diverse base classifiers. To verify the effectiveness of EUS-Bag, we conduct a series of comparison experiments on 22 two-class imbalanced classification problems. Experimental results measured using recall, geometric mean and AUC all demonstrate its superior performance.

Semi-Supervised Learning Classifier System Based on Bayes

Learning classifier system using both labeled and unlabeled data.

Neural-Based Learning Classifier Systems

SSXCS:Semi-supervised learning classifier system

Dual-Classifier Collaborative Method Based on Semi-Supervised Active Learning

Learning Classifier System Ensemble for Data Mining

Joint Semi-Supervised Feature Selection and Classification Through Bayesian Approach

One of semi-supervised classification algorithm named Co-S3OM based on cooperative training

An enhanced EM method of semi-supervised classification based on Naive Bayesian

Transfer of Semi-Supervised Broad Learning System in Electroencephalography Signal Classification

Evolutionary Under-Sampling Based Bagging Ensemble Method for Imbalanced Data Classification.

Bayesian Semi-supervised Multi-category Classification under Nonparanormality

A semi-supervised hierarchical classifier based on local information

Semi-supervised Classification Based on Clustering Adjusted Similarity

Semi-supervised learning with Bayesian Confidence Propagation Neural Network

Semi-Supervised Learning: Exploiting Unlabeled Data with Symmetrical Distribution and High Confidence

A Robust Semi-Supervised Broad Learning System Guided by Ensemble-Based Self-Training

A Cluster-Based Semisupervised Ensemble for Multiclass Classification.

Semi-supervised Learning for K-Dependence Bayesian Classifiers

Scalable Graph-Based Semi-Supervised Learning Through Sparse Bayesian Model.

A Classification Method Based on Self-Adaptive Artificial Bee Colony