Abstract:Traditional ensemble learning approaches explore the feature space and the sample space, respectively, which will prevent them to construct more powerful learning models for noisy real-world dataset classification. The random subspace method only search for the selection of features. Meanwhile, the bagging approach only search for the selection of samples. To overcome these limitations, we propose the hybrid incremental ensemble learning (HIEL) approach which takes into consideration the feature space and the sample space simultaneously to handle noisy dataset. Specifically, HIEL first adopts the bagging technique and linear discriminant analysis to remove noisy attributes, and generates a set of bootstraps and the corresponding ensemble members in the subspaces. Then, the classifiers are selected incrementally based on a classifier-specific criterion function and an ensemble criterion function. The corresponding weights for the classifiers are assigned during the same process. Finally, the final label is summarized by a weighted voting scheme, which serves as the final result of the classification. We also explore various classifier-specific criterion functions based on different newly proposed similarity measures, which will alleviate the effect of noisy samples on the distance functions. In addition, the computational cost of HIEL is analyzed theoretically. A set of nonparametric tests are adopted to compare HIEL and other algorithms over several datasets. The experiment results show that HIEL performs well on the noisy datasets. HIEL outperforms most of the compared classifier ensemble methods on 14 out of 24 noisy real-world UCI and KEEL datasets.

Incremental Classification Method Based on Ensemble

An ensemble learning method based on Bagging-SVM for intelligent sensor

Microcluster-Based Incremental Ensemble Learning for Noisy, Nonstationary Data Streams

Dynamic Weighting Ensembles for Incremental Learning

Incremental Learning of Support Vector Machines by Classifier Combining

Selective Bagging Based Incremental Learning

Incremental learning based on ensemble pruning.

An Incremental Network with Local Experts Ensemble.

An Incremental Learning Ensemble Method for Imbalanced Credit Scoring.

Learning a Dual-Branch Classifier for Class Incremental Learning

Hybrid Incremental Ensemble Learning for Noisy Real-World Data Classification.

Learning to Classify With Incremental New Class

Learning Classifier System Ensemble and Compact Rule Set

Incremental Learning Imbalanced Data Streams with Concept Drift: the Dynamic Updated Ensemble Algorithm

Study of Ensemble Algorithm and Its Application

Ensemble Learning Method for Classification: Integrating Data Envelopment Analysis with Machine Learning

A New Semi-Supervised Learning Based Ensemble Classifier For Recurring Data Stream

Incremental Weighted Ensemble for Data Streams With Concept Drift.

Life-long Learning Based on Dynamic Combination Model

Research on Incremental Learning Algorithm with Multiple Support Vector Machine Classifiers

Dynamic Incremental SVM Learning Algorithm for Mining Data Streams