Abstract:Abstract A typical ensemble learning process typically uses a forward integration mechanism to construct the ensemble classifier with a large number of base classifiers. Based on this mechanism, it is difficult to adjust the diversity among base classifiers and optimize the structure inside ensemble since the generation process has a certain amount of randomness, which makes the performance of ensemble classifiers heavily dependent on the human design decisions. To address this issue, we proposed an automatic ensemble classifier construction method based on a dual-layer evolutionary search mechanism, which includes a tree coding-based base classifier population and a binary coding-based ensemble classifier population. Through a collaborative searching process between the two populations, the proposed method can be driven by training data to update the base classifier population and optimize the ensemble classifiers globally. To verify the effectiveness of the dual evolutionary ensemble learning method (DEEL), we tested it on 22 classification tasks from 4 data repositories. The results show that the proposed method can generate a diverse decision tree population on the training data while searching and constructing ensemble classifiers from them. Compared with 9 competitor algorithms, the proposed method achieved the best performance on 17 of 22 test tasks and improved the average accuracies by 0.97–7.65% over the second place. In particular, the generated ensemble classifiers show excellent structure, which involve small number and diverse decision trees. That increases the transparency of ensembles and helps to perform interpretability analysis on them.

Using dual evolutionary search to construct decision tree based ensemble classifier

Differential Evolution with Collective Ensemble Learning

Evolutionary Classifier Ensembles For Semi-Supervised Learning

Adaboost EVOLUTIONARY DECISION TREES BASED ON ENSEMBLE LEARNING

Ensemble Learning Method for Classification: Integrating Data Envelopment Analysis with Machine Learning

Differential Evolution Based Selective Ensemble Of Extreme Learning Machine

Ensemble Classifier Design Based on Perturbation Binary Salp Swarm Algorithm for Classification

Classification by evolutionary ensembles

Dynamic Ensemble of Ensembles in Nonstationary Environments

DE-ELM-SSC+:Semi-supervised Classification Algorithm

Classifier Ensemble Using A Heuristic Learning With Sparsity And Diversity

Structural Diversity for Decision Tree Ensemble Learning

An ensemble learning framework based on group decision making

Ensemble One-class Classifiers Based on Hybrid Diversity Generation and Pruning

Novel Evolutionary Algorithms for Supervised Classification Problems: an Experimental Study

Multi-objective Ensemble Generation

Combining Weak-Link Co-Evolution Binary Artificial Fish Swarm Algorithm and Complementarity Measure for Ensemble Pruning

Generating Diverse and Accurate Classifier Ensembles Using Multi-Objective Optimization

An Ensemble of Classifiers with Genetic Algorithm Based Feature Selection

Interpretability Diversity for Decision-Tree-Initialized Dendritic Neuron Model Ensemble

Integration of Classifier Diversity Measures for Feature Selection-Based Classifier Ensemble Reduction.