Abstract:Heterogeneous ensembles that can aggregate an unrestricted number and variety of base predictors can effectively address challenging prediction problems. In particular, accurate ensembles that are also parsimonious, i.e., consist of as few base predictors as possible, can help reveal potentially useful knowledge about the target problem domain. Although ensemble selection offers a potential approach to achieving these goals, the currently available algorithms are limited in their abilities. In this paper, we present several algorithms that incorporate ensemble diversity into a reinforcement learning (RL)-based ensemble selection framework to build accurate and parsimonious ensembles. These algorithms, as well as several baselines, are rigorously evaluated on datasets from diverse domains in terms of the predictive performance and parsimony of their ensembles. This evaluation demonstrates that our diversity-incorporated RL-based algorithms perform better than the others for constructing simultaneously accurate and parsimonious ensembles. These algorithms can eventually aid the interpretation or reverse engineering of predictive models assimilated into effective ensembles. To enable such a translation, an implementation of these algorithms, as well the experimental setup they are evaluated in, has been made available at <a class="link-external link-https" href="https://github.com/GauravPandeyLab/lens-learning-ensembles-using-reinforcement-learning" rel="external noopener nofollow">this https URL</a>.

PBIL ensemble: Many better than one

Genetic Ensemble of Extreme Learning Machine

Using ensemble method to improve the performance of genetic algorithm

Ensembling Neural Networks: Many Could Be Better Than All

Ensemble Strategy Learning for Imperfect Information Games

Ensemble of differential evolution and gaining–sharing knowledge with exchange of individuals chosen based on fitness and lifetime

A Double Penalty Model for Ensemble Learning

Pareto Ensemble Pruning

An Ensemble Algorithm with Self-Adaptive Learning Techniques for High-Dimensional Numerical Optimization

Dual Population-Based Incremental Learning for Problem Optimization in Dynamic Environments

Bagging and Boosting Fine-tuning for Ensemble Learning

An ensemble bat algorithm for large-scale optimization

A Parallelizable Bayesian Ensemble Online Learning Algorithm

Ensemble Algorithm Of Neural Networks And Its Application

Instance-Based Ensemble Selection Using Deep Reinforcement Learning

Developing parsimonious ensembles using ensemble diversity within a reinforcement learning framework

Developing parsimonious ensembles using predictor diversity within a reinforcement learning framework

BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learning

Evolutionary bagging for ensemble learning

A Novel Surrogate-assisted Evolutionary Algorithm Applied to Partition-based Ensemble Learning

Network game and boosting