Abstract:In matters of great importance that have financial, medical, social, or other implications, we often seek a second opinion before making a decision, sometimes a third, and sometimes many more. In doing so, we weigh the individual opinions, and combine them through some thought process to reach a final decision that is presumably the most informed one. The process of consulting "several experts" before making a final decision is perhaps second nature to us; yet, the extensive benefits of such a process in automated decision making applications have only recently been discovered by computational intelligence community. Also known under various other names, such as multiple classifier systems, committee of classifiers, or mixture of experts, ensemble based systems have shown to produce favorable results compared to those of single-expert systems for a broad range of applications and under a variety of scenarios. Design, implementation and application of such systems are the main topics of this article. Specifically, this paper reviews conditions under which ensemble based systems may be more beneficial than their single classifier counterparts, algorithms for generating individual components of the ensemble systems, and various procedures through which the individual classifiers can be combined. We discuss popular ensemble based algorithms, such as bagging, boosting, AdaBoost, stacked generalization, and hierarchical mixture of experts; as well as commonly used combination rules, including algebraic combination of outputs, voting based techniques, behavior knowledge space, and decision templates. Finally, we look at current and future research directions for novel applications of ensemble systems. Such applications include incremental learning, data fusion, feature selection, learning with missing features, confidence estimation, and error correcting output codes; all areas in which ensemble systems have shown great promise

Taxonomy for characterizing ensemble methods in classification tasks: A review and annotated bibliography

Ensemble Classification and Regression-Recent Developments, Applications and Future Directions [review Article]

Ensemble learning: A survey

Ensemble Methods: Foundations and Algorithms

Ensemble based systems in decision making

Surveying the Landscape of Image Captioning Evaluation: A Comprehensive Taxonomy and Novel Ensemble Method

Automatic Bottom-Up Taxonomy Construction: A Software Application Domain Study

Credit Scoring Models Using Ensemble Learning and Classification Approaches: A Comprehensive Survey

A Survey of Selective Ensemble Learning Algorithms

A practical tutorial on bagging and boosting based ensembles for machine learning: Algorithms, software tools, performance study, practical perspectives and opportunities

A Survey of Ensemble Learning: Concepts, Algorithms, Applications, and Prospects

A New Rotation Forest Ensemble Algorithm

Early Classification of Time Series: Taxonomy and Benchmark

Performance assessment of ensemble learning systems in financial data classification

Ensemble of feature sets and classification algorithms for sentiment classification

Ensemble Learning Techniques and its Efficiency in Machine Learning: A Survey

A Comprehensive Survey of Text Classification Techniques and Their Research Applications: Observational and Experimental Insights

Notes on hierarchical ensemble methods for DAG-structured taxonomies

Less Is More: A Comprehensive Framework for the Number of Components of Ensemble Classifiers

An Empirical Study of Using an Ensemble Model in E-Commerce Taxonomy Classification Challenge.