Abstract:In matters of great importance that have financial, medical, social, or other implications, we often seek a second opinion before making a decision, sometimes a third, and sometimes many more. In doing so, we weigh the individual opinions, and combine them through some thought process to reach a final decision that is presumably the most informed one. The process of consulting "several experts" before making a final decision is perhaps second nature to us; yet, the extensive benefits of such a process in automated decision making applications have only recently been discovered by computational intelligence community. Also known under various other names, such as multiple classifier systems, committee of classifiers, or mixture of experts, ensemble based systems have shown to produce favorable results compared to those of single-expert systems for a broad range of applications and under a variety of scenarios. Design, implementation and application of such systems are the main topics of this article. Specifically, this paper reviews conditions under which ensemble based systems may be more beneficial than their single classifier counterparts, algorithms for generating individual components of the ensemble systems, and various procedures through which the individual classifiers can be combined. We discuss popular ensemble based algorithms, such as bagging, boosting, AdaBoost, stacked generalization, and hierarchical mixture of experts; as well as commonly used combination rules, including algebraic combination of outputs, voting based techniques, behavior knowledge space, and decision templates. Finally, we look at current and future research directions for novel applications of ensemble systems. Such applications include incremental learning, data fusion, feature selection, learning with missing features, confidence estimation, and error correcting output codes; all areas in which ensemble systems have shown great promise

A survey of multiple classifier systems as hybrid systems

Multiple Classifier System for Remote Sensing Image Classification: A Review

A Multi-Class Large Margin Classifier

Design of a multiple classifier system

A sentiment classification model based on multiple classifiers

Rotation-Based Ensemble Classifiers For High-Dimensional Data

AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systems

Process monitoring for quality - A multiple classifier system for highly unbalanced data

Hybrid approaches to optimization and machine learning methods: a systematic literature review

Combining classifiers with particle swarms

MFA-DMFS:new Multi-Classifier Fusion Method and Its Application

Assessment of Multiple-Biomarker Classifiers: fundamental principles and a proposed strategy

Multiple Classifier Combination for Hyperspectral Remote Sensing Image Classification

Design of a new classifier simulator

Multi-Class SVM Classifier Based on Pairwise Coupling

Key Techniques and Implementation of Multiple Classifier System for Remote Sensing Images

Ensemble based systems in decision making

CSMOUTE: Combined Synthetic Oversampling and Undersampling Technique for Imbalanced Data Classification

Modular Design Patterns for Hybrid Learning and Reasoning Systems: a taxonomy, patterns and use cases

A Hybrid Approach To News Video Classification With Multi-Modal Features

MRF-Based Multiple Classifier System for Hyperspectral Remote Sensing Image Classification.