Abstract:The problem of classifier combination is considered in the context of the two main fusion scenarios: fusion of opinions based on identical and on distinct representations. We develop a theoretical framework for classifier combination for these two scenarios. For multiple experts using distinct representations we argue that many existing schemes such as the product rule, sum rule, min rule, max rule, majority voting, and weighted combination, can be considered as special cases of compound classification. We then consider the effect of classifier combination in the case of multiple experts using a shared representation where the aim of fusion is to obtain a better estimate of the appropriatea posteriori class probabilities. We also show that the two theoretical frameworks can be used for devising fusion strategies when the individual experts use features some of which are shared and the remaining ones distinct. We show that in both cases (distinct and shared representations), the expert fusion involves the computation of a linear or nonlinear function of thea posteriori class probabilities estimated by the individual experts. Classifier combination can therefore be viewed as a multistage classification process whereby thea posteriori class probabilities generated by the individual classifiers are considered as features for a second stage classification scheme. Most importantly, when the linear or nonlinear combination functions are obtained by training, the distinctions between the two scenarios fade away, and one can view classifier fusion in a unified way.

Methods of Linear Combination Based on Different Features

Methods of Combining Multiple Classifiers with Different Features and Their Applications to Text-Independent Speaker Identification

A method of combining multiple probabilistic classifiers through soft competition on different feature sets

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Optimal Linear Combination Using Decision Reliability Of Individual Classifiers

Combination of linear classifiers using score function -- analysis of possible combination strategies

A Type-2 Fuzzy Logic Ensemble SVM Classifier Based on Feature Weighting

Multi-feature Combination for Speaker Recognition

On Use of Different Feature Sets for Pattern Classification: an Alternative Method

On Feature Combination For Music Classification

Linear Regression Based Combination of Neural Classifiers.

Discriminative Combination of Multiple Linear Predictions for Speech Recognition.

A Study of Discriminatory Speech Classification Based on Improved Smote and SVM-RF

Optimal Linear Combination of Classifiers

Combining classifiers: A theoretical framework

Linear and Order Statistics Combiners for Pattern Classification

Combining classifiers with particle swarms

Using Correspondence Analysis to Combine Classifiers

A Hybrid Approach To News Video Classification With Multi-Modal Features

News Video Classification Using Multimodal Classifiers and Text-Biased Combination Strategies

A hybrid variable selection method combining Fisher's linear discriminant combined population analysis and an improved binary cuckoo search algorithm