Abstract:Classifier combination is used in object classification to combine the strength of multiple complementary classifiers and yield better performance than any single classifier. While various optimization-based combination methods have been presented in literature, their real effectiveness in practice has been called in question. This prompts us to investigate the behavior of classifiers in combination with the simple average combination method. Specifically, we investigate the influence of some issues on average classifier combination performance with extensive experiments on four diverse datasets. As a result, we find that the behavior of features and kernel functions in feature combination, and of soft labels and classifiers in classifier fusion, can be elegantly explained in the framework of the kNN method in instance-based learning. This framework shows that by proper selection of features, kernel functions, soft labels and classifiers, an enhanced average combination is able to perform much better than the average combination of all features, kernel functions, soft labels and classifiers. Furthermore, this framework gives rise to the descending combination performance curve (DCPC) as a new performance evaluation criterion of combination methods. Unlike the ordinary criterion of comparing only the final classification rate, DCPC also captures the ability of combination methods to combine the strength and avoid the drawbacks of multiple classifiers.

A New Multiple Classifiers Combination Algorithm

Decision by Maximum of Posterior Probability Average with Weights: a Method of Multiple Classifiers Combination

Research and application of universal combination rule of multiple classifiers system

Multiple Classifiers Combination Based on Specialists' FIelds

New Model of Combining Multiple Classifiers

Multiple Decision Template Classifier Combination

Multiple Classifiers Combination by Clustering and Selection.

Optimal Linear Combination Using Decision Reliability Of Individual Classifiers

Combining classifiers with particle swarms

A New Kind of Combination Classifier and Its Application in Classification of Remote Sensing Image

Evaluating Classifier Combination in Object Classification

A Multiple Classifiers Integration Method Based on Adaptive Weigh Adjusting and it's Application on Text Classification

Combination of Multiple Classifier Using Feature Space Partitioning

Multiple Classifiers Fusion Based On Weighted Evidence Combination

Classifier Simulation Algorithm and Its Applications

A Comparison of Multiple Classifier Combinations Using Different Voting-Weights for Remote Sensing Image Classification

Combining Classifiers Based on Complex Network

Combination of Heterogeneous Multiple Classifiers Based on Evidence Theory

A Method of Multiple Classifier Fusion with Self-Adjusting Weights

Combining MLC and SVM Classifiers for Learning Based Decision Making: Analysis and Evaluations.

Decision combination in multiple classifier systems