Abstract:Classifier combination is used in object classification to combine the strength of multiple complementary classifiers and yield better performance than any single classifier. While various optimization-based combination methods have been presented in literature, their real effectiveness in practice has been called in question. This prompts us to investigate the behavior of classifiers in combination with the simple average combination method. Specifically, we investigate the influence of some issues on average classifier combination performance with extensive experiments on four diverse datasets. As a result, we find that the behavior of features and kernel functions in feature combination, and of soft labels and classifiers in classifier fusion, can be elegantly explained in the framework of the kNN method in instance-based learning. This framework shows that by proper selection of features, kernel functions, soft labels and classifiers, an enhanced average combination is able to perform much better than the average combination of all features, kernel functions, soft labels and classifiers. Furthermore, this framework gives rise to the descending combination performance curve (DCPC) as a new performance evaluation criterion of combination methods. Unlike the ordinary criterion of comparing only the final classification rate, DCPC also captures the ability of combination methods to combine the strength and avoid the drawbacks of multiple classifiers.

On The Use of Nonparametric Neighborhood Classification Rules in Multiple Classifier Combination

Combination of Heterogeneous Multiple Classifiers Based on Evidence Theory

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Multiple Classifiers Fusion Based On Weighted Evidence Combination

Multiple K-Nn Classifiers Fusion Based on Evidence Theory

Multiple Classifiers Combination Based on Specialists' FIelds

Combining Multiple K-Nearest Neighbor Classifiers Using Different Distance Functions

Multi-hypothesis nearest-neighbor classifier based on class-conditional weighted distance metric.

Combination of Multiple Nearest Neighbor Classifiers Based on Feature Subset Clustering Method

Decision by Maximum of Posterior Probability Average with Weights: a Method of Multiple Classifiers Combination

Multi-Class Svm Classifiers Fusion Based On Evidence Combination

Evaluating Classifier Combination in Object Classification

Combination of Multiple Classifier Using Feature Space Partitioning

Multiple Classifier Combination for Hyperspectral Remote Sensing Image Classification

A Novel Multi-Source Classification Approach Based on Evidence Combination

Combining KNN algorithm and other classifiers.

A New Multiple Classifiers Combination Algorithm

Linear Regression Based Combination of Neural Classifiers.

Feature Combination and the kNN Framework in Object Classification

Using Correspondence Analysis to Combine Classifiers

Combination Of Multiple Real-Valued Nearest Neighbor Classifiers Based On Different Feature Subsets With Fuzzy Integral