Abstract:Classifier combination is used in object classification to combine the strength of multiple complementary classifiers and yield better performance than any single classifier. While various optimization-based combination methods have been presented in literature, their real effectiveness in practice has been called in question. This prompts us to investigate the behavior of classifiers in combination with the simple average combination method. Specifically, we investigate the influence of some issues on average classifier combination performance with extensive experiments on four diverse datasets. As a result, we find that the behavior of features and kernel functions in feature combination, and of soft labels and classifiers in classifier fusion, can be elegantly explained in the framework of the kNN method in instance-based learning. This framework shows that by proper selection of features, kernel functions, soft labels and classifiers, an enhanced average combination is able to perform much better than the average combination of all features, kernel functions, soft labels and classifiers. Furthermore, this framework gives rise to the descending combination performance curve (DCPC) as a new performance evaluation criterion of combination methods. Unlike the ordinary criterion of comparing only the final classification rate, DCPC also captures the ability of combination methods to combine the strength and avoid the drawbacks of multiple classifiers.

Combination of Multiple K-NNCS by Fuzzy Integral

Combination Of Multiple Real-Valued Nearest Neighbor Classifiers Based On Different Feature Subsets With Fuzzy Integral

Combination of Multiple Nearest Neighbor Classifiers Based on Feature Subset Clustering Method

Combining KNN algorithm and other classifiers.

Combining Multiple K-Nearest Neighbor Classifiers Using Different Distance Functions

Multiple Classifiers Combination Based on Specialists' FIelds

Combining Multiple Support Vector Machines Using Fuzzy Integral For Classification

Combining Feature Selection with Feature Weighting for k-NN Classifier

Feature Combination and the kNN Framework in Object Classification

Improving fuzzy k-NN by using genetic algorithm

Improved KNN Algorithm based on Probability and Adaptive K Value.

Multi-functional Nearest-Neighbour Classification

Multiple Layer Classifiers Integration Based on Specialists' Fields

Improving Performance of the k-Nearest Neighbor Classifier by Combining Feature Selection with Feature Weighting.

Research and application of universal combination rule of multiple classifiers system

K-Ns: A Classifier by the Distance to the Nearest Subspace.

k-NN Numeric Prediction Using Bagging and Instance-relevant Combination

Linear Regression Based Combination of Neural Classifiers.

Fusion Classifiers Based on Universal Combination Operation

Evaluating Classifier Combination in Object Classification

On The Use of Nonparametric Neighborhood Classification Rules in Multiple Classifier Combination