Abstract:In image classification, feature combination is often used to combine the merits of multiple complementary features and improve the classification accuracy compared with one single feature. Existing feature combination algorithms, e.g., multiple kernel learning, usually determine the weights of features based on the optimization with respect to some classifier-dependent objective function. These algorithms are often computationally expensive, and in some cases are found to perform no better than simple baselines. In this paper, we solve the feature combination problem from a totally different perspective. Our algorithm is based on the simple idea of combining only base kernels suitable to be combined. Since the very aim of feature combination is to obtain the highest possible classification accuracy, we measure the combination suitableness of two base kernels by the maximum possible cross-validation accuracy of their combined kernel. By regarding the pairwise suitableness as the kernel adjacency, we obtain a weighted graph of all base kernels and find that the base kernels suitable to be combined correspond to a cluster in the graph. We then use the dominant sets algorithm to find the cluster and determine the weights of base kernels automatically. In this way, we transform the kernel combination problem into a clustering one. Our algorithm can be implemented in parallel easily and the running time can be adjusted based on available memory to a large extent. In experiments on several data sets, our algorithm generates comparable classification accuracy with the state of the art.

A method of combining multiple probabilistic classifiers through soft competition on different feature sets

On Use of Different Feature Sets for Pattern Classification: an Alternative Method

Methods of Linear Combination Based on Different Features

Methods of Combining Multiple Classifiers with Different Features and Their Applications to Text-Independent Speaker Identification

Combination of Multiple Classifier Using Feature Space Partitioning

Combining Classifiers and Learning Mixture-of-Experts

Decision by Maximum of Posterior Probability Average with Weights: a Method of Multiple Classifiers Combination

Multiple Classifiers Combination Based on Specialists' FIelds

Feature combination using boosting

Feature Combination Via Clustering

Combining Classifiers in Face Recognition

Learning the Classifier Combination for Image Classification

Combining classifiers: A theoretical framework

A New Algorithm for Combining Classifiers Based on Fuzzy Integral and Genetic Algorithms

Linear Regression Based Combination of Neural Classifiers.

Multiple Classifiers Fusion Based On Weighted Evidence Combination

A New Multiple Classifiers Combination Algorithm

Multiple Classifiers Combination by Clustering and Selection.

Evaluating Classifier Combination in Object Classification

Combination of Heterogeneous Multiple Classifiers Based on Evidence Theory

Combining classifiers with particle swarms