Abstract:This paper mainly focuses on how to effectively and efficiently measure visual similarity for local feature based representation. Among existing methods, metrics based on Bag of Visual Word (BoV) techniques are efficient and conceptually simple, at the expense of effectiveness. By contrast, kernel based metrics are more effective, but at the cost of greater computational complexity and increased storage requirements. We show that a unified visual matching framework can be developed to encompass both BoV and kernel based metrics, in which local kernel plays an important role between feature pairs or between features and their reconstruction. Generally, local kernels are defined using Euclidean distance or its derivatives, based either explicitly or implicitly on an assumption of Gaussian noise. However, local features such as SIFT and HoG often follow a heavy-tailed distribution which tends to undermine the motivation behind Euclidean metrics. Motivated by recent advances in feature coding techniques, a novel efficient local coding based matching kernel (LCMK) method is proposed. This exploits the manifold structures in Hilbert space derived from local kernels. The proposed method combines advantages of both BoV and kernel based metrics, and achieves a linear computational complexity. This enables efficient and scalable visual matching to be performed on large scale image sets. To evaluate the effectiveness of the proposed LCMK method, we conduct extensive experiments with widely used benchmark datasets, including 15-Scenes, Caltech101/256, PASCAL VOC 2007 and 2011 datasets. Experimental results confirm the effectiveness of the relatively efficient LCMK method.

A Novel Locally Linear KNN Method With Applications to Visual Recognition.

A Novel Locally Linear Knn Model For Visual Recognition

Learning a Locality Preserving Subspace for Visual Recognition.

A New Locally Linear KNN Method with an Improved Marginal Fisher Analysis for Image Classification

A Local Mean Representation-based K-Nearest Neighbor Classifier

Local Linear Regression Classifier for Image Recognition

Multi-view Local Linear KNN Classification: Theoretical and Experimental Studies on Image Classification

Novel General KNN Classifier and General Nearest Mean Classifier for Visual Classification

Image Classification Using Local Linear Regression

Rethinking Nearest Neighbors for Visual Classification

Local coding based matching kernel method for image classification

A Novel Pseudo Nearest Neighbor Classification Method Using Local Harmonic Mean Distance

K Nearest Neighbor Based Local Sparse Representation Classifier

An Iterative Locally Linear Embedding Algorithm

Supervised Kernel Optimized Locality Preserving Projection with Its Application to Face Recognition and Palm Biometrics

A Novel Face Recognition Algorithm Via Weighted Kernel Sparse Representation.

A Locality Preserving Approach for Kernel PCA

Efficient Linear Discriminant Analysis with Locality Preserving for Face Recognition

Neighborhood and Graph Constructions using Non-Negative Kernel Regression

Semi-Supervised Nearest Neighbor Discriminant Analysis Using Local Mean For Face Recognition

Face Recognition Using Local Variation