Abstract:This paper mainly focuses on how to effectively and efficiently measure visual similarity for local feature based representation. Among existing methods, metrics based on Bag of Visual Word (BoV) techniques are efficient and conceptually simple, at the expense of effectiveness. By contrast, kernel based metrics are more effective, but at the cost of greater computational complexity and increased storage requirements. We show that a unified visual matching framework can be developed to encompass both BoV and kernel based metrics, in which local kernel plays an important role between feature pairs or between features and their reconstruction. Generally, local kernels are defined using Euclidean distance or its derivatives, based either explicitly or implicitly on an assumption of Gaussian noise. However, local features such as SIFT and HoG often follow a heavy-tailed distribution which tends to undermine the motivation behind Euclidean metrics. Motivated by recent advances in feature coding techniques, a novel efficient local coding based matching kernel (LCMK) method is proposed. This exploits the manifold structures in Hilbert space derived from local kernels. The proposed method combines advantages of both BoV and kernel based metrics, and achieves a linear computational complexity. This enables efficient and scalable visual matching to be performed on large scale image sets. To evaluate the effectiveness of the proposed LCMK method, we conduct extensive experiments with widely used benchmark datasets, including 15-Scenes, Caltech101/256, PASCAL VOC 2007 and 2011 datasets. Experimental results confirm the effectiveness of the relatively efficient LCMK method.

Efficient match kernel in fine-grained image categorization

Multi-Level Feature Descriptor for Robust Texture Classification via Locality-Constrained Collaborative Strategy

A Pca Based Automatic Image Categorization Approach Using Dominant Color Features

Local coding based matching kernel method for image classification

A Novel Cnn-Based Match Kernel For Image Retrieval

Image Classification with Kernelized Spatial-Context.

Fast Low Rank Representation Based Spatial Pyramid Matching for Image Classification.

The Feature and Spatial Covariant Kernel

Weakly Supervised Multimodal Kernel for Categorizing Aerial Photographs

A joint appearance-spatial distance for kernel-based image categorization

A novel kernel collaborative representation approach for image classification

Dimension Amnesic Pyramid Match Kernel

Discriminative Cellets Discovery for Fine-Grained Image Categories Retrieval

Semantic-Spatial Matching for Image Classification

Learning Kernel for Conditional Moment-Matching Discrepancy-Based Image Classification

Kernel-based Image Classification Using the Context of Visual Words

Object Recognition via Adaptive Multi-level Feature Integration

Optimization-based Multikernel Extreme Learning for Multimodal Object Image Classification

A Fine-Grained Image Categorization System by Cellet-Encoded Spatial Pyramid Modeling

Improving feature matching strategies for efficient image retrieval

Linear spatial pyramid matching using sparse coding for image classification