Abstract:This paper mainly focuses on how to effectively and efficiently measure visual similarity for local feature based representation. Among existing methods, metrics based on Bag of Visual Word (BoV) techniques are efficient and conceptually simple, at the expense of effectiveness. By contrast, kernel based metrics are more effective, but at the cost of greater computational complexity and increased storage requirements. We show that a unified visual matching framework can be developed to encompass both BoV and kernel based metrics, in which local kernel plays an important role between feature pairs or between features and their reconstruction. Generally, local kernels are defined using Euclidean distance or its derivatives, based either explicitly or implicitly on an assumption of Gaussian noise. However, local features such as SIFT and HoG often follow a heavy-tailed distribution which tends to undermine the motivation behind Euclidean metrics. Motivated by recent advances in feature coding techniques, a novel efficient local coding based matching kernel (LCMK) method is proposed. This exploits the manifold structures in Hilbert space derived from local kernels. The proposed method combines advantages of both BoV and kernel based metrics, and achieves a linear computational complexity. This enables efficient and scalable visual matching to be performed on large scale image sets. To evaluate the effectiveness of the proposed LCMK method, we conduct extensive experiments with widely used benchmark datasets, including 15-Scenes, Caltech101/256, PASCAL VOC 2007 and 2011 datasets. Experimental results confirm the effectiveness of the relatively efficient LCMK method.

<Bold>Matching Images More Efficiently With Local Descriptors</Bold>

Matching Images Based on Consistency Graph and Region Adjacency Graphs.

A Local Feature with Multiple Line Descriptors and Its Speeded-Up Matching Algorithm

A Speeded-Up Local Descriptor for dense stereo matching

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

A novel pair-wise image matching strategy with compact descriptors

Image matching based on a local invariant descriptor

Local Invariant Descriptor for Image Matching

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

A Fast Local Stereo Matching Insensitive to Illumination Conditions

An Image Matching Algorithm Based on Improved Rank Transform

Efficient Covisibility-based Image Matching for Large-Scale SfM

Fine-search for image copy detection based on local affine-invariant descriptor and spatial dependent matching

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

Fast and Robust Matching for Multimodal Remote Sensing Image Registration

Robust Image Matching Via Local Graph Structure Consensus

Local Feature Descriptor for Image Matching: A Survey

A Robust Mismatch Removal Method for Image Matching Based on the Fusion of the Local Features and the Depth

Local coding based matching kernel method for image classification

An Image Matching Method Based on Improved DCCD and SIFT Descriptor