Abstract:This paper mainly focuses on how to effectively and efficiently measure visual similarity for local feature based representation. Among existing methods, metrics based on Bag of Visual Word (BoV) techniques are efficient and conceptually simple, at the expense of effectiveness. By contrast, kernel based metrics are more effective, but at the cost of greater computational complexity and increased storage requirements. We show that a unified visual matching framework can be developed to encompass both BoV and kernel based metrics, in which local kernel plays an important role between feature pairs or between features and their reconstruction. Generally, local kernels are defined using Euclidean distance or its derivatives, based either explicitly or implicitly on an assumption of Gaussian noise. However, local features such as SIFT and HoG often follow a heavy-tailed distribution which tends to undermine the motivation behind Euclidean metrics. Motivated by recent advances in feature coding techniques, a novel efficient local coding based matching kernel (LCMK) method is proposed. This exploits the manifold structures in Hilbert space derived from local kernels. The proposed method combines advantages of both BoV and kernel based metrics, and achieves a linear computational complexity. This enables efficient and scalable visual matching to be performed on large scale image sets. To evaluate the effectiveness of the proposed LCMK method, we conduct extensive experiments with widely used benchmark datasets, including 15-Scenes, Caltech101/256, PASCAL VOC 2007 and 2011 datasets. Experimental results confirm the effectiveness of the relatively efficient LCMK method.

Research on Image Matching Similarity Criterion Based on Maximum Posterior Probability

Matching Images Based on Consistency Graph and Region Adjacency Graphs.

Posterior probability measure for image matching

Gradient of Reference Difference Based Matching Algorithm for Image Feature Point

An Image Matching Algorithm Based on Improved Rank Transform

Maximum-likelihood image matching

Combining similarity measures in content-based image retrieval guided by mutual information

Mathematical Model of Blob Matching and Modified Bhattacharyya Coefficient

Centroid Iteration Image Tracking Algorithm

Object Tracking Using Local Multiple Features And A Posterior Probability Measure

Robust Template Matching Method Based on Minimum Maximum Circular Similarity Measurement

Locality preserving verification for image search.

Local coding based matching kernel method for image classification

A SIFT and Bayes Sampling Consensus Method for Image Matching

A new Hausdorff distance for image matching

Novel Image Matching Algorithm Based on Symmetrical Color-Spatial Feature

Image Matching for Non-Planar Scenes under Wide Baseline Views

Image Matching Algorithm Based on Critical Feature Points

Image Matching Based Local Delaunay Triangulation and Affine Invariant Geometric Constraint

Multiple Subimage Matching Algorithm Based on Correlation Plane Feature

An Image Matching Algorithm Based On Singular Value Decomposition and Belief Propagation