Abstract:There are a number of component technologies that are useful for visual search, including format of visual descriptors, descriptor extraction process, as well as indexing, and matching algorithms. As a minimum, the format of descriptors as well as parts of their extraction process should be defined to ensure interoperability. In this paper, we study the problem of interoperability among compressed local descriptors at different bit-rates; that is, allowing effective and efficient comparison of compact descriptors, which is fundamentally important to mobile visual search applications. We propose to combine feature transform and multi-stage vector quantization to implement the interoperability of compact local descriptors. First, an orthogonal transform (e. g. Principle component analysis, PCA) is employed to eliminate the correlation between local feature dimensions, which improves the performance of compressed domain descriptor matching with the well-aligned distance computing of sorted important features in transform space. Second, a multi-stage vector quantization (MSVQ) is applied to generate compact codes for local descriptors. At light quantization tables, MSVQ takes advantage of the transform domain features to properly allocate different budgets to each group of transformed feature dimensions, respectively. The interoperability between compressed descriptors at different bit rates can be achieved by the descriptors' fast matching in the orthogonal feature space. In other words, descriptor decoding into the original feature space (SIFT space) is unnecessary, as the distance can be calculated by pre-computed lookup tables. In particular, such efficient matching in transform domain is significant for large-scale visual search. Over a set of benchmark datasets, we have reported superior performance over state-of-the-arts.

A novel pair-wise image matching strategy with compact descriptors

A Local Feature with Multiple Line Descriptors and Its Speeded-Up Matching Algorithm

Learning Local Feature Descriptors Through Ranking Losses Improved by Variance Shrinkage

<Bold>Matching Images More Efficiently With Local Descriptors</Bold>

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

Affine-invariant SIFT Descriptor with Global Context

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Image matching based on a local invariant descriptor

Efficient Covisibility-based Image Matching for Large-Scale SfM

A Novel Image Matching Method Based on SIFT

A Novel Cnn-Based Match Kernel For Image Retrieval

Edge-SIFT: Discriminative Binary Descriptor for Scalable Partial-Duplicate Mobile Search.

Fine-search for image copy detection based on local affine-invariant descriptor and spatial dependent matching

A Novel Feature Matching Strategy for Large Scale Image Retrieval.

Scalable local feature matching without visual codebook training

On The Interoperability Of Local Descriptors Compression

Binary SIFT: towards efficient feature matching verification for image search

LDAHash: Improved Matching with Smaller Descriptors

Coupled Binary Embedding for Large-Scale Image Retrieval

A unified feature-spatial cycle consistency fusion framework for robust image matching

Local multi-feature hashing based fast matching for aerial images