Abstract:Visual matching is a crucial step in image retrieval based on the bag-of-words (BoW) model. In the baseline method, two keypoints are considered as a matching pair if their SIFT descriptors are quantized to the same visual word. However, the SIFT visual word has two limitations. First, it loses most of its discriminative power during quantization. Second, SIFT only describes the local texture feature. Both drawbacks impair the discriminative power of the BoW model and lead to false positive matches. To tackle this problem, this paper proposes to embed multiple binary features at indexing level. To model correlation between features, a multi-IDF scheme is introduced, through which different binary features are coupled into the inverted file. We show that matching verification methods based on binary features, such as Hamming embedding, can be effectively incorporated in our framework. As an extension, we explore the fusion of binary color feature into image retrieval. The joint integration of the SIFT visual word and binary features greatly enhances the precision of visual matching, reducing the impact of false positive matches. Our method is evaluated through extensive experiments on four benchmark datasets (Ukbench, Holidays, DupImage, and MIR Flickr 1M). We show that our method significantly improves the baseline approach. In addition, large-scale experiments indicate that the proposed method requires acceptable memory usage and query time compared with other approaches. Further, when global color feature is integrated, our method yields competitive performance with the state-of-the-arts.

Circumferential Binary Feature Extraction and Matching Search Algorithms

Matching binary feature search algorithm of bitmap locality sensitive hashing

Image Point Feature Extraction Algorithm of Circumferential Binary Descriptor

Binary Feature from Intensity Quantization and Weakly Spatial Contextual Coding for Image Search.

Binary SIFT: towards efficient feature matching verification for image search

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Cross-Indexing of Binary Sift Codes for Large-Scale Image Search

Infrared and Visible Image Matching Algorithm Based on SIFT and LDB

Coupled Binary Embedding for Large-Scale Image Retrieval

Image Matching Algorithm Based on Critical Feature Points

RESEARCH ON FEATURE POINTS EXTRACTION METHOD FOR BINARY MULTISCALE AND ROTATION INVARIANT LOCAL FEATURE DESCRIPTOR

Improving feature matching strategies for efficient image retrieval

Hamming embedding with fragile bits for image search

CDCF-based iris feature extraction and matching

Spherical binary images matching

Features Combined Binary Descriptor Based on Voted Ring-Sampling Pattern

Spherical binary images retrieval with wavelet analysis

An Evaluation of Feature Matchers Forfundamental Matrix Estimation.

Local Ternary Cross Structure Pattern: A Color LBP Feature Extraction with Applications in CBIR

Feature-matching method based on keypoint response constraint using binary encoding of phase congruency

Edge-SIFT: Discriminative Binary Descriptor for Scalable Partial-Duplicate Mobile Search.