Abstract:The essence of image-based localization lies in matching 2D key points in the query image and 3D points in the database. State-of-the-art methods mostly employ sophisticated key point detectors and feature descriptors, e.g., Difference of Gaussian (DoG) and Scale Invariant Feature Transform (SIFT), to ensure robust matching. While a high registration rate is attained, the registration speed is impeded by the expensive key point detection and the descriptor extraction. In this paper, we propose to use efficient key point detectors along with binary feature descriptors, since the extraction of such binary features is extremely fast. The naive usage of binary features, however, does not lend itself to significant speedup of localization, since existing indexing approaches, such as hierarchical clustering trees and locality sensitive hashing, are not efficient enough in indexing binary features and matching binary features turns out to be much slower than matching SIFT features. To overcome this, we propose a much more efficient indexing approach for approximate nearest neighbor search of binary features. This approach resorts to randomized trees that are constructed in a supervised training process by exploiting the label information derived from that multiple features correspond to a common 3D point. In the tree construction process, node tests are selected in a way such that trees have uniform leaf sizes and low error rates, which are two desired properties for efficient approximate nearest neighbor search. To further improve the search efficiency, a probabilistic priority search strategy is adopted. Apart from the label information, this strategy also uses non-binary pixel intensity differences available in descriptor extraction. By using the proposed indexing approach, matching binary features is no longer much slower but slightly faster than matching SIFT features. Consequently, the overall localization speed is significantly improved due to the much faster key point detection and descriptor extraction. It is empirically demonstrated that the localization speed is improved by an order of magnitude as compared with state-of-the-art methods, while comparable registration rate and localization accuracy are still maintained.

Fast Large-Scale Object Retrieval with Binary Quantization

Large-scale Image Retrieval Based on Boosting Iterative Quantization Hashing with Query-Adaptive Reranking.

Fast Object Retrieval Using Direct Spatial Matching

Scalar Quantization for Large Scale Image Search

BSIFT: Toward Data-Independent Codebook for Large Scale Image Search.

Fast Search In Large-Scale Image Database Using Vector Quantization

Indexing Large Visual Vocabulary by Randomized Dimensions Hashing for High Quantization Accuracy: Improving the Object Retrieval Quality

Fast Image Retrieval Method Based on Lattice Vector Quantization and Inverted File

Scalable Feature Matching by Dual Cascaded Scalar Quantization for Image Retrieval

Salable Image Search with Reliable Binary Code

Large scale partial-duplicate image retrieval with bi-space quantization and geometric consistency

Scalable Image Retrieval by Sparse Product Quantization

Color Image Retrieval Utilizing Extended Fast Vq Codeword Search Technique And Vector Composition-Based Feedback

Fast Image Search Using Vector Quantization

Scalable Face Image Retrieval with Identity-Based Quantization and Multireference Reranking

Sub-Selective Quantization for Large-Scale Image Search

Distance-based Multiple Paths Quantization of Vocabulary Tree for Object and Scene Retrieval

Cross-Indexing of Binary Sift Codes for Large-Scale Image Search

Coupled Binary Embedding for Large-Scale Image Retrieval

Spherical Centralized Quantization for Fast Image Retrieval

Fast Localization In Large-Scale Environments Using Supervised Indexing Of Binary Features