Abstract:The essence of image-based localization lies in matching 2D key points in the query image and 3D points in the database. State-of-the-art methods mostly employ sophisticated key point detectors and feature descriptors, e.g., Difference of Gaussian (DoG) and Scale Invariant Feature Transform (SIFT), to ensure robust matching. While a high registration rate is attained, the registration speed is impeded by the expensive key point detection and the descriptor extraction. In this paper, we propose to use efficient key point detectors along with binary feature descriptors, since the extraction of such binary features is extremely fast. The naive usage of binary features, however, does not lend itself to significant speedup of localization, since existing indexing approaches, such as hierarchical clustering trees and locality sensitive hashing, are not efficient enough in indexing binary features and matching binary features turns out to be much slower than matching SIFT features. To overcome this, we propose a much more efficient indexing approach for approximate nearest neighbor search of binary features. This approach resorts to randomized trees that are constructed in a supervised training process by exploiting the label information derived from that multiple features correspond to a common 3D point. In the tree construction process, node tests are selected in a way such that trees have uniform leaf sizes and low error rates, which are two desired properties for efficient approximate nearest neighbor search. To further improve the search efficiency, a probabilistic priority search strategy is adopted. Apart from the label information, this strategy also uses non-binary pixel intensity differences available in descriptor extraction. By using the proposed indexing approach, matching binary features is no longer much slower but slightly faster than matching SIFT features. Consequently, the overall localization speed is significantly improved due to the much faster key point detection and descriptor extraction. It is empirically demonstrated that the localization speed is improved by an order of magnitude as compared with state-of-the-art methods, while comparable registration rate and localization accuracy are still maintained.

RESEARCH ON FEATURE POINTS EXTRACTION METHOD FOR BINARY MULTISCALE AND ROTATION INVARIANT LOCAL FEATURE DESCRIPTOR

Local Registration of Medical Images Using Feature Point and Intensity Information

Statistical Probability Based Algorithm for Extracting Feature Points in 2-Dimensional Image

A New and Effective Spatio-Temporal Local Feature Extraction Method and Its Application in Target Recognition

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

A Novel Local Invariant Feature Detection and Description Algorithm

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

A Quick Scale-Invariant Interest Point Detecting Approach

New Local Descriptor Extracting and Matching Approach

A Novel Method Of Feature Points Identification Using Multi-Scale Technology

Feature Point Extraction from the Local Frequency Map of an Image

Robust Wide Baseline Feature Point Matching Based on Scale Invariant Feature Descriptor

AN EFFICIENT LOCAL FEATURE-BASED SALIENT REGION DETECTION ALGORITHM

Fast Localization In Large-Scale Environments Using Supervised Indexing Of Binary Features

Extraction Algorithm of Image Feature Point Based on Multi-Scale Fusion Information

Image Point Feature Extraction Algorithm of Circumferential Binary Descriptor

FFD: Fast Feature Detector

Binary Feature from Intensity Quantization and Weakly Spatial Contextual Coding for Image Search.

Key-points Feature Detection Using Multi-Scale Filtering for Remote Sensing Image

Image Matching Algorithm Based on Critical Feature Points

Object Recognition Using Rotation Invariant Local Binary Pattern of Significant Bit Planes