Abstract:Mobile landmark search (MLS) recently receives increasing attention for its great practical values. However, it still remains unsolved due to two important challenges. One is high bandwidth consumption of query transmission, and the other is the huge visual variations of query images sent from mobile devices. In this paper, we propose a novel hashing scheme, named as canonical view based discrete multi-modal hashing (CV-DMH), to handle these problems via a novel three-stage learning procedure. First, a submodular function is designed to measure visual representativeness and redundancy of a view set. With it, canonical views, which capture key visual appearances of landmark with limited redundancy, are efficiently discovered with an iterative mining strategy. Second, multi-modal sparse coding is applied to transform visual features from multiple modalities into an intermediate representation. It can robustly and adaptively characterize visual contents of varied landmark images with certain canonical views. Finally, compact binary codes are learned on intermediate representation within a tailored discrete binary embedding model which preserves visual relations of images measured with canonical views and removes the involved noises. In this part, we develop a new augmented Lagrangian multiplier (ALM) based optimization method to directly solve the discrete binary codes. We can not only explicitly deal with the discrete constraint, but also consider the bit-uncorrelated constraint and balance constraint together. The proposed solution can desirably avoid accumulated quantization errors in conventional optimization method which simply adopts two-step “relaxing+rounding” framework. With CV-DMH, robust visual query processing, low-cost of query transmission, and fast search process are simultaneously supported. Experiments on real world landmark datasets demonstrate the superior performance of CVDMH over several state-of-the-art methods.

Smart Query Expansion Scheme for CDVS Based on Illumination and Key Features

Query Expansion by Spatial Co-Occurrence for Image Retrieval

Contextual Query Expansion for Image Retrieval

Query expansion enhancement by fast binary matching.

An Image Enhancement Based CDVS Matching Algorithm

Query Expansion for VHR Image Detection

Accurate Off-Line Query Expansion for Large-Scale Mobile Visual Search.

Color Image Retrieval Utilizing Extended Fast Vq Codeword Search Technique And Vector Composition-Based Feedback

Visual word expansion and BSIFT verification for large-scale image search

Improving Image Retrieval by Local Feature Reselection with Query Expansion.

Database Images Multi-modal Canonical View Mining Discrete Binary Embedding Visual Preserving Latent Structure Extraction Discrete Optimiation Canonical

Mobile Visual Search Compression with Grassmann Manifold Embedding

Indexing Large Visual Vocabulary by Randomized Dimensions Hashing for High Quantization Accuracy: Improving the Object Retrieval Quality

See-to-retrieve: efficient processing of spatio-visual keyword queries.

Data-Driven Lightweight Interest Point Selection for Large-Scale Visual Search

Adaptive Feature Selection Based on Local Descriptor Distinctive Degree for Vehicle Retrieval Application

Query Expansion with Pairwise Learning in Object Retrieval Challenge.

Online Query Expansion Hashing for Efficient Image Retrieval

Learning Compact Visual Representation with Canonical Views for Robust Mobile Landmark Search.

Feature grouping and local soft match for mobile visual search

See-to-retrieve