Abstract:With the popularization of mobile devices, recent years have witnessed an emerging potential for mobile landmark search. In this scenario, the user experience heavily depends on the efficiency of query transmission over a wireless link. As sending a query photo is time consuming, recent works have proposed to extract compact visual descriptors directly on the mobile end towards low bit rate transmission. Typically, these descriptors are extracted based solely on the visual content of a query, and the location cues from the mobile end are rarely exploited. In this paper, we present a Location Discriminative Vocabulary Coding (LDVC) scheme, which achieves extremely low bit rate query transmission, discriminative landmark description, as well as scalable descriptor delivery in a unified framework. Our first contribution is a compact and location discriminative visual landmark descriptor, which is offline learnt in two-step: First, we adopt spectral clustering to segment a city map into distinct geographical regions, where both visual and geographical similarities are fused to optimize the partition of city-scale geo-tagged photos. Second, we propose to learn LDVC in each region with two schemes: (1) a Ranking Sensitive PCA and (2) a Ranking Sensitive Vocabulary Boosting. Both schemes embed location cues to learn a compact descriptor, which minimizes the retrieval ranking loss by replacing the original high-dimensional signatures. Our second contribution is a location aware online vocabulary adaption: We store a single vocabulary in the mobile end, which is efficiently adapted for a region specific LDVC coding once a mobile device enters a given region. The learnt LDVC landmark descriptor is extremely compact (typically 10–50 bits with arithmetical coding) and performs superior over state-of-the-art descriptors. We implemented the framework in a real-world mobile landmark search prototype, which is validated in a million-scale landmark database covering typical areas e.g. Beijing, New York City, Lhasa, Singapore, and Florence.

Landmark Recognition with Compact BoW Histogram and Ensemble ELM

Landmark Recognition with Sparse Representation Classification and Extreme Learning Machine.

Fast online learning algorithm for landmark recognition based on BoW framework

Ensemble Based Constrained-Optimization Extreme Learning Machine For Landmark Recognition

Accurate and Efficient Scene Recognition with Compact Bow and Ensemble Elm

Landmark Recognition Via Sparse Representation

Extreme Learning Machine Combining Hidden-Layer Feature Weighting and Batch Training for Classification

A Discriminative Learning Technique For Mobile Landmark Recognition

Design of an Enhanced Visual Odometry by Building and Matching Compressive Panoramic Landmarks Online

Discriminative BoW Framework for Mobile Landmark Recognition

Discriminative Bag-of-visual Phrase Learning for Landmark Recognition

Mining Location-Aware Discriminative Blocklets for Recognizing Landmark Architectures

Landmark recognition system for mini rotor aerial robot

Context-Aware Discriminative Vocabulary Learning for Mobile Landmark Recognition.

Learning Compact Visual Descriptors For Low Bit Rate Mobile Landmark Search

Location Discriminative Vocabulary Coding for Mobile Landmark Search

Land-Use Scene Classification Using a Concentric Circle-Structured Multiscale Bag-of-Visual-Words Model

Context-aware codebook learning for mobile landmark recognition

Learning Compact Visual Descriptor for Low Bit Rate Mobile Landmark Search.

A Bag-of-visual-words Model Based Framework for Object-Oriented Land-Cover Classification

Landmark Tracking Algorithm Based on Adaptive Feature