Abstract:ABSTRACTBecause of the popularity of touch-screen devices, it has become a highly desirable feature to retrieve images from a huge repository by matching with a hand-drawn sketch. Although searching images via keywords or an example image has been successfully launched in some commercial search engines of billions of images, it is still very challenging for both academia and industry to develop a sketch-based image retrieval system on a billion-level database. In this work, we systematically study this problem and try to build a system to support query-by-sketch for two billion images. The raw edge pixel and Chamfer matching are selected as the basic representation and matching in this system, owning to the superior performance compared with other methods in extensive experiments. To get a more compact feature and a faster matching, a vector-like Chamfer feature pair is introduced, based on which the complex matching is reformulated as the crossover dot-product of feature pairs. Based on this new formulation, a compact shape code is developed to represent each image/sketch by projecting the Chamfer features to a linear subspace followed by a non-linear source coding. Finally, the multi-probe Kmedoids-LSH is leveraged to index database images, and the compact shape codes are further used for fast reranking. Extensive experiments show the effectiveness of the proposed features and algorithms in building such a sketch-based image search system.

Pattern retrieval in image databases based on adaptive signal decomposition

Enhanced Micro-structure Descriptor based Image Retrieval.

Texture-based Pattern Retrieval from Image Databases

An Image Retrieval Method Synthesizing PHOG Shape Description and Wavelet Pyramid Energy Distribution

Imagerank : Spectral Techniques for Structural Analysis of Image Database

Adaptive Filtering And Indexing For Image Databases

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

An Adaptive Index Structure for Similarity Search in Large Image Databases

Texture Image Retrieval Using Novel Non-separable Filter Banks Based on Centrally Symmetric Matrices.

Image Retrieval Based on Structured Local Binary Kirsch Pattern.

Local Spatial Binary Pattern: a New Feature Descriptor for Content-Based Image Retrieval

A Pattern Thesaurus for Browsing Large Aerial Photographs

An Image Retrieval Method Based on Color and Texture Features

A Novel Retrieval Refinement and Interaction Pattern by Exploring Result Correlations for Image Retrieval

Large scale partially duplicated web image retrieval.

Texture Features for Browsing and Retrieval of Image Data

Content Based Image Indexing and Retrieval

Efficient Indexing for Large Scale Visual Search

Indexing billions of images for sketch-based retrieval.

Low-Level Features for Image Retrieval Based on Extraction of Directional Binary Patterns and Its Oriented Gradients Histogram

A Comparative Analysis of Retrieval Techniques In Content Based Image Retrieval