Abstract:ABSTRACTBecause of the popularity of touch-screen devices, it has become a highly desirable feature to retrieve images from a huge repository by matching with a hand-drawn sketch. Although searching images via keywords or an example image has been successfully launched in some commercial search engines of billions of images, it is still very challenging for both academia and industry to develop a sketch-based image retrieval system on a billion-level database. In this work, we systematically study this problem and try to build a system to support query-by-sketch for two billion images. The raw edge pixel and Chamfer matching are selected as the basic representation and matching in this system, owning to the superior performance compared with other methods in extensive experiments. To get a more compact feature and a faster matching, a vector-like Chamfer feature pair is introduced, based on which the complex matching is reformulated as the crossover dot-product of feature pairs. Based on this new formulation, a compact shape code is developed to represent each image/sketch by projecting the Chamfer features to a linear subspace followed by a non-linear source coding. Finally, the multi-probe Kmedoids-LSH is leveraged to index database images, and the compact shape codes are further used for fast reranking. Extensive experiments show the effectiveness of the proposed features and algorithms in building such a sketch-based image search system.

IdeaPanel: A Large Scale Interactive Sketch-based Image Search System

Sketch-Based Retrieval in Large-Scale Image Database Via Position-Aware Silhouette Matching.

MindFinder: interactive sketch-based image search on millions of images.

InterestPainter: A Painting Support Tool to Promote Children's Interest in Painting

InSide: Interactive Sketching for Image Database Exploration

SceneSketcher: Fine-Grained Image Retrieval with Scene Sketches

Fashionsketch: An Interactive Sketch-Based Massive Image Retrieval For Fashion E-Business

SceneSketcher-v2: Fine-Grained Scene-Level Sketch-Based Image Retrieval Using Adaptive GCNs

Indexing billions of images for sketch-based retrieval.

Guess what you draw: interactive contour-based image retrieval on a million-scale database.

Guess What You Draw

Edgel Index for Large-Scale Sketch-Based Image Search

Sketch-based Image Retrieval on a Large Scale Database

Robust Semantic Sketch Based Specific Image Retrieval

Efficient Indexing for Large Scale Visual Search

Collaborative Sketching in Crowdsourcing Design: A New Method for Idea Generation

PhotoSketch: Internet Image Montage

A Novel Visual-Region-Descriptor-based Approach to Sketch-based Image Retrieval

Sketch2Photo: Internet Image Montage

Improving the Precision of Image Search Engines with the Psychological Intention Diagram

Visual Search at Pinterest