Abstract:Sketch-based image retrieval is of import practical significance in today’s world populated by smart touch screen devices. Fine-grained sketch-based image retrieval (FG-SBIR) is particularly challenging and uses characteristic of free-hand sketches to retrieve natural photos at the instance level. From outline and semantic perspectives, a free-hand sketch may have many natural photos corresponding to it, we call the relationship “one-to-many”, which means that the effectiveness of FG-SBIR mainly depends on the quality of fine-grained information extracted. Existing deep convolutional neural network (DCNN) models for FG-SBIR commonly use coarse or first-order attention modules to focus on specific local regions, yet cannot capture high-order or complex information and the subtle differences between sketch–photo pairs. It is widely known that the features learned from higher layers of the network are more abstract and of a higher semantic level compared to those learned from the lower layers, but lose some important fine-grained information. To address these limitations, this paper proposes a three-way enhanced part-aware network (EPAN), in which a mixed high-order attention module is added after the middle-level feature space to generate a variety of high-order attention maps and capture rich features contained in the middle convolutional layer. An enhanced part-aware module is proposed to capture useful part cues and enhance the semantic consistency of local regions. This allows for learning more discriminative cross-domain feature representations. A larger number of experiments on several popular datasets demonstrate that our model is superior to state-of-the-art approaches.

A Multi-Layer Deep Fusion Convolutional Neural Network for Sketch Based Image Retrieval

SceneSketcher-v2: Fine-Grained Scene-Level Sketch-Based Image Retrieval Using Adaptive GCNs

SceneSketcher: Fine-Grained Image Retrieval with Scene Sketches

Sketch-Based 3D Model Retrieval via Multi-feature Fusion

Personalized Sketch-Based Image Retrieval by Convolutional Neural Network and Deep Transfer Learning.

Sketch based image retrieval based on abstract-level transform and convolutional neural networks

Sketch-Based Image Retrieval Via Siamese Convolutional Neural Network

Enhancing Sketch-Based Image Retrieval Via Deep Discriminative Representation.

Three-way Enhanced Part-Aware Network for Fine-Grained Sketch-Based Image Retrieval

Deep Multimodal Embedding Model for Fine-grained Sketch-based Image Retrieval

Sketch Based Image Retrieval Via Image-Aided Cross Domain Learning

Sketch Me That Shoe

Users Personalized Sketch-Based Image Retrieval Using Deep Transfer Learning.

Single Color Sketch-Based Image Retrieval in HSV Color Space

Deep Sketch Hashing: Fast Free-hand Sketch-Based Image Retrieval

Successively focused details: attention-based recurrent multiscale network for sketch-based image retrieval

Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image Retrieval.

Sketch-based Image Retrieval with Deep Visual Semantic Descriptor

A Multiple Triplet-Ranking Model for Fine-Grained Sketch-Based Image Retrieval

A Novel Visual-Region-Descriptor-based Approach to Sketch-based Image Retrieval

Multi-feature Fusion for Fine-Grained Sketch-Based Image Retrieval