Abstract:Sketch-based image retrieval is of import practical significance in today’s world populated by smart touch screen devices. Fine-grained sketch-based image retrieval (FG-SBIR) is particularly challenging and uses characteristic of free-hand sketches to retrieve natural photos at the instance level. From outline and semantic perspectives, a free-hand sketch may have many natural photos corresponding to it, we call the relationship “one-to-many”, which means that the effectiveness of FG-SBIR mainly depends on the quality of fine-grained information extracted. Existing deep convolutional neural network (DCNN) models for FG-SBIR commonly use coarse or first-order attention modules to focus on specific local regions, yet cannot capture high-order or complex information and the subtle differences between sketch–photo pairs. It is widely known that the features learned from higher layers of the network are more abstract and of a higher semantic level compared to those learned from the lower layers, but lose some important fine-grained information. To address these limitations, this paper proposes a three-way enhanced part-aware network (EPAN), in which a mixed high-order attention module is added after the middle-level feature space to generate a variety of high-order attention maps and capture rich features contained in the middle convolutional layer. An enhanced part-aware module is proposed to capture useful part cues and enhance the semantic consistency of local regions. This allows for learning more discriminative cross-domain feature representations. A larger number of experiments on several popular datasets demonstrate that our model is superior to state-of-the-art approaches.

Gradually Focused Fine-Grained Sketch-Based Image Retrieval

SceneSketcher: Fine-Grained Image Retrieval with Scene Sketches

SceneSketcher-v2: Fine-Grained Scene-Level Sketch-Based Image Retrieval Using Adaptive GCNs

Sketch-Based 3D Model Retrieval via Multi-feature Fusion

Sketch-Based Retrieval in Large-Scale Image Database Via Position-Aware Silhouette Matching.

Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image Retrieval.

Multi-feature Fusion for Fine-Grained Sketch-Based Image Retrieval

AE-Net: Fine-grained Sketch-Based Image Retrieval Via Attention-Enhanced Network

Successively focused details: attention-based recurrent multiscale network for sketch-based image retrieval

Sketch Less for More: On-the-Fly Fine-Grained Sketch Based Image Retrieval

Deep Reinforced Attention Regression for Partial Sketch Based Image Retrieval

Fine-grained Sketch-Based Image Retrieval: the Role of Part-Aware Attributes

Deep Multimodal Embedding Model for Fine-grained Sketch-based Image Retrieval

A Review of Fine-Grained Sketch Image Retrieval Based on Deep Learning

A Multiple Triplet-Ranking Model for Fine-Grained Sketch-Based Image Retrieval

Sketch Me That Shoe

Three-way Enhanced Part-Aware Network for Fine-Grained Sketch-Based Image Retrieval

Cross-Modal Hierarchical Modelling for Fine-Grained Sketch Based Image Retrieval

Conventional SBIR Fine-grained SBIR Conventional Methods Our Method

A deformable CNN-based triplet model for fine-grained sketch-based image retrieval

Enhancing Sketch-Based Image Retrieval Via Deep Discriminative Representation.