Abstract:Sketch-based 3D shape retrieval has always been a hot research topic in the computer vision community. The main challenge is to alleviate the cross-modality discrepancies such that the retrieval accuracy can be improved. In this paper, we propose a novel Precise Alignment Guided Metric Learning (PAGML) method based on master-auxiliary cross-modality retrieval framework. An auxiliary learning network is developed to indirectly guide the master learning model to extract features of rich semantic information, so as to achieve a semantic alignment between the cross-modality data. Furthermore, affected by the intra-class variability and inter-class imbalance issue, the learned class distributions may exhibit unevenness in the common embedding space and cause poor retrieval performance. A loss function dedicated for cross-modality retrieval is designed to achieve a rigid alignment between sketches and 3D shapes of the same category by pulling their rich semantic representations to the rigid center of the category. As a result, a more precise alignment between the cross-modality embedding features of the same category is approached gradually, which further alleviates the cross-modality discrepancies, inter-class variability, and inter-class imbalance, thus improving the cross-modality retrieval accuracies. Extensive experiments on two public benchmark datasets demonstrate that the proposed PAGML surpasses the state-of-the-art methods in retrieval accuracy and has excellent generalization abilities to unseen classes.

Probabilistic Latent Semantic Analysis for Sketch-Based 3D Model Retrieval

Sketch-Based 3D Model Retrieval via Multi-feature Fusion

Viewpoint-Aware Representation for Sketch-Based 3D Model Retrieval

A New Sketch-Based 3D Model Retrieval Approach by Using Global and Local Features

Model-driven sketch reconstruction with structure-oriented retrieval

SceneSketcher: Fine-Grained Image Retrieval with Scene Sketches

Extended Large Scale Sketch-Based 3D Shape Retrieval.

A Comparison of 3D Shape Retrieval Methods Based on a Large-Scale Benchmark Supporting Multimodal Queries

A Words-of-interest Model of Sketch Representation for Image Retrieval

A Scale Invariant Local Descriptor for Sketch Based 3D Model Retrieval

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

A Sketch-Based Semantic Retrieval Approach for 3d Cad Models

Sketch retrieval based on spatial relations

’ s repository of research publications and other research outputs A words-of-interest model of sketch representation for image retrieval Conference or Workshop Item

Discriminative Sketch-Based 3d Model Retrieval Via Robust Shape Matching

Effective Sketch Retrieval Based On Its Contents

A sketch-texture retrieval framework using perceptual similarity

Zero-shot sketch-based image retrieval via adaptive relation-aware metric learning

User-Adaptive Sketch-Based 3-D CAD Model Retrieval

Deep Sketch-Shape Hashing With Segmented 3D Stochastic Viewing

PAGML: Precise Alignment Guided Metric Learning for sketch-based 3D shape retrieval