Abstract:Learning robust and discriminative representations is essential for 3D object retrieval. In this paper, we present an improved Multi-view Convolutional Neural Network (MVCNN) for view-based 3D object representation learning. Our technical contributions are divided into two aspects. First, we propose to employ Group-view Similarity Learning (GSL) over the multi-view representations before the aggregation operation ( i.e. , max-pooling in MVCNN). We assume that the similarity information among the view groups of different 3D objects can provide an important cue but has been neglected more or less by previous methods. To enhance it, we add a branch to the original MVCNN architecture and learn to maintain such group-view similarity relationships. Second, we utilize an end-to-end metric learning loss function to improve the representation learning process. In particular, we propose an improved Triplet-Center Loss (TCL) named Adaptive Margin based Triplet-Center Loss (AMTCL). The original TCL assumes a fixed and common margin to control the relative distance relationship between a sample to its corresponding class center and to the nearest negative center. Though TCL has demonstrated its great capacity on the 3D object retrieval task, however, when considering the distinguishability between samples of one class and samples of another class, we assume that it would be more appropriate that the margin takes different values based on the distinguishability of samples of different classes. Therefore we propose to adaptively and dynamically adjust the margin hyperparameter based on the normalized confusion matrix which is obtained on the training set during the training process. Extensive experiments on several public 3D shape benchmarks show that our method, GSL + AMTCL, can learn more suitable representations for 3D object retrieval, obtaining superior performance against state-of-the-art methods.

Learning Descriptors with Cube Loss for View-Based 3-D Object Retrieval

Feature Representation for 3D Object Retrieval Based on Unconstrained Multi-View

Using Triplet Loss to Generate Better Descriptors for 3D Object Retrieval

Multi-View 3d Object Retrieval with Deep Embedding Network

Center-push Loss for Joint View-Based 3D Model Classification and Retrieval Feature Learning

An Improved Multi-View Convolutional Neural Network for 3D Object Retrieval.

Multiple Discrimination and Pairwise CNN for view-based 3D object retrieval

Exploring Discriminative Views for 3D Object Retrieval.

View-based 3D object retrieval with discriminative views.

Group-Pair Convolutional Neural Networks for Multi-View Based 3D Object Retrieval.

Soft Margin Triplet-Center Loss for Multi-View 3D Shape Retrieval

A Unified Feature Representation and Learning Framework for 3D Shape

A Dimensional Reduction Guiding Deep Learning Architecture for 3D Shape Retrieval

Learning Discriminative and Generative Shape Embeddings for Three-Dimensional Shape Retrieval

Multi-View Saliency Guided Deep Neural Network for 3-D Object Retrieval and Classification

Group-pair deep feature learning for multi-view 3d model retrieval

Learning the Global Descriptor for 3-D Object Recognition Based on Multiple Views Decomposition

Angular Triplet-Center Loss for Multi-View 3D Shape Retrieval.

View-Based Discriminative Probabilistic Modeling for 3D Object Retrieval and Recognition

3-D Object Retrieval With Hausdorff Distance Learning

Efficient 3D Object Retrieval Based on Compact Views and Hamming Embedding