Abstract:3D shape retrieval has attracted much attention and become a hot topic in computer vision field recently.With the development of deep learning, 3D shape retrieval has also made great progress and many view-based methods have been introduced in recent years. However, how to represent 3D shapes better is still a challenging problem. At the same time, the intrinsic hierarchical associations among views still have not been well utilized. In order to tackle these problems, in this paper, we propose a multi-loop-view convolutional neural network (MLVCNN) framework for 3D shape retrieval. In this method, multiple groups of views are extracted from different loop directions first. Given these multiple loop views, the proposed MLVCNN framework introduces a hierarchical view-loop-shape architecture, i.e., the view level, the loop level, and the shape level, to conduct 3D shape representation from different scales. In the view-level, a convolutional neural network is first trained to extract view features. Then, the proposed Loop Normalization and LSTM are utilized for each loop of view to generate the loop-level features, which considering the intrinsic associations of the different views in the same loop. Finally, all the loop-level descriptors are combined into a shape-level descriptor for 3D shape representation, which is used for 3D shape retrieval. Our proposed method has been evaluated on the public 3D shape benchmark, i.e., ModelNet40. Experiments and comparisons with the state-of-the-art methods show that the proposed MLVCNN method can achieve significant performance improvement on 3D shape retrieval tasks. Our MLVCNN outperforms the state-of-the-art methods by the mAP of 4.84% in 3D shape retrieval task. We have also evaluated the performance of the proposed method on the 3D shape classification task where MLVCNN also achieves superior performance compared with recent methods.

Unify 3D Shape Retrieval and Classification in One Framework

A Unified Feature Representation and Learning Framework for 3D Shape

A Comparison of 3D Shape Retrieval Methods Based on a Large-Scale Benchmark Supporting Multimodal Queries

A Metric Learning Method for Image-based 3D Shape Retrieval

A Dimensional Reduction Guiding Deep Learning Architecture for 3D Shape Retrieval

3D shape classification based on convolutional neural networks fusing multi-view information

MLVCNN: Multi-Loop-View Convolutional Neural Network for 3D Shape Retrieval

Learning Discriminative and Generative Shape Embeddings for Three-Dimensional Shape Retrieval

Shape Topics: A Compact Representation and New Algorithms for 3D Partial Shape Retrieval

CLN: Cross-Domain Learning Network for 2D Image-Based 3D Shape Retrieval

Multi-view Convolutional Neural Networks for 3D Shape Recognition

A Unified Framework for 3D Scene Understanding

PlaneRecTR: Unified Query Learning for 3D Plane Recovery from a Single View

Deep Multimetric Learning for Shape-Based 3D Model Retrieval

Uni3D: Exploring Unified 3D Representation at Scale

Towards Unified 3D Object Detection via Algorithm and Data Unification

Learning Barycentric Representations of 3D Shapes for Sketch-Based 3D Shape Retrieval.

PVNet: A Joint Convolutional Network of Point Cloud and Multi-View for 3D Shape Recognition.

Learning High-Level Feature by Deep Belief Networks for 3-D Model Retrieval and Recognition.

Towards Unified Representation of Multi-Modal Pre-training for 3D Understanding via Differentiable Rendering

Unsupervised Multi-View CNN for Salient View Selection and 3D Interest Point Detection