Abstract:3D shape retrieval has attracted much attention and become a hot topic in computer vision field recently.With the development of deep learning, 3D shape retrieval has also made great progress and many view-based methods have been introduced in recent years. However, how to represent 3D shapes better is still a challenging problem. At the same time, the intrinsic hierarchical associations among views still have not been well utilized. In order to tackle these problems, in this paper, we propose a multi-loop-view convolutional neural network (MLVCNN) framework for 3D shape retrieval. In this method, multiple groups of views are extracted from different loop directions first. Given these multiple loop views, the proposed MLVCNN framework introduces a hierarchical view-loop-shape architecture, i.e., the view level, the loop level, and the shape level, to conduct 3D shape representation from different scales. In the view-level, a convolutional neural network is first trained to extract view features. Then, the proposed Loop Normalization and LSTM are utilized for each loop of view to generate the loop-level features, which considering the intrinsic associations of the different views in the same loop. Finally, all the loop-level descriptors are combined into a shape-level descriptor for 3D shape representation, which is used for 3D shape retrieval. Our proposed method has been evaluated on the public 3D shape benchmark, i.e., ModelNet40. Experiments and comparisons with the state-of-the-art methods show that the proposed MLVCNN method can achieve significant performance improvement on 3D shape retrieval tasks. Our MLVCNN outperforms the state-of-the-art methods by the mAP of 4.84% in 3D shape retrieval task. We have also evaluated the performance of the proposed method on the 3D shape classification task where MLVCNN also achieves superior performance compared with recent methods.

Deep Spherical Panoramic Representation for 3D Shape Recognition

An Improved 3D Shape Recognition Method Based on Panoramic View

Panorama based on multi-channel-attention CNN for 3D model recognition

DeepCamera

A Unified Feature Representation and Learning Framework for 3D Shape

Shape Representation and Recognition in High Dimensional Feature Space

Multi-view Convolutional Neural Networks for 3D Shape Recognition

Multi-view Moments Embedding Network for 3D Shape Recognition

Deep Learning 3D Shapes Using Alt-az Anisotropic 2-Sphere Convolution

Deep Learning Representation using Autoencoder for 3D Shape Retrieval

DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization

3D shape classification based on convolutional neural networks fusing multi-view information

Multi-channel Deep 3D Face Recognition

A New Rotation-Invariant Deep Network for 3D Object Recognition

GVCNN: Group-View Convolutional Neural Networks for 3D Shape Recognition

Unify 3D Shape Retrieval and Classification in One Framework

Variable-Viewpoint Representations for 3D Object Recognition

A Dimensional Reduction Guiding Deep Learning Architecture for 3D Shape Retrieval

3D Orientation Estimation and Vanishing Point Extraction from Single Panoramas Using Convolutional Neural Network

Spherical Fractal Convolutional Neural Networks for Point Cloud Recognition

MLVCNN: Multi-Loop-View Convolutional Neural Network for 3D Shape Retrieval