Abstract:As an important solution for 3D shape retrieval, a multi-view shape descriptor has achieved impressive performance. One crucial part of view-based shape descriptors is to interpret 3D structures through various 2D observations. Most existing methods like MVCNN believe that a strong classification model trained with deep learning, can often provide an efficient shape embedding for 3D shape retrieval. However, these methods pay much attention to discriminative models and none of them necessarily incorporate the underlying 3D properties of the objects from 2D images. In this paper, we present a novel encoder-decoder recurrent feature aggregation network (ERFA-Net) to address this problem. Aiming at emphasizing the 3D properties of 3D shapes in the fusion of multiple view features, 3D properties prediction tasks are introduced into the 3D shape retrieval. Specifically, an image sequence of the shape is recurrently aggregated into a discriminative shape embedding based on LSTM network, and then this latent shape embedding is trained to predict the original voxel grids and estimate images of unseen viewpoints. This generation task gives an effective supervision which makes the network exploit 3D properties of shapes through various 2D images. Our method achieves the state-of-the-art performance for 3D shape retrieval, on two large-scale 3D shape datasets, ModelNet and ShapeNetCore55. Extensive experiments show that the proposed 3D representation performs robust discrimination against view occlusion, and strong generation ability for various 3D shape tasks.

3D Shape Classification Based on Global and Local Features Extraction with Collaborative Learning

Local Deep Feature Learning Framework for 3D Shape.

Unify 3D Shape Retrieval and Classification in One Framework

A Unified Feature Representation and Learning Framework for 3D Shape

3D Shape Classification Using a Single View.

LATFormer: Locality-Aware Point-View Fusion Transformer for 3D shape recognition

Tensor Multi-Task Learning for Multi-View Representation of 3D Shape

View-aligned Pixel-Level Feature Aggregation for 3D Shape Classification

Learning the Global Descriptor for 3-D Object Recognition Based on Multiple Views Decomposition

MV-LFN: Multi-view Based Local Information Fusion Network for 3D Shape Recognition

Parts4Feature: Learning 3D Global Features from Generally Semantic Parts in Multiple Views

Learning Representative Viewpoints in 3D Shape Recognition

Learning Multi-View Representation with LSTM for 3-D Shape Recognition and Retrieval

3D-TRANS: 3D Hierarchical Transformer for Shape Correspondence Learning.

3D Shape Recognition and Retrieval Based on Multi-Modality Deep Learning

Training Deep Convolutional Neural Networks to Acquire the Best View of a 3D Shape.

3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification

3D shape classification based on convolutional neural networks fusing multi-view information

Learning Discriminative and Generative Shape Embeddings for Three-Dimensional Shape Retrieval

Joint Local Correlation and Global Contextual Information for Unsupervised 3D Model Retrieval and Classification