Abstract:View-based approach that recognizes 3D shape through its projected 2D images has achieved state-of-the-art results for 3D shape recognition. The major challenges are how to aggregate multi-view features and deal with 3D shapes in arbitrary poses. We propose two versions of a novel view-based Graph Convolutional Network, dubbed view-GCN and view-GCN++, to recognize 3D shape based on graph representation of multiple views. We first construct view-graph with multiple views as graph nodes, then design two graph convolutional networks over the view-graph to hierarchically learn discriminative shape descriptor considering relations of multiple views. Specifically, view-GCN is a hierarchical network based on two pivotal operations, i.e., feature transform based on local positional and non-local graph convolution, and graph coarsening based on a selective view-sampling operation. To deal with rotation sensitivity, we further propose view-GCN++ with local attentional graph convolution operation and rotation robust view-sampling operation for graph coarsening. By these designs, view-GCN++ achieves invariance to transformations under the finite subgroup of rotation group SO(3). Extensive experiments on benchmark datasets (i.e., ModelNet40, ScanObjectNN, RGBD and ShapeNet Core55) show that view-GCN and view-GCN++ achieve state-of-the-art results for 3D shape classification and retrieval tasks under aligned and rotated settings.

Learning Probabilistic Representation of Shape Recognition from Volumetric Grid

Shape Representation and Recognition in High Dimensional Feature Space

A Unified Feature Representation and Learning Framework for 3D Shape

Multi-view Convolutional Neural Networks for 3D Shape Recognition

Deep Spherical Panoramic Representation for 3D Shape Recognition

PVLNet: Parameterized-View-Learning Neural Network for 3D Shape Recognition.

Learning Local Neighboring Structure for Robust 3D Shape Representation

Latent-MVCNN: 3D Shape Recognition Using Multiple Views from Pre-defined or Random Viewpoints

Learning Shape Representation on Sparse Point Clouds for Volumetric Image Segmentation

Shape-based object recognition via Evidence Accumulation Inference.

One at a Time: Progressive Multi-step Volumetric Probability Learning for Reliable 3D Scene Perception

Learning Shape Priors for Single-View 3D Completion and Reconstruction

Latent Space Representation for Shape Analysis and Learning

PAI-GCN: Permutable Anisotropic Graph Convolutional Networks for 3D Shape Representation Learning.

Learning Canonical View Representation for 3D Shape Recognition with Arbitrary Views

An Improved 3D Shape Recognition Method Based on Panoramic View

Vehicle Detection And Pose Estimation By Probabilistic Representation

View Inter-Prediction GAN: Unsupervised Representation Learning for 3D Shapes by Learning Global Shape Memories to Support Local View Predictions.

3D shape representation, matching and recognition

Dual octree graph networks for learning adaptive volumetric shape representations

Learning View-Based Graph Convolutional Network for Multi-View 3D Shape Analysis