Abstract:Fine-grained 3D shape classification is important for shape understanding and analysis, which poses a challenging research problem. However, the studies on the fine-grained 3D shape classification have rarely been explored, due to the lack of fine-grained 3D shape benchmarks. To address this issue, we first introduce a new 3D shape dataset (named FG3D dataset) with fine-grained class labels, which consists of three categories including airplane, car and chair. Each category consists of several subcategories at a fine-grained level. According to our experiments under this fine-grained dataset, we find that state-of-the-art methods are significantly limited by the small variance among subcategories in the same category. To resolve this problem, we further propose a novel fine-grained 3D shape classification method named FG3D-Net to capture the fine-grained local details of 3D shapes from multiple rendered views. Specifically, we first train a Region Proposal Network (RPN) to detect the generally semantic parts inside multiple views under the benchmark of generally semantic part detection. Then, we design a hierarchical part-view attention aggregation module to learn a global shape representation by aggregating generally semantic part features, which preserves the local details of 3D shapes. The part-view attention module hierarchically leverages part-level and view-level attention to increase the discriminability of our features. The part-level attention highlights the important parts in each view while the view-level attention highlights the discriminative views among all the views of the same object. In addition, we integrate a Recurrent Neural Network (RNN) to capture the spatial relationships among sequential views from different viewpoints. Our results under the fine-grained 3D shape dataset show that our method outperforms other state-of-the-art methods. The FG3D dataset is available at https://github.com/liuxinhai/FG3D-Net.

A 3d Shape Classifier with Neural Network Supervision

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Unify 3D Shape Retrieval and Classification in One Framework

SSN: Shape Signature Networks for Multi-class Object Detection from Point Clouds

Unsupervised 3D Learning for Shape Analysis Via Multiresolution Instance Discrimination

A Unified Feature Representation and Learning Framework for 3D Shape

Unsupervised 3D Learning for Shape Analysis via Multiresolution Instance Discrimination

3D shape classification based on convolutional neural networks fusing multi-view information

Learning Point Cloud Shapes with Geometric and Topological Structures.

Fine-Grained 3D Shape Classification With Hierarchical Part-View Attention

Learning 3D Shape Completion under Weak Supervision

MHSAN: Multi-view hierarchical self-attention network for 3D shape recognition

Smart Computing for Large Scale Visual Data Sensing and Processing

Unsupervised Deep Shape Descriptor with Point Distribution Learning.

Robust 3D Shape Classification Via Non-Local Graph Attention Network

Learning Cross-Domain Neural Networks For Sketch-Based 3d Shape Retrieval

AutoShape: Real-Time Shape-Aware Monocular 3D Object Detection

GVCNN: Group-View Convolutional Neural Networks for 3D Shape Recognition

DAN: Deep-Attention Network for 3D Shape Recognition

Learning High-Level Feature by Deep Belief Networks for 3-D Model Retrieval and Recognition.

Weakly-Supervised Learning of Category-Specific 3D Object Shapes.