Abstract:Fine-grained 3D shape classification is important for shape understanding and analysis, which poses a challenging research problem. However, the studies on the fine-grained 3D shape classification have rarely been explored, due to the lack of fine-grained 3D shape benchmarks. To address this issue, we first introduce a new 3D shape dataset (named FG3D dataset) with fine-grained class labels, which consists of three categories including airplane, car and chair. Each category consists of several subcategories at a fine-grained level. According to our experiments under this fine-grained dataset, we find that state-of-the-art methods are significantly limited by the small variance among subcategories in the same category. To resolve this problem, we further propose a novel fine-grained 3D shape classification method named FG3D-Net to capture the fine-grained local details of 3D shapes from multiple rendered views. Specifically, we first train a Region Proposal Network (RPN) to detect the generally semantic parts inside multiple views under the benchmark of generally semantic part detection. Then, we design a hierarchical part-view attention aggregation module to learn a global shape representation by aggregating generally semantic part features, which preserves the local details of 3D shapes. The part-view attention module hierarchically leverages part-level and view-level attention to increase the discriminability of our features. The part-level attention highlights the important parts in each view while the view-level attention highlights the discriminative views among all the views of the same object. In addition, we integrate a Recurrent Neural Network (RNN) to capture the spatial relationships among sequential views from different viewpoints. Our results under the fine-grained 3D shape dataset show that our method outperforms other state-of-the-art methods. The FG3D dataset is available at https://github.com/liuxinhai/FG3D-Net.

DAN: Deep-Attention Network for 3D Shape Recognition

SVHAN: Sequential View Based Hierarchical Attention Network for 3D Shape Recognition.

RJAN: Region-based Joint Attention Network for 3D Shape Recognition

MANet: Multimodal Attention Network based Point- View fusion for 3D Shape Recognition

LIMAN: Local Information based Multi Attention Network for 3D Shape Recognition

Attention-Guided Fusion Network of Point Cloud and Multiple Views for 3D Shape Recognition.

3D ShapeNets: A Deep Representation for Volumetric Shapes

LIMAN: Local Information-Based Multiattention Network for 3D Shape Recognition

3D-A-Nets: 3D Deep Dense Descriptor for Volumetric Shapes with Adversarial Networks

DFNet: Deep Fusion Network for 3D Shape Classification and Retrieval

MHSAN: Multi-view hierarchical self-attention network for 3D shape recognition

A Dimensional Reduction Guiding Deep Learning Architecture for 3D Shape Retrieval

3D VAE-Attention Network: A Parallel System for Single-view 3D Reconstruction.

3D Shape Recognition and Retrieval Based on Multi-Modality Deep Learning

Learning Discriminative 3D Shape Representations by View Discerning Networks

PVNet: A Joint Convolutional Network of Point Cloud and Multi-View for 3D Shape Recognition.

PGNet: Progressive Feature Guide Learning Network for Three-dimensional Shape Recognition.

VERAM: View-Enhanced Recurrent Attention Model for 3D Shape Classification

Dual Attention MobDenseNet(DAMDNet) for Robust 3D Face Alignment

DaNet: Decompose-and-aggregate Network for 3D Human Shape and Pose Estimation

Fine-Grained 3D Shape Classification With Hierarchical Part-View Attention