Abstract:As an important field of multimedia, 3D shape recognition has attracted much research attention in recent years. A lot of deep learning models have been proposed for effective 3D shape representation. The view-based methods show the superiority due to the comprehensive exploration of the visual characteristics with the help of established 2D CNN architectures. Generally, the current approaches contain the following disadvantages: First, the most majority of methods lack the consideration for sequential information among the multiple views, which can provide descriptive characteristics for shape representation. Second, the incomprehensive exploration for the multi-view correlations directly affects the discrimination of shape descriptors. Finally, roughly aggregating multi-view features leads to the loss of descriptive information, which limits the shape representation effectiveness. To handle these issues, we propose a novel sequential view based hierarchical attention network (SVHAN) for 3D shape recognition. Specifically, we first divide the view sequence into several view blocks. Then, we introduce a novel hierarchical feature aggregation module (HFAM), which hierarchically exploits the view-level, block-level, and shapelevel features, the intra- and inter- view-block correlations are also captured to improve the discrimination of learned features. Subsequently, a novel selective fusion module (SFM) is designed for feature aggregation, considering the correlations between different levels and preserving effective information. Finally, discriminative and informative shape descriptors are generated for the recognition task. We validate the effectiveness of our proposed method on two public databases. The experimental results show the superiority of SVHAN against the current state-of-the-art approaches.

SeqViews2SeqLabels: Learning 3D Global Features via Aggregating Sequential Views by RNN With Attention.

3D2seqviews: Aggregating Sequential Views for 3D Global Feature Learning by CNN with Hierarchical Attention Aggregation

3Dviewgraph: Learning Global Features for 3D Shapes from A Graph of Unordered Views with Attention

View-Aware Geometry-Structure Joint Learning for Single-View 3D Shape Reconstruction

Recurrent Aggregation Learning for Multi-View Echocardiographic Sequences Segmentation

SVHAN: Sequential View Based Hierarchical Attention Network for 3D Shape Recognition.

Multi-view Rank Pooling for 3D Object Recognition*.

Point2Sequence: Learning the Shape Representation of 3D Point Clouds with an Attention-Based Sequence to Sequence Network.

Y2Seq2Seq: Cross-Modal Representation Learning for 3D Shape and Text by Joint Reconstruction and Prediction of View and Word Sequences.

Deeply Exploiting Long-Term View Dependency For 3d Shape Recognition

Parts4Feature: Learning 3D Global Features from Generally Semantic Parts in Multiple Views

Learning the Global Descriptor for 3-D Object Recognition Based on Multiple Views Decomposition

View Inter-Prediction GAN: Unsupervised Representation Learning for 3D Shapes by Learning Global Shape Memories to Support Local View Predictions.

Multi-Angle Point Cloud-VAE: Unsupervised Feature Learning for 3D Point Clouds from Multiple Angles by Joint Self-Reconstruction and Half-to-Half Prediction

View-aligned Pixel-Level Feature Aggregation for 3D Shape Classification

Learning Multi-View Representation with LSTM for 3-D Shape Recognition and Retrieval

VFMVAC: View-filtering-based Multi-View Aggregating Convolution for 3D Shape Recognition and Retrieval

Dynamic View Aggregation for Multi-View 3D Shape Recognition

View Sequence Prediction GAN: Unsupervised Representation Learning for 3D Shapes by Decomposing View Content and Viewpoint Variance

Emphasizing 3D Properties in Recurrent Multi-View Aggregation for 3D Shape Retrieval.

Hierarchical View Predictor: Unsupervised 3D Global Feature Learning Through Hierarchical Prediction among Unordered Views.