Abstract:With the widespread success of deep learning in the two-dimensional field, how to apply deep learning methods from two-dimensional to three-dimensional field has become a current research hotspot. Among them, the polygon mesh structure in the three-dimensional representation as a complex data structure provides an effective shape approximate representation for the three-dimensional object. Although the traditional method can extract the characteristics of the three-dimensional object through the graphical method, it cannot be applied to more complex objects. However, due to the complexity and irregularity of the mesh data, it is difficult to directly apply convolutional neural networks to 3D mesh data processing. Considering this problem, we propose a deep learning method based on a capsule network to effectively classify mesh data. We first design a polynomial convolution template. Through a sliding operation similar to a two-dimensional image convolution window, we directly sample on the grid surface, and use the window sampling surface as the minimum unit of calculation. Because a high-order polynomial can effectively represent a surface, we fit the approximate shape of the surface through the polynomial, use the polynomial parameter as the shape feature of the surface, and add the center point coordinates and normal vector of the surface as the pose feature of the surface. The feature is used as the feature vector of the surface. At the same time, to solve the problem of the introduction of a large number of pooling layers in traditional convolutional neural networks, the capsule network is introduced. For the problem of nonuniform size of the input grid model, the capsule network attitude parameter learning method is improved by sharing the weight of the attitude matrix. The amount of model parameters is reduced, and the training efficiency of the 3D mesh model is further improved. The experiment is compared with the traditional method and the latest two methods on the SHREC15 data set. Compared with the MeshNet and MeshCNN, the average recognition accuracy in the original test set is improved by 3.4% and 2.1%, and the average after fusion of features the accuracy reaches 93.8%. At the same time, under the premise of short training time, this method can also achieve considerable recognition results through experimental verification. The three-dimensional mesh classification method proposed in this paper combines the advantages of graphics and deep learning methods, and effectively improves the classification effect of 3D mesh model.

Feature-preserved Convolutional Neural Network for 3D Mesh Recognition

MixFormer: A Self-Attentive Convolutional Network for 3D Mesh Object Recognition.

3D Mesh Model Classification with a Capsule Network

3D Mesh Labeling Via Deep Convolutional Neural Networks

MeshNet: Mesh Neural Network for 3D Shape Representation

A task-driven network for mesh classification and semantic part segmentation

A Deep Learning Approach to Mesh Segmentation

Mesh Convolutional Restricted Boltzmann Machines for Unsupervised Learning of Features With Structure Preservation on 3-D Meshes.

Face Recognition on 3D Point Clouds

Mesh Convolution: A Novel Feature Extraction Method for 3D Nonrigid Object Classification

Dense Graph Convolutional Neural Networks on 3D Meshes for 3D Object Segmentation and Classification

FatNet: A Feature-attentive Network for 3D Point Cloud Processing

A feature fusion-based attention graph convolutional network for 3D classification and segmentation

Self-Parameterization Based Multi-Resolution Mesh Convolution Networks

DMNet: Delaunay Meshing Network for 3D Shape Representation

PAI-GCN: Permutable Anisotropic Graph Convolutional Networks for 3D Shape Representation Learning.

MDSSN: an End-to-end Deep Network on Triangle Mesh Parameterization

An improved fused feature residual network for 3D point cloud data

Mesh-Based DGCNN: Semantic Segmentation of Textured 3-D Urban Scenes

DGCB-Net: Dynamic Graph Convolutional Broad Network for 3D Object Recognition in Point Cloud

Multi-channel Deep 3D Face Recognition