Abstract:Extracting local features from 3D shapes is an important and challenging task that usually requires carefully designed 3D shape descriptors. However, these descriptors are hand-crafted and require intensive human intervention with prior knowledge. To tackle this issue, we propose a novel deep learning model, namely circle convolutional restricted Boltzmann machine (CCRBM), for unsupervised 3D local feature learning. CCRBM is specially designed to learn from raw 3D representations. It effectively overcomes obstacles such as irregular vertex topology, orientation ambiguity on the 3D surface, and rigid or slightly non-rigid transformation invariance in the hierarchical learning of 3D data that cannot be resolved by the existing deep learning models. Specifically, by introducing the novel circle convolution, CCRBM holds a novel ring-like multi-layer structure to learn 3D local features in a structure preserving manner. Circle convolution convolves across 3D local regions via rotating a novel circular sector convolution window in a consistent circular direction. In the process of circle convolution, extra points are sampled in each 3D local region and projected onto the tangent plane of the center of the region. In this way, the projection distances in each sector window are employed to constitute a novel local raw 3D representation called projection distance distribution (PDD). In addition, to eliminate the initial location ambiguity of a sector window, the Fourier transform modulus is used to transform the PDD into the Fourier domain, which is then conveyed to CCRBM. Experiments using the learned local features are conducted on three aspects: global shape retrieval, partial shape retrieval, and shape correspondence. The experimental results show that the learned local features outperform other state-of-the-art 3D shape descriptors.

Mesh Convolutional Restricted Boltzmann Machines for Unsupervised Learning of Features With Structure Preservation on 3-D Meshes.

Mesh Convolution: A Novel Feature Extraction Method for 3D Nonrigid Object Classification

Deep Spatiality: Unsupervised Learning of Spatially-Enhanced Global and Local 3D Features by Deep Neural Network With Coupled Softmax.

Unsupervised Learning of 3-D Local Features from Raw Voxels Based on a Novel Permutation Voxelization Strategy

Robust Mesh Representation Learning Via Efficient Local Structure-Aware Anisotropic Convolution

Unsupervised 3D Local Feature Learning by Circle Convolutional Restricted Boltzmann Machine.

A Unified Feature Representation and Learning Framework for 3D Shape

Local Deep Feature Learning Framework for 3D Shape.

Learning Local Neighboring Structure for Robust 3D Shape Representation

MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Model

MeshNet: Mesh Neural Network for 3D Shape Representation

MixFormer: A Self-Attentive Convolutional Network for 3D Mesh Object Recognition.

MeshCL: Towards robust 3D mesh analysis via contrastive learning

Vis2Mesh: Efficient Mesh Reconstruction from Unstructured Point Clouds of Large Scenes with Learned Virtual View Visibility

Unsupervised Learning of Fine Structure Generation for 3D Point Clouds by 2D Projection Matching

SpaceMesh: A Continuous Representation for Learning Manifold Surface Meshes

Semi-Supervised Mesh Segmentation and Labeling

Multi-Angle Point Cloud-VAE: Unsupervised Feature Learning for 3D Point Clouds from Multiple Angles by Joint Self-Reconstruction and Half-to-Half Prediction

Self-Supervised Learning for Multimodal Non-Rigid 3D Shape Matching

Unsupervised Representation Learning for Diverse Deformable Shape Collections

MeshMVS: Multi-View Stereo Guided Mesh Reconstruction