Abstract:Effective representation of objects in irregular and unordered point clouds is one of the core challenges in 3D vision. Transforming point cloud into regular structures, such as 2D images and 3D voxels, are not ideal. It either obscures the inherent geometry information of 3D data or results in high computational complexity. Learning permutation invariance feature directly from raw 3D point clouds using deep neural network is a trend, such as PointNet and its variants, which are effective and computationally efficient. However, these methods are weak to reveal the spatial structure of 3D point clouds. Our method is delicately designed to capture both global and local spatial layout of point cloud by proposing a Local k-NNs Pattern in Omni-Direction Graph Convolution Neural Network architecture, called LKPO-GNN. Our method converts the unordered 3D point cloud into an ordered 1D sequence, to facilitate feeding the raw data into neural networks and simultaneously reducing the computational complexity. LKPO-GNN selects multi-directional k-NNs to form the local topological structure of a centroid, which describes local shapes in the point cloud. Afterwards, GNN is used to combine the local spatial structures and represent the unordered point clouds as a global graph. Experiments on ModelNet40, ShapeNetPart, ScanNet, and S3DIS datasets demonstrate that our proposed method outperforms most existing methods, which verifies the effectiveness and advantage of our work. Additionally, a deep analysis towards illustrating the rationality of our approach, in terms of the learned the topological structure feature, is provided. Source code is available at https://github.com/zwj12377/LKPO-GNN.git.

Shape-Oriented Convolution Neural Network for Point Cloud Analysis

Learning Point Cloud Shapes with Geometric and Topological Structures.

Global Context Aware Convolutions for 3D Point Cloud Understanding

Rethinking Local-to-global Representation Learning for Rotation-Invariant Point Cloud Analysis

Learning Discriminative Features by Covering Local Geometric Space for Point Cloud Analysis.

Learning Polynomial-Based Separable Convolution for 3D Point Cloud Analysis.

Interpolated Convolutional Networks for 3D Point Cloud Understanding

PointConv: Deep Convolutional Networks on 3D Point Clouds

DensePoint: Learning Densely Contextual Representation for Efficient Point Cloud Processing

Hierarchical Shape-Consistent Transformer for Unsupervised Point Cloud Shape Correspondence

Point-based Attention Convolutional Neural Networks for Point Clouds Semantic Segmentation

A Registration Method for 3D Point Clouds with Convolutional Neural Network.

Local K-Nns Pattern in Omni-Direction Graph Convolution Neural Network for 3D Point Clouds

Dynamic Graph CNN for Learning on Point Clouds

ShellNet: Efficient Point Cloud Convolutional Neural Networks using Concentric Shells Statistics

Adaptive Graph Convolution for Point Cloud Analysis

The Devils in the Point Clouds: Studying the Robustness of Point Cloud Convolutions

PointDoN: A Shape Pattern Aggregation Module for Deep Learning on Point Cloud.

LSPConv: local spatial projection convolution for point cloud analysis

Learnable-graph Convolutional Neural Network for Point Cloud Analysis

PAI-Conv: Permutable Anisotropic Convolutional Networks for Learning on Point Clouds