Abstract:Recently, there has been a significant interest in performing convolution over irregularly sampled point clouds. Since point clouds are very different from regular raster images, it is imperative to study the generalization of the convolution networks more closely, especially their robustness under variations in scale and rotations of the input data. This paper investigates different variants of PointConv, a convolution network on point clouds, to examine their robustness to input scale and rotation changes. Of the variants we explored, two are novel and generated significant improvements. The first is replacing the multilayer perceptron based weight function with much simpler third degree polynomials, together with a Sobolev norm regularization. Secondly, for 3D datasets, we derive a novel viewpoint-invariant descriptor by utilizing 3D geometric properties as the input to PointConv, in addition to the regular 3D coordinates. We have also explored choices of activation functions, neighborhood, and subsampling methods. Experiments are conducted on the 2D MNIST & CIFAR-10 datasets as well as the 3D SemanticKITTI & ScanNet datasets. Results reveal that on 2D, using third degree polynomials greatly improves PointConv's robustness to scale changes and rotations, even surpassing traditional 2D CNNs for the MNIST dataset. On 3D datasets, the novel viewpoint-invariant descriptor significantly improves the performance as well as robustness of PointConv. We achieve the state-of-the-art semantic segmentation performance on the SemanticKITTI dataset, as well as comparable performance with the current highest framework on the ScanNet dataset among point-based approaches.

3D Object Classification with Point Convolution Network

Continuous Volumetric Convolution Network with Self-Learning Kernels for Point Clouds

3D Point Cloud Classification Method Based on Multiple Attention Mechanism and Dynamic Graph Convolution

Point Cloud-Based 3D Object Classification With Non Local Attention and Lightweight Convolution Neural Networks

3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification

A novel GCN-based point cloud classification model robust to pose variances

Point Convolutional Neural Networks by Extension Operators

DGCB-Net: Dynamic Graph Convolutional Broad Network for 3D Object Recognition in Point Cloud

A 3D Point Cloud Classification Method Based on Adaptive Graph Convolution and Global Attention

Dual-Graph Attention Convolution Network for 3-D Point Cloud Classification

Multi-Head Self-Attention for 3D Point Cloud Classification

Point-GN: A Non-Parametric Network Using Gaussian Positional Encoding for Point Cloud Classification

NPTC-net: Narrow-Band Parallel Transport Convolutional Neural Networks on Point Clouds

A Graph-CNN for 3D Point Cloud Classification

DPC-Net: Distributed Point Convolution Network for large-scale point clouds semantic segmentation

Multi-view attention-convolution pooling network for 3D point cloud classification

NPTC-net: Narrow-Band Parallel Transport Convolutional Neural Network on Point Clouds

The Devils in the Point Clouds: Studying the Robustness of Point Cloud Convolutions

Classification Model of 3D Point Cloud Based on Linked Adaptive Graph Convolution

Optimized CNNs for Rapid 3D Point Cloud Object Recognition

3D Point Cloud Classification Segmentation Model Based on Improved PointNet++