Abstract:Recently, there has been a significant interest in performing convolution over irregularly sampled point clouds. Since point clouds are very different from regular raster images, it is imperative to study the generalization of the convolution networks more closely, especially their robustness under variations in scale and rotations of the input data. This paper investigates different variants of PointConv, a convolution network on point clouds, to examine their robustness to input scale and rotation changes. Of the variants we explored, two are novel and generated significant improvements. The first is replacing the multilayer perceptron based weight function with much simpler third degree polynomials, together with a Sobolev norm regularization. Secondly, for 3D datasets, we derive a novel viewpoint-invariant descriptor by utilizing 3D geometric properties as the input to PointConv, in addition to the regular 3D coordinates. We have also explored choices of activation functions, neighborhood, and subsampling methods. Experiments are conducted on the 2D MNIST & CIFAR-10 datasets as well as the 3D SemanticKITTI & ScanNet datasets. Results reveal that on 2D, using third degree polynomials greatly improves PointConv's robustness to scale changes and rotations, even surpassing traditional 2D CNNs for the MNIST dataset. On 3D datasets, the novel viewpoint-invariant descriptor significantly improves the performance as well as robustness of PointConv. We achieve the state-of-the-art semantic segmentation performance on the SemanticKITTI dataset, as well as comparable performance with the current highest framework on the ScanNet dataset among point-based approaches.

Spherical Interpolated Convolutional Network With Distance-Feature Density for 3-D Semantic Segmentation of Point Clouds

Spherical Interpolated Convolutional Network with Distance-Feature Density for 3D Semantic Segmentation of Point Clouds

Pass3d: Precise And Accelerated Semantic Segmentation For 3d Point Cloud

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Interpolated Convolutional Networks for 3D Point Cloud Understanding

Semantic Segmentation of 3D Point Clouds Based on High Precision Range Search Network

Three-Dimensional Point Cloud Semantic Segmentation Network Based on Spatial Graph Convolution Network

Spherical Frustum Sparse Convolution Network for LiDAR Point Cloud Semantic Segmentation

Dilated Nearest-Neighbor Encoding for 3D Semantic Segmentation of Point Clouds

Hierarchical Depthwise Graph Convolutional Neural Network for 3D Semantic Segmentation of Point Clouds

SWCF-Net: Similarity-weighted Convolution and Local-global Fusion for Efficient Large-scale Point Cloud Semantic Segmentation

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perception

DPC-Net: Distributed Point Convolution Network for large-scale point clouds semantic segmentation

Semantic segmentation of large-scale point clouds based on dilated nearest neighbors graph

The Devils in the Point Clouds: Studying the Robustness of Point Cloud Convolutions

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

Exploring Spatial Context for 3D Semantic Segmentation of Point Clouds