Abstract:Representing valuable semantics in irregular 3-D point clouds with spatial-variant relationships is challenging. Current shared/weighted point convolution methods have limited efficiency and struggle to represent distinctive weight matrices precisely. In thisarticle, we present guided convolution (GuidedConv) operation, a plug-and-play point convolution operator for 3-D point cloud analysis. Compared to existing point convolution methods, GuidedConv implements a guided-share method for the weight matrices, which dynamically assigns corresponding weight matrices to points depending on their local spatial relationships without increasing the kernels in a brute-force way or equipping sophisticated auxiliary networks. The key of GuidedConv is to dynamically assigns weight matrices generated by kernel base to the points according to a guided mask, which is learned adaptively from the spatial relationships of 3-D point clouds in a data-driven manner. Guided masks establish a one-of-a-kind correspondence between the weight matrices and the points. In this way, GuidedConv possesses powerful capabilities to characterize different semantics and is more efficient and precise than current point convolution operators. Extensive qualitative and quantitative evaluations clearly show integrating GuidedConv into several relatively typical networks without modifying configurations to achieve on-par or better performances than state-of-the-art point cloud classification and segmentation methods on several benchmark datasets. Thorough ablation studies and visualizations demonstrate the flexibility and effectiveness of GuidedConv.

Adaptive Surface Fitting Convolution for 3D Point Cloud Analysis

Continuous Volumetric Convolution Network with Self-Learning Kernels for Point Clouds

Adaptive Recurrent Forward Network for Dense Point Cloud Completion

Adaptive Graph Convolution for Point Cloud Analysis

AGConv: Adaptive Graph Convolution on 3D Point Clouds

Learning Local Contextual Features for 3D Point Clouds Semantic Segmentation by Attentive Kernel Convolution

Multi-scale Adaptive Atrous Graph Convolution for Point Cloud Analysis

DANet: Density Adaptive Convolutional Network with Interactive Attention for 3D Point Clouds

PointConv: Deep Convolutional Networks on 3D Point Clouds

Convolutional neural networks with hybrid weights for 3D point cloud classification

3D Adaptive Structural Convolution Network for Domain-Invariant Point Cloud Recognition

Global Context Aware Convolutions for 3D Point Cloud Understanding

Adapt PointFormer: 3D Point Cloud Analysis via Adapting 2D Visual Transformers

Dynamic Graph CNN for Learning on Point Clouds

Point Cloud Classification by Dynamic Graph CNN with Adaptive Feature Fusion.

DSACNN: Dynamically Local Self-Attention CNN for 3D Point Cloud Analysis.

Adaptive Guided Convolution Generated with Spatial Relationships for Point Clouds Analysis

PointFusionNet: Point Feature Fusion Network for 3D Point Clouds Analysis

Interpolated Convolutional Networks for 3D Point Cloud Understanding

A 3D Point Cloud Classification Method Based on Adaptive Graph Convolution and Global Attention