Abstract:As a 3D counterpart of object classification in images, object point cloud classification is fundamental to 3D scene understanding, and has drawn great research attention since the release of benchmarking datasets, such as the ModelNet and the ShapeNet. These benchmarks assume point clouds covering complete surfaces of object instances, for which plenty of high-performing methods have been developed. However, their settings deviate from those often met in practice, where, due to (self-)occlusion, a point cloud covering partial surface of an object is captured from an arbitrary view. We show in this paper that performance of existing point cloud classification methods drops drastically under the considered practical single-view, partial setting; the phenomenon is consistent with the observation that semantic category of a partial object surface is less ambiguous only when its distribution on the whole surface is clearly specified. To this end, we argue for a single-view, partial setting where supervised learning of object pose estimation should be accompanied with classification. Technically, we propose a baseline method of Pose-Accompanied Point cloud classification Network (PAPNet); built upon SE(3)-equivariant convolutions, the PAPNet learns intermediate pose transformations for equivariant features defined on vector fields, which makes the subsequent classification easier (ideally) in the category-level, canonical pose. We adapt existing ModelNet40 and ScanNet datasets on point set classification to the introduced single-view, partial setting to verify our hypothesis. Thorough experiments confirm the necessity of object pose estimation; our PAPNet also outperforms existing methods greatly on the new benchmarks.

Triangle-Net: Towards Robustness in Point Cloud Learning

Improving Adversarial Robustness of 3D Point Cloud Classification Models

A novel GCN-based point cloud classification model robust to pose variances

Rethinking Local-to-global Representation Learning for Rotation-Invariant Point Cloud Analysis

ClusterNet: Deep Hierarchical Cluster Network with Rigorously Rotation-Invariant Representation for Point Cloud Analysis

Rotation-Invariant Point Cloud Representation for 3-D Model Recognition

SRINet: Learning Strictly Rotation-Invariant Representations for Point Cloud Classification and Segmentation

Multi-Head Attentional Point Cloud Classification and Segmentation Using Strictly Rotation-Invariant Representations

POIRot: A rotation invariant omni-directional pointnet

A Rotation-Invariant Framework for Deep Point Cloud Analysis

MInet: A Novel Network Model for Point Cloud Processing by Integrating Multi-Modal Information

CAP: Robust Point Cloud Classification Via Semantic and Structural Modeling.

Robust 3D Point Cloud Recognition: Enhancing Robustness with GPT-4 and CLIP Integration

DCNet: Exploring Fine-Grained Vision Classification for 3D Point Clouds

3D Object Classification on Partial Point Clouds: A Practical Perspective.

3DTI-Net: Learn Inner Transform Invariant 3D Geometry Features using Dynamic GCN.

3Dti-Net: Learn 3D Transform-Invariant Feature Using Hierarchical Graph CNN

Point Cloud Classification by Dynamic Graph CNN with Adaptive Feature Fusion.

Sparse-to-Dense Point Cloud Registration Based on Rotation-Invariant Features

PCRNet: Point Cloud Registration Network using PointNet Encoding

SMCNet: State-Space Model for Enhanced Corruption Robustness in 3D Classification