Abstract:As a 3D counterpart of object classification in images, object point cloud classification is fundamental to 3D scene understanding, and has drawn great research attention since the release of benchmarking datasets, such as the ModelNet and the ShapeNet. These benchmarks assume point clouds covering complete surfaces of object instances, for which plenty of high-performing methods have been developed. However, their settings deviate from those often met in practice, where, due to (self-)occlusion, a point cloud covering partial surface of an object is captured from an arbitrary view. We show in this paper that performance of existing point cloud classification methods drops drastically under the considered practical single-view, partial setting; the phenomenon is consistent with the observation that semantic category of a partial object surface is less ambiguous only when its distribution on the whole surface is clearly specified. To this end, we argue for a single-view, partial setting where supervised learning of object pose estimation should be accompanied with classification. Technically, we propose a baseline method of Pose-Accompanied Point cloud classification Network (PAPNet); built upon SE(3)-equivariant convolutions, the PAPNet learns intermediate pose transformations for equivariant features defined on vector fields, which makes the subsequent classification easier (ideally) in the category-level, canonical pose. We adapt existing ModelNet40 and ScanNet datasets on point set classification to the introduced single-view, partial setting to verify our hypothesis. Thorough experiments confirm the necessity of object pose estimation; our PAPNet also outperforms existing methods greatly on the new benchmarks.

3D Object Classification on Partial Point Clouds: A Practical Perspective.

Classification of Single-View Object Point Clouds

A novel GCN-based point cloud classification model robust to pose variances

3D Object Classification with Point Convolution Network

A Point Cloud Classification Method Based on Channel and Spatial Attention Mechanism

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

P2C: Self-Supervised Point Cloud Completion from Single Partial Clouds

Triangle-Net: Towards Robustness in Point Cloud Learning

A Closer Look at Few-Shot 3D Point Cloud Classification

Multi-Head Attentional Point Cloud Classification and Segmentation Using Strictly Rotation-Invariant Representations

Deep Learning Based Pose Estimation Method Using 3D Point Clouds

Multi-Head Self-Attention for 3D Point Cloud Classification

CMNet: Component-Aware Matching Network for Few-Shot Point Cloud Classification

A Hierarchical Approach for Point Cloud Classification with 3D Contextual Features.

Attentional Keypoint Detection on Point Clouds for 3D Object Part Segmentation

Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud

MVPointNet: Multi-View Network for 3D Object Based on Point Cloud

CONTEXTUAL CLASSIFICATION OF POINT CLOUD DATA BY EXPLOITING INDIVIDUAL 3D NEIGBOURHOODS

What Makes for Effective Few-shot Point Cloud Classification?

EPiC: Ensemble of Partial Point Clouds for Robust Classification

Partial-to-Partial Point Cloud Registration Based on Multi-Level Semantic-Structural Cognition