Abstract:Few-shot point cloud 3D object detection (FS3D) aims to identify and localise objects of novel classes from point clouds, using knowledge learnt from annotated base classes and novel classes with very few annotations. Thus far, this challenging task has been approached using prototype learning, but the performance remains far from satisfactory. We find that in existing methods, the prototypes are only loosely constrained and lack of fine-grained awareness of the semantic and geometrical correlation embedded within the point cloud space. To mitigate these issues, we propose to leverage the inherent contrastive relationship within the semantic and geometrical subspaces to learn more refined and generalisable prototypical representations. To this end, we first introduce contrastive semantics mining, which enables the network to extract discriminative categorical features by constructing positive and negative pairs within training batches. Meanwhile, since point features representing local patterns can be clustered into geometric components, we further propose to impose contrastive relationship at the primitive level. Through refined primitive geometric structures, the transferability of feature encoding from base to novel classes is significantly enhanced. The above designs and insights lead to our novel Contrastive Prototypical VoteNet (CP-VoteNet). Extensive experiments on two FS3D benchmarks FS-ScanNet and FS-SUNRGBD demonstrate that CP-VoteNet surpasses current state-of-the-art methods by considerable margins across different FS3D settings. Further ablation studies conducted corroborate the rationale and effectiveness of our designs.

Enhanced Vote Network for 3D Object Detection in Point Clouds.

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Deep Hough Voting for 3D Object Detection in Point Clouds

S-VoteNet: Deep Hough Voting with Spherical Proposal for 3D Object Detection.

Dual-scale Point Cloud Completion Network Based on High-Frequency Feature Fusion

SSF: Sparse Point Cloud Object Detection Based on Self-Adaptive Voxel Encoding and Focal-Sparse Convolution

VENet: Voting Enhancement Network for 3D Object Detection

Multi-feature Fusion VoteNet for 3D Object Detection

REGNet: Ray-Based Enhancement Grouping for 3D Object Detection Based on Point Cloud

Refined Voting and Scene Feature Fusion for 3D Object Detection in Point Clouds

Efficient Indoor 3D Object Detection in Point Clouds Using the Kinect Sensor

3D Object Detection from Point Cloud via Voting Step Diffusion

CP-VoteNet: Contrastive Prototypical VoteNet for Few-Shot Point Cloud Object Detection

Vote-Based 3D Object Detection with Context Modeling and SOB-3DNMS

Canonical Voting: Towards Robust Oriented Bounding Box Detection in 3D Scenes

Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud

SOA: Seed point offset attention for indoor 3D object detection in point clouds

P2V-RCNN: Point to Voxel Feature Learning for 3D Object Detection From Point Clouds

Optimized CNNs for Rapid 3D Point Cloud Object Recognition

Transformer3D-Det: Improving 3D Object Detection by Vote Refinement

Neighbor-Vote: Improving Monocular 3D Object Detection through Neighbor Distance Voting