Abstract:The proliferation of depth cameras and LiDAR sensors in actual industrial environments has fueled the pursuit of an effective and efficient 3D point cloud model that enables us to perceive and interact with the physical world. However, the intrinsic complexity of 3D semantic information poses significant challenges to model design, including spatial rotation invariance and irregular point cloud structure, which fundamentally impact the representation and behavior of 3D point cloud systems. Existing have either heavily relied on labeling information in a supervised learning setting or failed to effectively capture the inherent patterns of the 3D point clouds within a self-supervised learning framework, leading to poor performance in specific downstream tasks. To address these limitations, this paper introduces a self-supervised framework, D ual- C ross C ontrastive Neural N etwork (DCCN) for 3D point cloud self-supervised representation learning. DCCN leverages cross-view, cross-network, and domain-specific knowledge distillation to enhance the extraction of hidden features from point clouds and fully exploit the capabilities of the encoder. Our DCCN employs a pseudo-Siamese network consisting of an online network and a target network, facilitating knowledge interaction and distillation. The method extracts internal states from augmented 3D point cloud by learning cross-view relationships and optimizes model parameters through intra-modal cross-network learning. We incorporate a momentum-updating mechanism without shared weights in the Siamese network architecture to distill knowledge and enhance the role differentiation the online and target networks. Experimental results demonstrate that our approach outperforms a range of supervised and self-supervised learning methods across a series of downstream tasks consisting of four tasks in three representative datasets. Ablation studies validate the component-wise effectiveness of cross-view, cross-network, and moment-updating learning objectives in achieving superior point cloud representation. The overall findings establish our method, DCCN, as an effective solution for 3D point cloud representation learning in real-world applications.

Cascaded Network with Hierarchical Self-Distillation for Sparse Point Cloud Classification

Joint Learning for Scattered Point Cloud Understanding with Hierarchical Self-Distillation

Point Cloud Completion Cascade Optimization Network Based on Feature Fusion

Dual-scale Point Cloud Completion Network Based on High-Frequency Feature Fusion

Cascaded Non-local Neural Network for Point Cloud Semantic Segmentation

Point Cloud Upsampling via Cascaded Refinement Network

Completing Partial Point Clouds with Outliers by Collaborative Completion and Segmentation

Point Cloud Completion by Skip-attention Network with Hierarchical Folding

Multistage Adaptive Point-Growth Network for Dense Point Cloud Completion

Incorporating Handcrafted Features into Deep Learning for Point Cloud Classification

Hierarchical Aggregated Deep Features for ALS Point Cloud Classification

Snowflake Point Deconvolution for Point Cloud Completion and Generation With Skip-Transformer

Collaborative Completion and Segmentation for Partial Point Clouds with Outliers.

3D Cascade RCNN: High Quality Object Detection in Point Clouds

Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations.

Using Multi-Scale and Hierarchical Deep Convolutional Features for 3D Semantic Classification of TLS Point Clouds.

Stage-Aware Interaction Network for Point Cloud Completion

CP-Net: Contour-Perturbed Reconstruction Network for Self-Supervised Point Cloud Learning

Self-Prediction for Joint Instance and Semantic Segmentation of Point Clouds

DCCN: A dual-cross contrastive neural network for 3D point cloud representation learning

Learning Latent Part-Whole Hierarchies for Point Clouds