Abstract:The proliferation of depth cameras and LiDAR sensors in actual industrial environments has fueled the pursuit of an effective and efficient 3D point cloud model that enables us to perceive and interact with the physical world. However, the intrinsic complexity of 3D semantic information poses significant challenges to model design, including spatial rotation invariance and irregular point cloud structure, which fundamentally impact the representation and behavior of 3D point cloud systems. Existing have either heavily relied on labeling information in a supervised learning setting or failed to effectively capture the inherent patterns of the 3D point clouds within a self-supervised learning framework, leading to poor performance in specific downstream tasks. To address these limitations, this paper introduces a self-supervised framework, D ual- C ross C ontrastive Neural N etwork (DCCN) for 3D point cloud self-supervised representation learning. DCCN leverages cross-view, cross-network, and domain-specific knowledge distillation to enhance the extraction of hidden features from point clouds and fully exploit the capabilities of the encoder. Our DCCN employs a pseudo-Siamese network consisting of an online network and a target network, facilitating knowledge interaction and distillation. The method extracts internal states from augmented 3D point cloud by learning cross-view relationships and optimizes model parameters through intra-modal cross-network learning. We incorporate a momentum-updating mechanism without shared weights in the Siamese network architecture to distill knowledge and enhance the role differentiation the online and target networks. Experimental results demonstrate that our approach outperforms a range of supervised and self-supervised learning methods across a series of downstream tasks consisting of four tasks in three representative datasets. Ablation studies validate the component-wise effectiveness of cross-view, cross-network, and moment-updating learning objectives in achieving superior point cloud representation. The overall findings establish our method, DCCN, as an effective solution for 3D point cloud representation learning in real-world applications.

CEDR: Contrastive Embedding Distribution Refinement for 3D point cloud representation

DCCN: A dual-cross contrastive neural network for 3D point cloud representation learning

EFECL: Feature encoding enhancement with contrastive learning for indoor 3D object detection

A Unified Framework for 3D Point Cloud Visual Grounding

Concavity-Induced Distance for Unoriented Point Cloud Decomposition

FEATURE RELEVANCE ANALYSIS FOR 3D POINT CLOUD CLASSIFICATION USING DEEP LEARNING

D3Feat: Joint Learning of Dense Detection and Description of 3D Local Features

DeepPoint3D: Learning discriminative local descriptors using deep metric learning on 3D point clouds

Three-Dimensional Point Cloud Object Detection Based on Feature Fusion and Enhancement

Encoding Discriminative Representation for Point Cloud Semantic Segmentation

Feature extraction and representation learning of 3D point cloud data

Edge-based feature extraction module for 3D point cloud shape classification

Diffusion unit: Interpretable edge enhancement and suppression learning for 3D point cloud segmentation

CBF-Net: An Adaptive Context Balancing and Feature Filtering Network for Point Cloud Classification

PointMCD: Boosting Deep Point Cloud Encoders via Multi-view Cross-modal Distillation for 3D Shape Recognition

D-Net: Learning for distinctive point clouds by self-attentive point searching and learnable feature fusion

A Closer Look at Few-Shot 3D Point Cloud Classification

D3Former: Jointly Learning Repeatable Dense Detectors and Feature-enhanced Descriptors via Saliency-guided Transformer

Distillation with Contrast is All You Need for Self-Supervised Point Cloud Representation Learning

ULD-Net: 3D unsupervised learning by dense similarity learning with equivariant-crop

TriCI: Triple Cross-Intra Branch Contrastive Learning for Point Cloud Analysis