Abstract:Abstract. Semantic segmentation of point clouds is one of the fundamental tasks of point cloud processing and is the basis for other downstream tasks. Deep learning has become the main method to solve point cloud processing. Most existing 3D deep learning models require large amounts of point cloud data to drive them, but annotating the data requires significant time and economic costs. To address the problem of semantic segmentation requiring large amounts of annotated data for training, this paper proposes a Super-point-level and Point-level Dual-scale Contrast learning network (SPDC). To solve the problem that contrastive learning is difficult to train and feature extraction is not sufficient, we introduce super-point maps to assist the network in feature extraction. We use a pre-trained super-point generation network to convert the original point cloud into a super-point map. A dynamic data augmentation(DDA) module is designed for the super-point maps for super-point-level contrastive learning. We map the extracted super-point-level features back to the original point-level scale and conduct secondary contrastive learning with the original point features. The whole feature extraction network is parameter sharing and to reduce the number of parameters we used the lightweight network DGCNN (encoder)+Self-attention as the backbone network. And we did a few-shot pre-training of the backbone network to make the network converge easily. Analogous to CutMix, we designed a new method for point cloud data augmentation called PointObjectMix (POM). This method solves the sample imbalance problem while preserving the overall characteristics of the objects in the scene. We conducted experiments on the S3DIS dataset and obtained 63.3% mIoU. We have also done a large number of ablation experiments to verify the effectiveness of the modules in our method. Experimental results show that our method outperforms the best-unsupervised network available.

Two-Stage Relation Constraint for Semantic Segmentation of Point Clouds

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

A Large-Scale Point Cloud Semantic Segmentation Network Via Local Dual Features and Global Correlations

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

A Multi-scale Network for Semantic Segmentation of 3D Point Clouds

Exploring Dual Representations in Large-Scale Point Clouds: A Simple Weakly Supervised Semantic Segmentation Framework

Semantic Segmentation of Point Cloud Scene via Multi-Scale Feature Aggregation and Adaptive Fusion

SPDC: A SUPER-POINT AND POINT COMBINING BASED DUAL-SCALE CONTRASTIVE LEARNING NETWORK FOR POINT CLOUD SEMANTIC SEGMENTATION

Encoding Discriminative Representation for Point Cloud Semantic Segmentation

Attention-based relation and context modeling for point cloud semantic segmentation.

Feature Graph Convolution Network With Attentive Fusion for Large-Scale Point Clouds Semantic Segmentation

A Structural-Constraint 3D Point Clouds Segmentation Adversarial Method

PointNest: Learning Deep Multiscale Nested Feature Propagation for Semantic Segmentation of 3-D Point Clouds

Dual fusion network for semantic segmentation of point clouds

Multi-Scale Superpoint Network for 3D Point Cloud Semantic Segmentation.

Self-Prediction for Joint Instance and Semantic Segmentation of Point Clouds

Push-the-Boundary: Boundary-aware Feature Propagation for Semantic Segmentation of 3D Point Clouds

Associatively Segmenting Instances and Semantics in Point Clouds

Mining Local Geometric Structure for Large-Scale 3D Point Clouds Semantic Segmentation