Abstract:Weakly supervised point cloud segmentation has garnered considerable interest recently, primarily due to its ability to diminish labor-intensive manual labeling costs. The effectiveness of such methods hinges on their ability to augment the supervision signals available for training implicitly. However, we found that most approaches tend to be implemented through complex modeling, which is not conducive to deployment and implementation in resource-poor scenarios. Our study introduces a novel scene consistency modeling approach that significantly enhances weakly supervised point cloud segmentation in this context. By synergistically modeling both complete and incomplete scenes, our method can improve the quality of the supervision signal and save more resources and ease of deployment in practical applications. To achieve this, we first generate the corresponding incomplete scene for the whole scene using windowing techniques. Next, we input the complete and incomplete scenes into a network encoder and obtain prediction results for each scene through two decoders. We enforce semantic consistency between the labeled and unlabeled data in the two scenes by employing cross-entropy and KL loss. This consistent modeling method enables the network to focus more on the same areas in both scenes, capturing local details and effectively increasing the supervision signals. One of the advantages of the proposed method is its simplicity and cost-effectiveness. Because we rely solely on variance and KL loss to model scene consistency, resulting in straightforward computations. Our experimental evaluations on S3DIS, ScanNet, and Semantic3D datasets provide further evidence that our method can effectively leverage sparsely labeled data and abundant unlabeled data to enhance supervision signals and improve the overall model performance.

Multi-modality Affinity Inference for Weakly Supervised 3D Semantic Segmentation

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

Learning Inter-Superpoint Affinity for Weakly Supervised 3D Instance Segmentation

Affinity3D: Propagating Instance-Level Semantic Affinity for Zero-Shot Point Cloud Semantic Segmentation

Image Understands Point Cloud: Weakly Supervised 3D Semantic Segmentation via Association Learning

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Weakly Supervised Point Cloud Semantic Segmentation Based on Scene Consistency

Weakly Supervised Point Cloud Segmentation Via Deep Morphological Semantic Information Embedding

PointMatch: A Consistency Training Framework for Weakly Supervised Semantic Segmentation of 3D Point Clouds

A Multi-scale Network for Semantic Segmentation of 3D Point Clouds

Learning Hybrid Semantic Affinity for Point Cloud Segmentation

Multistage Scene-Level Constraints for Large-Scale Point Cloud Weakly Supervised Semantic Segmentation.

Weakly Supervised Semantic Segmentation for Point Cloud Based on View-Based Adversarial Training and Self-Attention Fusion.

Multimodality Helps Few-Shot 3D Point Cloud Semantic Segmentation

Dense Supervision Propagation for Weakly Supervised Semantic Segmentation on 3D Point Clouds

Dual Adaptive Transformations for Weakly Supervised Point Cloud Segmentation

3D Guided Weakly Supervised Semantic Segmentation

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

Weakly Supervised 3D Instance Segmentation without Instance-level Annotations