Abstract:Weakly supervised point cloud segmentation has garnered considerable interest recently, primarily due to its ability to diminish labor-intensive manual labeling costs. The effectiveness of such methods hinges on their ability to augment the supervision signals available for training implicitly. However, we found that most approaches tend to be implemented through complex modeling, which is not conducive to deployment and implementation in resource-poor scenarios. Our study introduces a novel scene consistency modeling approach that significantly enhances weakly supervised point cloud segmentation in this context. By synergistically modeling both complete and incomplete scenes, our method can improve the quality of the supervision signal and save more resources and ease of deployment in practical applications. To achieve this, we first generate the corresponding incomplete scene for the whole scene using windowing techniques. Next, we input the complete and incomplete scenes into a network encoder and obtain prediction results for each scene through two decoders. We enforce semantic consistency between the labeled and unlabeled data in the two scenes by employing cross-entropy and KL loss. This consistent modeling method enables the network to focus more on the same areas in both scenes, capturing local details and effectively increasing the supervision signals. One of the advantages of the proposed method is its simplicity and cost-effectiveness. Because we rely solely on variance and KL loss to model scene consistency, resulting in straightforward computations. Our experimental evaluations on S3DIS, ScanNet, and Semantic3D datasets provide further evidence that our method can effectively leverage sparsely labeled data and abundant unlabeled data to enhance supervision signals and improve the overall model performance.

Weakly Supervised 3D Segmentation Via Receptive-Driven Pseudo Label Consistency and Structural Consistency.

Weakly Supervised Point Cloud Semantic Segmentation Based on Scene Consistency

Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud

Weakly Supervised Semantic Segmentation for Point Clouds with Self-Purification on Pseudo Labels

A Survey on Weakly Supervised 3D Point Cloud Semantic Segmentation

Image Understands Point Cloud: Weakly Supervised 3D Semantic Segmentation via Association Learning

PointMatch: A Consistency Training Framework for Weakly Supervised Semantic Segmentation of 3D Point Clouds

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

3D Guided Weakly Supervised Semantic Segmentation

Weakly Supervised 3D Instance Segmentation without Instance-level Annotations

Weakly-Supervised Point Cloud Segmentation Combining Pseudo Label Generation and Noise Label Learning

Dense Supervision Propagation for Weakly Supervised Semantic Segmentation on 3D Point Clouds

Weakly Supervised Semantic Segmentation of Point Cloud Scenes Using Boundary-based Feature Aggregation

Mutual Positive and Negative Learning for Weakly-supervised Point Cloud Semantic Segmentation

Reliability-Adaptive Consistency Regularization for Weakly-Supervised Point Cloud Segmentation

Weakly Supervised Semantic Segmentation for Point Cloud Based on View-Based Adversarial Training and Self-Attention Fusion.

Weakly-Supervised Point Cloud Semantic Segmentation Based on Dilated Region

SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Clouds with 1000x Fewer Labels

Enhanced Pseudo-Label Generation with Self-supervised Training for Weakly-supervised Semantic Segmentation

Visual Boundary-Guided Pseudo-Labeling for Weakly Supervised 3D Point Cloud Segmentation in Indoor Environments

Densify Your Labels: Unsupervised Clustering with Bipartite Matching for Weakly Supervised Point Cloud Segmentation