Abstract:Weakly supervised point cloud semantic segmentation methods that require 1% or fewer labels with the aim of realizing almost the same performance as fully supervised approaches have recently attracted extensive research attention. A typical solution in this framework is to use self-training or pseudo-labeling to mine the supervision from the point cloud itself while ignoring the critical information from images. In fact, cameras widely exist in LiDAR scenarios, and this complementary information seems to be highly important for 3D applications. In this paper, we propose a novel cross-modality weakly supervised method for 3D segmentation that incorporates complementary information from unlabeled images. We design a dual-branch network equipped with an active labeling strategy to maximize the power of tiny parts of labels and to directly realize 2D-to-3D knowledge transfer. Afterward, we establish a cross-modal self-training framework, which iterates between parameter updating and pseudolabel estimation. In the training phase, we propose cross-modal association learning to mine complementary supervision from images by reinforcing the cycle consistency between 3D points and 2D superpixels. In the pseudolabel estimation phase, a pseudolabel self-rectification mechanism is derived to filter noisy labels, thus providing more accurate labels for the networks to be fully trained. The extensive experimental results demonstrate that our method even outperforms the state-of-the-art fully supervised competitors with less than 1% actively selected annotations.

A Probabilistic Associative Model For Segmenting Weakly Supervised Images

Probabilistic Graphlet Cut: Exploiting Spatial Structure Cue for Weakly Supervised Image Segmentation

Weak Supervision Learning for Object Co-Segmentation

Representative Discovery of Structure Cues for Weakly-Supervised Image Segmentation

Weakly Supervised Semantic Segmentation with a Multiscale Model

Weakly Supervised Semantic Segmentation for Social Images

Image Piece Learning for Weakly Supervised Semantic Segmentation

Learning Latent Stable Patterns for Image Understanding with Weak and Noisy Labels

Sparse Reconstruction for Weakly Supervised Semantic Segmentation.

Weakly-Supervised Semantic Segmentation by Iterative Affinity Learning

Associating Inter-Image Salient Instances For Weakly Supervised Semantic Segmentation

Image Understands Point Cloud: Weakly Supervised 3D Semantic Segmentation via Association Learning

Weakly Supervised 3D Segmentation Via Receptive-Driven Pseudo Label Consistency and Structural Consistency.

Supervised Image Segmentation Using Learning And Merging\

Weakly Supervised Segmentation Loss Based on Graph Cuts and Superpixel Algorithm

Weakly-supervised Semantic Segmentation with Superpixel Guided Local and Global Consistency

Mining Pixels: Weakly Supervised Semantic Segmentation Using Image Labels

Interactive Multilabel Image Segmentation Via Robust Multilayer Graph Constraints

Enhancing Weakly Supervised 3D Medical Image Segmentation through Probabilistic-aware Learning

Reliability Does Matter: an End-to-End Weakly Supervised Semantic Segmentation Approach

Weakly Supervised Multiclass Video Segmentation