Abstract:Despite the significant growth in the availability of 3D light detection and ranging (LiDAR) point cloud data in recent years, annotation remains expensive and time-consuming. This has led to an increasing demand for weakly-supervised semantic segmentation (WSSS) methods in applications such as autonomous driving, mapping, and robotics. Existing approaches typically rely solely on LiDAR point cloud data for WSSS, which often results in lower segmentation accuracy due to the sparsity of point clouds. To address these challenges, we propose a novel architecture, PPDistiller, which employs multiple teacher networks from different modalities. Compared to other WSSS and multimodal approaches, PPDistiller achieves superior segmentation accuracy with fewer annotations. This is facilitated through the novel Mean Multi-Teacher Framework (MMT), which incorporates multiple modalities and teachers. To address the issue of lacking 2D labels, we propose the Distance-CAM Self-Training (DCAM-ST) module, which utilizes sparse 3D weak annotations to produce accurate 2D pixel-level annotations. To enable adaptive fusion of 2D and 3D data, we introduce the Attention Point to Pixel Fusion (APPF) module, facilitating bidirectional transfer of cross-modal knowledge. Additionally, to fully leverage the spatial semantic information in point cloud, we propose the Pyramid Semantic-context Neighbor Aggregation (PSNA) module, aiming to exploit spatial and semantic correlations to improve performance. Extensive experimentation on SemanticKITTI, ScribbleKITTI and nuScenes datasets demonstrates the superiority of our proposed method. Compared to state-of-the-art fusion and weakly-supervised methods, PPDistiller achieves the highest mean Intersection over Union (mIoU) scores under both fully-supervised and weakly-supervised settings.

PRRD: Pixel-Region Relation Distillation for Efficient Semantic Segmentation

Local structure consistency and pixel-correlation distillation for compact semantic segmentation

Adaptive Perspective Distillation for Semantic Segmentation

Channel Correlation Distillation for Compact Semantic Segmentation

Difference-Aware Distillation for Semantic Segmentation

Intra-class Feature Variation Distillation for Semantic Segmentation

MTED: Multiple Teachers Ensemble Distillation for Compact Semantic Segmentation

PPDistiller: Weakly-supervised 3D point cloud semantic segmentation framework via point-to-pixel distillation

Distilling Inter-Class Distance for Semantic Segmentation

Double Similarity Distillation for Semantic Image Segmentation

Multi-Granularity Distillation Scheme Towards Lightweight Semi-Supervised Semantic Segmentation

Relative Difficulty Distillation for Semantic Segmentation

Normalized Feature Distillation for Semantic Segmentation

Multi-view knowledge distillation for efficient semantic segmentation

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

Augmentation-free Dense Contrastive Distillation for Efficient Semantic Segmentation

Spirit Distillation: Precise Real-time Semantic Segmentation of Road Scenes with Insufficient Data

Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition

Depth Removal Distillation for RGB-D Semantic Segmentation

Channel Affinity Knowledge Distillation for Semantic Segmentation