Abstract:RGB thermal semantic segmentation facilitates unmanned platforms to perceive and characterize their surrounding environment, which is critical for autonomous driving tasks. Deep-learning-based algorithms have achieved dominance in terms of accuracy and robustness. However, their large parameter sizes and significant computational demands impede their application in terminal devices. To address this challenge, we propose a novel strategy for achieving a balance between effectiveness and compactness. It includes a robust teacher network, CLNet-T, and a streamlined student network, CLNet-S. Using knowledge distillation (KD), we obtained an optimized model called CLNet-S*. Specifically, CLNet-T and CLNet-S were identical in all aspects except for the feature extraction component. They included a multi-attribute hierarchical feature interaction module (MHFI) and a detail-guided semantic decoder (DGSD). The MHFI initially filters features by considering the characteristics of the low- and high-level features. It gradually combines complementary and common features from various modalities in distinct receptive fields. DGSD uses edge and distribution information to guide semantic decoding, thereby improving the segmentation accuracy at class boundaries. To enhance the performance of the compact student model, our KD strategy includes detail, semantic response distillation (DSRD), and contrastive learning-based feature distillation (CLFD). Practically, DSRD enables the student model to gain knowledge from the teacher model at both the detailed and semantic levels. At the same time, CLFD increases the similarity of features within the same categories and emphasizes the distinctiveness of features between different categories in both the student and teacher models. Extensive experiments conducted on two standard datasets have consistently demonstrated that both CLNet-T and CLNet-S* outperform other state-of-the-art methods. The code and results are available at https://github.com/xiaodonguo/CLNet.

Local structure consistency and pixel-correlation distillation for compact semantic segmentation

Double Similarity Distillation for Semantic Image Segmentation

Channel-wise Distillation for Semantic Segmentation.

Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation

FCKDNet: A Feature Condensation Knowledge Distillation Network for Semantic Segmentation

Knowledge Adaptation for Efficient Semantic Segmentation

Spirit Distillation: Precise Real-time Semantic Segmentation of Road Scenes with Insufficient Data

Efficient Semantic Segmentation Via Self-Attention and Self-Distillation

Multi-Granularity Distillation Scheme Towards Lightweight Semi-Supervised Semantic Segmentation

Self Pseudo Entropy Knowledge Distillation for Semi-supervised Semantic Segmentation

Difference-Aware Distillation for Semantic Segmentation

Normalized Feature Distillation for Semantic Segmentation

Adaptive Perspective Distillation for Semantic Segmentation

Bridging Knowledge Distillation Gap for Few-sample Unsupervised Semantic Segmentation

Contrastive learning-based knowledge distillation for RGB-thermal urban scene semantic segmentation

PPDistiller: Weakly-supervised 3D point cloud semantic segmentation framework via point-to-pixel distillation

Channel-spatial knowledge distillation for efficient semantic segmentation

Structural and Statistical Texture Knowledge Distillation for Semantic Segmentation

Efficient Object Region Discovery for Weakly-supervised Semantic Segmentation

Make a Strong Teacher with Label Assistance: A Novel Knowledge Distillation Approach for Semantic Segmentation

Cross-Image Distillation for Semi-Supervised Semantic Segmentation