Abstract:RGB thermal semantic segmentation facilitates unmanned platforms to perceive and characterize their surrounding environment, which is critical for autonomous driving tasks. Deep-learning-based algorithms have achieved dominance in terms of accuracy and robustness. However, their large parameter sizes and significant computational demands impede their application in terminal devices. To address this challenge, we propose a novel strategy for achieving a balance between effectiveness and compactness. It includes a robust teacher network, CLNet-T, and a streamlined student network, CLNet-S. Using knowledge distillation (KD), we obtained an optimized model called CLNet-S*. Specifically, CLNet-T and CLNet-S were identical in all aspects except for the feature extraction component. They included a multi-attribute hierarchical feature interaction module (MHFI) and a detail-guided semantic decoder (DGSD). The MHFI initially filters features by considering the characteristics of the low- and high-level features. It gradually combines complementary and common features from various modalities in distinct receptive fields. DGSD uses edge and distribution information to guide semantic decoding, thereby improving the segmentation accuracy at class boundaries. To enhance the performance of the compact student model, our KD strategy includes detail, semantic response distillation (DSRD), and contrastive learning-based feature distillation (CLFD). Practically, DSRD enables the student model to gain knowledge from the teacher model at both the detailed and semantic levels. At the same time, CLFD increases the similarity of features within the same categories and emphasizes the distinctiveness of features between different categories in both the student and teacher models. Extensive experiments conducted on two standard datasets have consistently demonstrated that both CLNet-T and CLNet-S* outperform other state-of-the-art methods. The code and results are available at https://github.com/xiaodonguo/CLNet.

Lightweight Dual Stream Network With Knowledge Distillation for RGB-D Scene Parsing

A lightweight and stochastic depth residual attention network for remote sensing scene classification

A Lightweight SE-YOLOv3 Network for Multi-Scale Object Detection in Remote Sensing Imagery.

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

3D-to-2D Distillation for Indoor Scene Parsing

Depth Cue Enhancement and Guidance Network for RGB-D Salient Object Detection

DDNet: Depth Dominant Network for Semantic Segmentation of RGB-D Images

A Single Stream Network for Robust and Real-Time RGB-D Salient Object Detection

Contrastive learning-based knowledge distillation for RGB-thermal urban scene semantic segmentation

RGB×D: Learning Depth-Weighted RGB Patches for RGB-D Indoor Semantic Segmentation

Multi-resolution Cascaded Network with Depth-similar Residual Module for Real-time Semantic Segmentation on RGB-D Images.

DSGI‐Net: Density‐based Selective Grouping Point Cloud Learning Network for Indoor Scene

Image Enhancement and Translation for RGB-D Indoor Scene Recognition

Lightweight Multi-modal Representation Learning for RGB Salient Object Detection

Deep Dual-Resolution Networks for Real-Time and Accurate Semantic Segmentation of Traffic Scenes

CCDepth: A Lightweight Self-supervised Depth Estimation Network with Enhanced Interpretability

Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes

LW-Net: A Lightweight Network for Monocular Depth Estimation

DeepLiDAR: Deep Surface Normal Guided Depth Prediction for Outdoor Scene from Sparse LiDAR Data and Single Color Image

Dual Attention Based Multi-scale Feature Fusion Network for Indoor RGBD Semantic Segmentation.

Spatial-information Guided Adaptive Context-aware Network for Efficient RGB-D Semantic Segmentation