Abstract:Strong semantic segmentation models require large backbones to achieve promising performance, making it hard to adapt to real applications where effective real-time algorithms are needed. Knowledge distillation tackles this issue by letting the smaller model (student) produce similar pixel-wise predictions to that of a larger model (teacher). However, the classifier, which can be deemed as the perspective by which models perceive the encoded features for yielding observations (i.e., predictions), is shared by all training samples, fitting a universal feature distribution. Since good generalization to the entire distribution may bring the inferior specification to individual samples with a certain capacity, the shared universal perspective often overlooks details existing in each sample, causing degradation of knowledge distillation. In this paper, we propose Adaptive Perspective Distillation (APD) that creates an adaptive local perspective for each individual training sample. It extracts detailed contextual information from each training sample specifically, mining more details from the teacher and thus achieving better knowledge distillation results on the student. APD has no structural constraints to both teacher and student models, thus generalizing well to different semantic segmentation models. Extensive experiments on Cityscapes, ADE20K, and PASCAL-Context manifest the effectiveness of our proposed APD. Besides, APD can yield favorable performance gain to the models in both object detection and instance segmentation without bells and whistles.

Geometry-Aware Distillation for Indoor Semantic Segmentation

DCL: Differential Contrastive Learning for Geometry-Aware Depth Synthesis

3D-to-2D Distillation for Indoor Scene Parsing

Geometry-guided Feature Learning and Fusion for Indoor Scene Reconstruction

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

Complementary Bi-directional Feature Compression for Indoor 360° Semantic Segmentation with Self-distillation

Open Vocabulary 3D Scene Understanding via Geometry Guided Self-Distillation

TPV-IGKD: Image-Guided Knowledge Distillation for 3D Semantic Segmentation with Tri-Plane-View

Color-indoor: Incorporating Depth into Room Decoration Visualization

SEMANTIC SEGMENTATION OF INDOOR 3D POINT CLOUDS BY JOINT OPTIMIZATION OF GEOMETRIC FEATURES AND NEURAL NETWORKS

Learning to Reconstruct and Understand Indoor Scenes from Sparse Views

Transformer Fusion for Indoor Rgb-D Semantic Segmentation

Learning Semantic Segmentation from Synthetic Data: A Geometrically Guided Input-Output Adaptation Approach

Virtual Multi-view Fusion for 3D Semantic Segmentation

Semisupervised learning-based depth estimation with semantic inference guidance

Global-Local Propagation Network for RGB-D Semantic Segmentation

Adaptive Perspective Distillation for Semantic Segmentation

Robust Geometry-Preserving Depth Estimation Using Differentiable Rendering

Multi-to-Single Knowledge Distillation for Point Cloud Semantic Segmentation

Joining Geometric and RGB Features for RGB-D Semantic Segmentation

Difference-Aware Distillation for Semantic Segmentation