Abstract:Image-processing techniques used for remote sensing images (RSIs) have addressed the issues associated with scene classification. However, two challenges remain; first, most bi-modal methods integrate the extracted features indiscriminately while neglecting certain more relevant features, and bi-modal feature qualities may vary in different scenarios. Second, previous studies have improved the feature extraction performance at the expense of computational speed and complexity, hindering the wide application of improved versions. To address these issues, we constructed a graph template enhancement and supplementation network (GTESNet) with dual-teacher knowledge distillation (KD), GTESNet-S , to emphasize and manage the extracted features adaptively and compress the model. First, we developed a graph template enhancement (GTE) module that combined long-range contextual information with clustered template features. Second, an exchange-correlation fusion (ECF) module was introduced to allocate feature distribution dynamically and achieve integration. Third, we constructed feedback complementary decoders (FCDs) consisting of two subdecoders with a cascade connection that used a feedback mechanism to supplement the final output. A dual-teacher distillation method that utilized simple confidence perceptions to assign weights to both teachers was implemented during KD. Furthermore, we introduced clustered templates and graph-relation distillations (GRDs), allowing the student GTESNet-S to learn the clustering ability and semantic association process of the teacher GTESNet-T. Finally, we introduced simple progressive decoder distillation (PDD) to facilitate the learning of GTESNet-S. Extensive experiments on two publicly available datasets demonstrated that the GTESNet outperformed similar state-of-the-art (SOTA) methods. The code is available at: https://github.com/MAXHAN22/GTESNet.

From Coarse to Fine: Knowledge Distillation for Remote Sensing Scene Classification

Research on Knowledge Distillation Algorithm of Object Detection

Lightweight Remote Sensing Scene Classification Based on Knowledge Distillation

Lightweight High-Resolution Remote Sensing Scene Classification via Adaptive Enhanced Knowledge Distillation.

Remote Sensing Image Scene Classification with Noisy Label Distillation

Remote Sensing Image Scene Classification via Self-Supervised Learning and Knowledge Distillation

Instance-Level Scaling and Dynamic Margin-Alignment Knowledge Distillation for Remote Sensing Image Scene Classification

Information Fusion with Knowledge Distillation for Fine-grained Remote Sensing Object Detection

TAKD: Target-Aware Knowledge Distillation for Remote Sensing Scene Classification

Multispectral Scene Classification via Cross-Modal Knowledge Distillation

Fusing Deep Local And Global Features For Remote Sensing Image Scene Classification

Pair-Wise Similarity Knowledge Distillation for RSI Scene Classification

Remote Sensing Scene Classification Using Sparse Representation-Based Framework with Deep Feature Fusion

RS-SSKD: Self-Supervision Equipped with Knowledge Distillation for Few-Shot Remote Sensing Scene Classification

Variational Self-Distillation for Remote Sensing Scene Classification

Scene Classification of High-Resolution Remote Sensing Image Using Transfer Learning with Multi-model Feature Extraction Framework.

Learn by Yourself: A Feature-Augmented Self-Distillation Convolutional Neural Network for Remote Sensing Scene Image Classification

Remote Sensing Image Scene Classification via Graph Template Enhancement and Supplementation Network With Dual-Teacher Knowledge Distillation

Knowledge Distillation of Grassmann Manifold Network for Remote Sensing Scene Classification

Scene Classification of Remote Sensing Images Guided by Fine-Grained Salient Region

Remote Sensing Image Scene Classification Using Rearranged Local Features