Abstract:Image-processing techniques used for remote sensing images (RSIs) have addressed the issues associated with scene classification. However, two challenges remain; first, most bi-modal methods integrate the extracted features indiscriminately while neglecting certain more relevant features, and bi-modal feature qualities may vary in different scenarios. Second, previous studies have improved the feature extraction performance at the expense of computational speed and complexity, hindering the wide application of improved versions. To address these issues, we constructed a graph template enhancement and supplementation network (GTESNet) with dual-teacher knowledge distillation (KD), GTESNet-S , to emphasize and manage the extracted features adaptively and compress the model. First, we developed a graph template enhancement (GTE) module that combined long-range contextual information with clustered template features. Second, an exchange-correlation fusion (ECF) module was introduced to allocate feature distribution dynamically and achieve integration. Third, we constructed feedback complementary decoders (FCDs) consisting of two subdecoders with a cascade connection that used a feedback mechanism to supplement the final output. A dual-teacher distillation method that utilized simple confidence perceptions to assign weights to both teachers was implemented during KD. Furthermore, we introduced clustered templates and graph-relation distillations (GRDs), allowing the student GTESNet-S to learn the clustering ability and semantic association process of the teacher GTESNet-T. Finally, we introduced simple progressive decoder distillation (PDD) to facilitate the learning of GTESNet-S. Extensive experiments on two publicly available datasets demonstrated that the GTESNet outperformed similar state-of-the-art (SOTA) methods. The code is available at: https://github.com/MAXHAN22/GTESNet.

Remote Sensing Image Scene Classification via Graph Template Enhancement and Supplementation Network With Dual-Teacher Knowledge Distillation

Vision Transformer: an Excellent Teacher for Guiding Small Networks in Remote Sensing Image Scene Classification

Remote Sensing Scene Classification by Gated Bidirectional Network

GSGNet-S*: Graph Semantic Guidance Network Via Knowledge Distillation for Optical Remote Sensing Image Scene Analysis

Graph-Based Embedding Smoothing Network for Few-Shot Scene Classification of Remote Sensing Images

Remote-Sensing Scene Classification via Multistage Self-Guided Separation Network

Graph Attention Guidance Network with Knowledge Distillation for Semantic Segmentation of Remote Sensing Images.

Attention-Aware Deep Feature Embedding for Remote Sensing Image Scene Classification

From Coarse to Fine: Knowledge Distillation for Remote Sensing Scene Classification

Remote Scene Image Scene Classification Based on Adaptive Segmentation and Dynamic Graph Convolution

SIGKD: A Structured Instance Graph Distillation Method for Efficient Object Detection in Remote Sensing Images

MGSGNet-S*: Multilayer Guided Semantic Graph Network Via Knowledge Distillation for RGB-Thermal Urban Scene Parsing

Self-Training and Curriculum Learning Guided Dynamic Refined Network for Remote Sensing Class-Incremental Semantic Segmentation

RS-SSKD: Self-Supervision Equipped with Knowledge Distillation for Few-Shot Remote Sensing Scene Classification

Lightweight High-Resolution Remote Sensing Scene Classification via Adaptive Enhanced Knowledge Distillation.

Multigranularity Decoupling Network With Pseudolabel Selection for Remote Sensing Image Scene Classification

Remote Sensing Scene Classification via Second-Order Differentiable Token Transformer Network

Remote Sensing Image Scene Classification Based on a Dual Attention Dense Network

Scene Classification Of Remotely Sensed Images Via Densely Connected Convolutional Neural Networks And An Ensemble Classifier

TAKD: Target-Aware Knowledge Distillation for Remote Sensing Scene Classification

Instance-Level Scaling and Dynamic Margin-Alignment Knowledge Distillation for Remote Sensing Image Scene Classification