Abstract:To infer unknown remote sensing scenarios, most existing technologies use a supervised learning paradigm to train deep neural network (DNN) models on closed datasets. This paradigm faces challenges such as highly spatiotemporal variants and ever-changing scale-heterogeneous remote sensing scenarios. Additionally, DNN models cannot scale to new scenarios. Lifelong learning is an effective solution to these problems. Current lifelong learning approaches focus on overcoming the catastrophic forgetting issue (i.e., a successive increase in heterogeneous remote sensing scenes causes models to forget historical scenes) while ignoring the knowledge recall issue (i.e., how to facilitate the learning of new scenes by recalling historical experiences), which is a significant problem. This article proposes a lifelong learning framework called asymmetric collaborative network (SCN) for lifelong remote sensing image (RSI) classification. This framework consists of two structurally distinct networks: a preserving network (Pres-Net) and a transient network (Trans-Net), which imitate the long- and short-term memory processes in the brain, respectively. Moreover, this framework is based on two synergistic knowledge transfer mechanisms: triple distillation and prior feature fusion. The triple distillation mechanism enables knowledge persistence from Trans-Net to Pres-Net to achieve better memorization; the prior feature fusion mechanism enables knowledge transfer from Pres-Net to Trans-Net to achieve better recall. Experiments on three open datasets demonstrate the effectiveness of SCN for three-, six-, and nine-task-length learning. The idea of asymmetric separation networks and the synergistic strategy proposed in this article are expected to provide new solutions to the translatability of the classification of RSIs in real-world scenarios. The source codes are available at https://github.com/GeoX-Lab/SCN.

Lifelong Learning for Scene Recognition in Remote Sensing Images

A Meta-Learning Framework for Few-Shot Classification of Remote Sensing Scene

RS-MetaNet: Deep Metametric Learning for Few-Shot Remote Sensing Scene Classification

Structural Attention Enhanced Continual Meta-Learning for Graph Edge Labeling Based Few-Shot Remote Sensing Scene Classification

Better Memorization, Better Recall: A Lifelong Learning Framework for Remote Sensing Image Scene Classification

Few-Shot Scene Classification of Optical Remote Sensing Images Leveraging Calibrated Pretext Tasks

A lightweight and stochastic depth residual attention network for remote sensing scene classification

RS-MetaNet: Deep meta metric learning for few-shot remote sensing scene classification

Meta-FSEO: A Meta-Learning Fast Adaptation with Self-Supervised Embedding Optimization for Few-Shot Remote Sensing Scene Classification

Research Progress on Few-Shot Learning for Remote Sensing Image Interpretation

A Few-Shot Semi-Supervised Learning Method for Remote Sensing Image Scene Classification

Semi-Supervised Contrastive Learning for Few-Shot Segmentation of Remote Sensing Images

RS-SSKD: Self-Supervision Equipped with Knowledge Distillation for Few-Shot Remote Sensing Scene Classification

Few-Shot Scene Classification With Multi-Attention Deepemd Network In Remote Sensing

Few-Shot Remote Sensing Scene Classification Via Subspace Based on Multiscale Feature Learning

Scene Classification of High Resolution Remote Sensing Images Via Self-Paced Deep Learning.

Remote Sensing Image Scene Classification with Self-Supervised Paradigm under Limited Labeled Samples

Unsupervised Few-Shot Continual Learning for Remote Sensing Image Scene Classification

Subspace Prototype Learning for Few-Shot Remote Sensing Scene Classification

Multi-attention DeepEMD for Few-Shot Learning in Remote Sensing

Class Shared Dictionary Learning for Few-Shot Remote Sensing Scene Classification