Abstract:Overcoming catastrophic forgetting is a key difficulty for remote sensing image (RSI) classification in open-world applications. The core of this problem lies in the ability of RSI scene classification models to adapt to the changing environment and maintain the learned knowledge while continually learning new knowledge. Mainstream replay-based approaches overcome catastrophic forgetting by reenacting and retracing past experiences in the process of learning new data. However, such approaches rely heavily on the storage of historical data, and the recent rise of new paradigms based on prompt learning offers a new perspective of using only task-related "instructions" (i.e., prompts) to guide the model's continual learning and reasoning. Therein, the task knowledge encoded by the prompt improves the model's ability to overcome forgetting while reducing the amount of data and model parameters required by traditional data-driven approaches. Therefore, we propose a continual learning method based on prompt learning for RSI classification. We systematically analyze and reveal the potential of prompt learning for continual learning of RSI classification. Experiments on three publicly available remote sensing datasets show that prompt learning significantly outperforms two comparable methods on 3, 6, and 9 tasks, with an average accuracy (ACC) improvement of approximately 43%. Performance improvements of 4%–6% were achieved when compared with advanced prototype network methods. We found that prompt-generation strategies and prompt-related components significantly affect performance: (1) prompt-generation strategies are strongly correlated with the model's performance in overcoming catastrophic forgetting; (2) prompt-related components are correlated with RSIs of different scales. The new paradigm of prompt learning potentially provides a new idea for the continual learning problem of RSI classification.

Prompting Continual Person Search

POP: Prompt Of Prompts for Continual Learning

Enhance Performance of Ad-hoc Search via Prompt Learning.

S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learning

Prompting to Adapt Foundational Segmentation Models

KC-Prompt: End-To-End Knowledge-Complementary Prompting for Rehearsal-Free Continual Learning

Prompt Customization for Continual Learning

A Cross-modality and Progressive Person Search System

Prompt Recursive Search: A Living Framework with Adaptive Growth in LLM Auto-Prompting

Dynamic Textual Prompt For Rehearsal-free Lifelong Person Re-identification

Continual Learning for Remote Sensing Image Scene Classification With Prompt Learning

Prompt-Matched Semantic Segmentation

Evolving Parameterized Prompt Memory for Continual Learning

Generating Prompts in Latent Space for Rehearsal-free Continual Learning

CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual Learning

Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

Attentive Feature Focusing for Person Search by Natural Language

RCS-Prompt: Learning Prompt to Rearrange Class Space for Prompt-based Continual Learning

Comprehensive Attribute Prediction Learning for Person Search by Language.

Survival of the Most Influential Prompts: Efficient Black-Box Prompt Search via Clustering and Pruning