Abstract:Remote sensing image scene classification (RSI-SC) is crucial for various high-level applications, including RSI retrieval, image captioning, and object detection. Deep learning-based methods can accurately predict scene categories. However, these approaches often require numerous labeled samples for training, limiting their practicality in real-world RS applications with scarce label resources. In contrast, few-shot remote sensing image scene classification (FS-RSI-SC) has garnered substantial research interest owing to its potential to mitigate the need for extensive training samples. In recent years, there has been a surge in studies on FS-RSI-SC. This paper presents a comprehensive overview of FS-RSI-SC research, categorizing existing methods into two groups. The first group comprises approaches based on data augmentation, transfer learning, metric learning, and meta-learning. Our analysis reveals that most existing FS-RSI-SC methods fall into the meta-learning category, employing attention mechanisms, self-supervised learning (SSL), and feature fusion techniques for enhanced performance. Additionally, transfer learning-based methods consistently outperform other approaches in this category. The second group is centered around large-scale pre-training, which has demonstrated remarkable competitiveness across various tasks, including FS-RSI-SC. This special group of methods has shown considerable potential and is expected to attract more attention with the increasing popularity of large-scale pre-training and the unimodal and multimodal foundation models. Moreover, we proposed a pipeline that harnesses the capabilities of powerful large vision-language models (VLMs) as image encoders, establishing new baselines for FS-RSI-SC on commonly used datasets under standard experimental settings. Our empirical results validated the effectiveness of utilizing large VLMs and highlighted their potential for FS-RSI-SC. Through a joint analysis of state-of-the-art methods and our experiments with VLMs, we identified the prevailing challenges in FS-RSI-SC and outlined promising directions for future research.

Self-Supervised Remote Sensing Feature Learning: Learning Paradigms, Challenges, and Future Works

A Survey on Deep Learning-Driven Remote Sensing Image Scene Understanding: Scene Classification, Scene Retrieval and Scene-Guided Object Detection

Self-Supervised Learning in Remote Sensing: A review

Remote Sensing Image Scene Classification with Self-Supervised Paradigm under Limited Labeled Samples

Few-shot remote sensing image scene classification: Recent advances, new baselines, and future trends

Unsupervised Feature Learning in Remote Sensing

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

A generic self-supervised learning (SSL) framework for representation learning from spectra-spatial feature of unlabeled remote sensing imagery

Simple and Efficient: A Semisupervised Learning Framework for Remote Sensing Image Semantic Segmentation

Self-Supervised Representation Learning: Introduction, advances, and challenges

Semi-Supervised Scene Classification for Remote Sensing Images Based on CNN and Ensemble Learning.

FedRSU: Federated Learning for Scene Flow Estimation on Roadside Units

Deep Feature Reconstruction Learning for Open-Set Classification of Remote Sensing Imagery

Self-supervised in-domain representation learning for remote sensing image scene classification

Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning

Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectives

Exploring Self-Supervised Learning for Multi-Modal Remote Sensing Pre-Training via Asymmetric Attention Fusion

Open Self-Supervised Features for Remote-Sensing Image Scene Classification Using Very Few Samples

Unsupervised Few-Shot Continual Learning for Remote Sensing Image Scene Classification

SiamSeg: Self-Training with Contrastive Learning for Unsupervised Domain Adaptation in Remote Sensing

Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art