Abstract:Self-supervised learning, which leverages unlabeled data to learn useful feature representations by constructing auxiliary tasks, has been widely explored in few-shot scene classification to improve the feature representation and generalization capabilities of deep models in scarce data. However, most of the current related work adopts specific self-supervised auxiliary tasks (SSATs) for combinatorial improvement, and does not explore the intrinsic connection between different pretext tasks. In practice, the linkage of SSATs is complex, and the optimization of task-sharing parameters by minimizing linear combinations of losses can be conflicting. In addition, although a single combination of SSAT can improve certain performance on the baseline, it is not the personalized optimal solution on various remote sensing datasets with diverse properties. In this article, we propose a collaborative self-supervised evolution (so-called CSENet) framework for few-shot remote sensing scene classification to automatically search for appropriate weights in balancing the task conflicts. In contrast to most existing methods, which consider all SSATs to be equally efficacious or fixed-weighted for the few-shot main task, CSENet achieves autonomous co-evolutionary optimization by encoding arbitrary self-supervised weights. Specifically, the complex self-supervised combinations for different remote sensing data are transformed into an evolutionary optimization problem, where chromosomes with weighting variables obtain the optimal combination with genetic operators. Based on the transfer learning few-shot training paradigm, CSENet first efficiently searches for optimal self-supervised combinations with potential by the proposed automatic collaborative evolution strategy and automatically adjusts the weights without manual settings. Importantly, CSENet provides both inductive and transductive inference, and supports the embedding of arbitrary SSATs. The effectiveness of the proposed framework is demonstrated by state-of-the-art (SOTA) results on three benchmark datasets.

ICSFF: Information Constraint on Self-Supervised Feature Fusion for Few-Shot Remote Sensing Image Classification

Fusing Deep Features by Kernel Collaborative Representation for Remote Sensing Scene Classification

Multi-Grained Global-Local Semantic Feature Fusion for Few Shot Remote Sensing Scene Classification

Multi-scale fusion for few-shot remote sensing image classification

SAFFNet: Self-Attention-Based Feature Fusion Network for Remote Sensing Few-Shot Scene Classification

Few-Shot Remote Sensing Scene Classification With Spatial Affinity Attention and Class Surrogate-Based Supervised Contrastive Learning

Few-Shot Remote Sensing Scene Classification Via Subspace Based on Multiscale Feature Learning

MVFF: Multi-view Feature Fusion for Few-shot Remote Sensing Image Scene Classification

Learn to Few-Shot Segment Remote Sensing Images from Irrelevant Data

Few-Shot Remote Sensing Scene Classification with Multi-Metric Fusion

Few-Shot Hyperspectral Image Classification with Self-Supervised Learning.

Class-Shared SparsePCA for Few-Shot Remote Sensing Scene Classification

Improving Few-Shot Image Classification with Self-supervised Learning.

Collaborative Self-Supervised Evolution for Few-Shot Remote Sensing Scene Classification

An Adaptive Multilayer Feature Fusion Strategy for Remote Sensing Scene Classification

Spatial-Spectral-Semantic Cross-Domain Few-Shot Learning for Hyperspectral Image Classification

Multicrop Fusion Strategy Based on Prototype Assignment for Remote Sensing Image Scene Classification.

Self-Attention-Based Deep Feature Fusion for Remote Sensing Scene Classification.

Multi‐View Self‐Supervised Auxiliary Task for Few‐Shot Remote Sensing Classification

Few-Shot Object Detection in Remote Sensing Imagery Via Fuse Context Dependencies and Global Features

Multiform Ensemble Self-Supervised Learning for Few-Shot Remote Sensing Scene Classification