Abstract:The existing few-shot scene classification (FSSC) algorithms have achieved satisfactory results, but they are limited by the paradigm of centralized machine learning, i.e., private remote sensing data need to be centralized on a certain server for training. However, remote sensing images generally contain sensitive information such as national security and company privacy, so it is realistically difficult to collect remote sensing data from all the parties. Therefore, there is a pressing requirement in FSSC for a novel paradigm to achieve multi-party collaborative learning without compromising remote sensing data privacy. In this paper, we formulate a novel personalized multi-party few-shot learning (PMPFSL) paradigm for remote sensing scene classification. In PMPFSL, different participants can achieve multi-party collaborative learning without sacrificing the privacy of their local data, and their respective local models are able to recognize the unseen remote sensing scene categories with a small number of labeled samples. Importantly, the proposed PMPFSL is applicable to various multi-party learning algorithms and few-shot scene classification networks. Moreover, to address the problems of local model overfitting and poor discriminability of few-shot metrics, we propose the personalized adaptive distillation (PAD) scheme and multi-scale feature matching network (MSFMNet) on PMPFSL, respectively. Specifically, each participant obtains the MSFMNet with initialization parameters, and implements a certain number of local training on their respective private machines. Global aggregation is subsequently achieved by uploading only the local models to the central server. In a new round of local training, the participants realize personalized data adaptation to the global model based on the PAD. Overall, the proposed PMPFSL customizes a personalized few-shot model for each participant that is more tailored to their respective remote sensing scenarios. The experimental results demonstrate that our PMPFSL is superior in three benchmark FSSC datasets. We also extensively studied and analyzed the contributions of PAD and MSFMNet in the proposed PMPFSL framework.

Personalized Multi-Party Few-Shot Learning for Remote Sensing Scene Classification

Personalized Multiparty Few-Shot Learning for Remote Sensing Scene Classification

Multi-pretext-task Prototypes Guided Dynamic Contrastive Learning Network for Few-shot Remote Sensing Scene Classification

Subspace Prototype Learning for Few-Shot Remote Sensing Scene Classification

Toward Multiparty Personalized Collaborative Learning in Remote Sensing

Few-Shot Remote Sensing Scene Classification With Spatial Affinity Attention and Class Surrogate-Based Supervised Contrastive Learning

Few-Shot Remote Sensing Scene Classification Via Subspace Based on Multiscale Feature Learning

Class-Shared SparsePCA for Few-Shot Remote Sensing Scene Classification

Personalized Federated Few-Shot Learning

Multipretext-Task Prototypes Guided Dynamic Contrastive Learning Network for Few-Shot Remote Sensing Scene Classification

Multi-Grained Global-Local Semantic Feature Fusion for Few Shot Remote Sensing Scene Classification

Class Shared Dictionary Learning for Few-Shot Remote Sensing Scene Classification

A class distribution learning method for few-shot remote sensing scene classification

Deep Updated Subspace Networks for Few-Shot Remote Sensing Scene Classification

Not Just Learning from Others but Relying on Yourself: A New Perspective on Few-Shot Segmentation in Remote Sensing

Multiform Ensemble Self-Supervised Learning for Few-Shot Remote Sensing Scene Classification

Pseudo-label Meta-Learner in Semi-Supervised Few-Shot Learning for Remote Sensing Image Scene Classification

Frequency-Aware Multi-Modal Fine-Tuning for Few-Shot Open-Set Remote Sensing Scene Classification

Class Centralized Dictionary Learning for Few-Shot Remote Sensing Scene Classification

Few-Shot Scene Classification of Optical Remote Sensing Images Leveraging Calibrated Pretext Tasks

Federated Few-Shot Learning with Adversarial Learning