Abstract:Prototypical Network is a popular few-shot solver that aims at establishing a feature metric generalizable to novel few-shot classification (FSC) tasks using deep neural networks. However, its performance drops dramatically when generalizing to the FSC tasks in new domains. In this study, we revisit this problem and argue that the devil lies in the simplicity bias pitfall in neural networks. In specific, the network tends to focus on some biased shortcut features (e.g., color, shape, etc.) that are exclusively sufficient to distinguish very few classes in the meta-training tasks within a pre-defined domain, but fail to generalize across domains as some desirable semantic features. To mitigate this problem, we propose a Local-global Distillation Prototypical Network (LDP-net). Different from the standard Prototypical Network, we establish a two-branch network to classify the query image and its random local crops, respectively. Then, knowledge distillation is conducted among these two branches to enforce their class affiliation consistency. The rationale behind is that since such global-local semantic relationship is expected to hold regardless of data domains, the local-global distillation is beneficial to exploit some cross-domain transferable semantic features for feature metric establishment. Moreover, such local-global semantic consistency is further enforced among different images of the same class to reduce the intra-class semantic variation of the resultant feature. In addition, we propose to update the local branch as Exponential Moving Average (EMA) over training episodes, which makes it possible to better distill cross-episode knowledge and further enhance the generalization performance. Experiments on eight cross-domain FSC benchmarks empirically clarify our argument and show the state-of-the-art results of LDP-net. Code is available in https://github.com/NWPUZhoufei/LDP-Net

L2-norm prototypical networks for tackling the data shift problem in scene classification

Reweighting and Information-Guidance Networks for Few-Shot Learning

Two-Stage Domain Alignment Single-Source Domain Generalization Network for Cross-Scene Hyperspectral Images Classification

TDNet: A Novel Transductive Learning Framework with Conditional Metric Embedding for Few-shot Remote Sensing Image Scene Classification

DPNet: domain-aware prototypical network for interdisciplinary few-shot relation classification

Revisiting Prototypical Network for Cross Domain Few-Shot Learning

Prototype Rectification with Region-Wise Foreground Enhancement for Few-Shot Classification.

Locally Linear Unbiased Randomization Network for Cross-Scene Hyperspectral Image Classification.

SPNet: Siamese-Prototype Network for Few-Shot Remote Sensing Image Scene Classification

SEN: A Novel Feature Normalization Dissimilarity Measure for Prototypical Few-Shot Learning Networks

Double Discriminative Constraint-Based Affine Nonnegative Representation for Few-Shot Remote Sensing Scene Classification

Semantic-embedded Similarity Prototype for Scene Recognition

CP-VoteNet: Contrastive Prototypical VoteNet for Few-Shot Point Cloud Object Detection

No Time to Train: Empowering Non-Parametric Networks for Few-shot 3D Scene Segmentation

See More for Scene: Pairwise Consistency Learning for Scene Classification

Few-Shot Remote Sensing Image Scene Classification Based on Metric Learning and Local Descriptors

Local Mutual Metric Network for Few-Shot Image Classification

Spectral–Spatial Enhancement and Causal Constraint for Hyperspectral Image Cross-Scene Classification

Zero-Shot Learning via Attribute Regression and Class Prototype Rectification

Local descriptor-based multi-prototype network for few-shot Learning

Neural Information Processing in Hierarchical Prototypical Networks