Robust Re-weighting Prototypical Networks for Few-Shot Classification

Junjie Zhu,Xiaodong Yi,Naiyang Guan,Hang Cheng
DOI: https://doi.org/10.1145/3449301.3449325
2020-01-01
Abstract:Prototypical networks (ProtoNet) inferences the class of each probe sample by its nearest prototype representation among all classes. Since ProtoNet learns the prototype representation from only a few labeled samples of each class, it is effective for few-shot classification and has been widely applied in computer vision, natural language processing and many other fields. However, ProtoNet suffers from a non-robustness deficiency, i.e., the prototype representation of a certain class will be seriously drifted if some labeled samples are unluckily corrupted. To overcome this deficiency, we propose a robust re-weighting prototypical networks (RRPNet) model to adaptively highlight the critical samples in learning the prototype representations. In particular, like ProtoNet, RRPNet utilizes the arithmetic mean to compute the prototypes, unlike ProtoNet, it incorporates a re-weighting mechanism to set a weight for each summation item. The weight reduces the influences of noisy samples in learning the prototypes, and thus makes RRPNet some-how more robust to noisy samples. We propose an adaptive weighting scheme in this paper. Several experimental results on both MiniImageNet and TieredImageNet datasets show that RRPNet is superior to the representative ProtoNet methods for few-shot image classification.
What problem does this paper attempt to address?