Hybrid Pooling Networks for Few-shot Learning

Shaoqing Tan,Ruoyu Yang
DOI: https://doi.org/10.1109/ijcnn48605.2020.9207287
2020-01-01
Abstract:We propose Hybrid Pooling Networks (HPN) for few-shot learning, where a classifier must learn to recognize new classes not seen in the training set, given only few examples from each new class. HPN learns deep similarity metrics between labeled and unlabeled instances, consisting of two independent networks named Bilinear Pooling Network (BPN) and Element-wise Interaction Network (EIN). By using bilinear pooling, BPN produces a combination of the inputs containing comprehensive information about pair-wise similarities. In EIN, we apply "alignment" on features, making feature-wise interactions on input images. This operation contributes to capturing finer similarities. Both of BPN and EIN bring significant improvements on miniImageNet and Omniglot few-shot datasets. We incorporate the two networks to form HPN by simply averaging their outputs, showing much better performance. Besides, all of our models are easily extended to zero-shot learning. Experiments on CUB and AWA2 demonstrate that our approaches can achieve state-of-the-art performance on zero-shot tasks.
What problem does this paper attempt to address?