Harnessing Multi-Semantic Hypergraph for Few-Shot Learning.

Hao Chen,Linyan Li,Zhenping Xia,Fan Lyu,Liuqing Zhao,Kaizhu Huang,Wei Feng,Fuyuan Hu
DOI: https://doi.org/10.1007/978-3-031-18907-4_18
2022-01-01
Abstract:Recently, Graph-based Few Shot Learning (FSL) methods exhibit good generalization by mining relations among the few examples with Graph Neural Networks. However, most Graph-based FSL methods consider only binary relations and ignore the multi-semantic information of the global context knowledge. We propose a framework of Multi-Semantic Hypergraph for FSL (MSH-FSL) to explore complex latent high-order multi-semantic relations among the few examples. Specifically, we first build up a novel Multi-Semantic Hypergraph by identifying associated examples with various semantic features from different receptive fields. With the constructed hypergraph, we then develop the Hyergraph Neural Network along with a novel multi-generation hypergraph message passing so as to better leverage the complex latent semantic relations among examples. Finally, after a number of generations, the hyper-node representations embedded in the learned hypergraph become more accurate for obtaining few-shot predictions. In the 5-way 1-shot task on miniImagenet dataset, the multi-semantic hypergraph outperforms the single-semantic graph by 3.1%, and with the proposed semantic-distribution message passing, the improvement can further reach 6.5%.
What problem does this paper attempt to address?