Abstract:The purpose of few-shot learning is to learn a classifier, even if only a limited number of samples are used, a good generalization effect can be achieved. Recently, many methods based on meta-learning learn a large number of multi-classification tasks to train a general classifier to solve this problem. Methods based on metric learning use the distance relationship between labeled samples and unlabeled samples for classification. These methods all have good performance. However, these methods rarely pay attention to the problems of insufficient feature extraction and low training efficiency. To this end, we propose multi-attention mutual information distributed framework for few-shot learning (MAMD). Specifically, we use the attention mechanism to help the feature embedding module extract more representative features. We use multiple attention mechanisms because different attention mechanisms can focus on different features. After multiple attention modules extract features, we use the mutual learning to aggregate the extracted features. The mutual learning mothed is similar to knowledge distillation. The difference between knowledge distillation and mutual learning is that mutual learning does not require a large network to guide a small network, but two networks learn from each other and progress together. In addition, we use distributed learning to improve the training speed and shorten the consumption of time. We combine distributed learning with few-shot learning for the first time and propose the concept of distributed few-shot learning. It provides a new direction for few-shot learning. We evaluate MAMD on two few-shot learning benchmark datasets and achieve the expected results.

Multi-Head Attention Graph Network for Few Shot Learning

Multi-instance attention network for few-shot learning

Multi-Attention Network For One Shot Learning

Local feature graph neural network for few-shot learning

Mixture Distribution Graph Network for Few Shot Learning

Multi-Scale Adaptive Task Attention Network for Few-Shot Learning.

Edge-labeling based modified gated graph network for few-shot learning

Graph-based few-shot learning with transformed feature propagation and optimal class allocation

Dual-stream Multi-Modal Graph Neural Network for Few-Shot Learning

Cross Attention Network for Few-shot Classification

A Mutually Supervised Graph Attention Network for Few-Shot Segmentation: The Perspective of Fully Utilizing Limited Samples

Bidirectional Gated Edge-Labeling Graph Recurrent Neural Network for Few-shot Learning

Multi-Semantic Hypergraph Neural Network for Effective Few-Shot Learning

Self-attention network for few-shot learning based on nearest-neighbor algorithm

Fuzzy Graph Neural Network for Few-Shot Learning

Multi-Similarity Enhancement Network for Few-Shot Segmentation.

Cross-Modality Graph Neural Network for Few-Shot Learning.

Adaptive Attentional Network for Few-Shot Relational Learning of Knowledge Graphs

Fine-Grained 3D-Attention Prototypes for Few-Shot Learning

Multi-attention mutual information distributed framework for few-shot learning

Few-Shot Relation Extraction with Dual Graph Neural Network Interaction.