Abstract:The purpose of few-shot learning is to learn a classifier, even if only a limited number of samples are used, a good generalization effect can be achieved. Recently, many methods based on meta-learning learn a large number of multi-classification tasks to train a general classifier to solve this problem. Methods based on metric learning use the distance relationship between labeled samples and unlabeled samples for classification. These methods all have good performance. However, these methods rarely pay attention to the problems of insufficient feature extraction and low training efficiency. To this end, we propose multi-attention mutual information distributed framework for few-shot learning (MAMD). Specifically, we use the attention mechanism to help the feature embedding module extract more representative features. We use multiple attention mechanisms because different attention mechanisms can focus on different features. After multiple attention modules extract features, we use the mutual learning to aggregate the extracted features. The mutual learning mothed is similar to knowledge distillation. The difference between knowledge distillation and mutual learning is that mutual learning does not require a large network to guide a small network, but two networks learn from each other and progress together. In addition, we use distributed learning to improve the training speed and shorten the consumption of time. We combine distributed learning with few-shot learning for the first time and propose the concept of distributed few-shot learning. It provides a new direction for few-shot learning. We evaluate MAMD on two few-shot learning benchmark datasets and achieve the expected results.

MHA-WoML: Multi-head Attention and Wasserstein-OT for Few-Shot Learning

Wavelet Attention Network for Few-shot Learning

Few-Shot Learning Based on Deep Learning for Image Classification

Attentive Matching Network for Few-Shot Learning.

Local Mutual Metric Network for Few-Shot Image Classification

Optimization model based on attention mechanism for few-shot image classification

Few-Shot Classification of Aerial Scene Images via Meta-Learning

Task-wise Attention Guided Part Complementary Learning for Few-Shot Image Classification

Few-shot Classification with Intra-Class Co-Salient Learning and Holistic Metric

Local Descriptors Weighted Adaptive Threshold Filtering For Few-Shot Learning

Attributes-Guided and Pure-Visual Attention Alignment for Few-Shot Recognition

Multi-Scale Adaptive Task Attention Network for Few-Shot Learning.

Object-aware Long-short-range Spatial Alignment for Few-Shot Fine-Grained Image Classification

Multimodal variational contrastive learning for few-shot classification

Multi-Scale Metric Learning for Few-Shot Learning

Multi-distance Metric Network for Few-Shot Learning

Spatial Attention Network for Few-Shot Learning

Dual-stream Multi-Modal Graph Neural Network for Few-Shot Learning

Coarse-to-fine Few-Shot Classification with Deep Metric Learning

Multi-attention mutual information distributed framework for few-shot learning

Collect and Select: Semantic Alignment Metric Learning for Few-Shot Learning