Abstract:Few-shot learning aims to learn classifiers for new classes with only a few training examples per class. Most existing few-shot learning approaches belong to either metric-based meta-learning or optimization-based meta-learning category, both of which have achieved successes in the simplified "k-shot N-way" image classification settings. Specifically, the optimization-based approaches train a meta-learner to predict the parameters of the task-specific classifiers. The task-specific classifiers are required to be homogeneous-structured to ease the parameter prediction, so the meta-learning approaches could only handle few-shot learning problems where the tasks share a uniform number of classes. The metric-based approaches learn one task-invariant metric for all the tasks. Even though the metric-learning approaches allow different numbers of classes, they require the tasks all coming from a similar domain such that there exists a uniform metric that could work across tasks. In this work, we propose a hybrid meta-learning model called Meta-Metric-Learner which combines the merits of both optimization- and metric-based approaches. Our meta-metric-learning approach consists of two components, a task-specific metric-based learner as a base model, and a meta-learner that learns and specifies the base model. Thus our model is able to handle flexible numbers of classes as well as generate more generalized metrics for classification across tasks. We test our approach in the standard "k-shot N-way" few-shot learning setting following previous works and a new realistic few-shot setting with flexible class numbers in both single-source form and multi-source form. Experiments show that our approach attains superior performance in all settings. (C) 2019 Elsevier B.V. All rights reserved.

TADAM: Task dependent adaptive metric for improved few-shot learning

Transductive Episodic-Wise Adaptive Metric for Few-Shot Learning

Task Attribute Distance for Few-Shot Learning: Theoretical Analysis and Applications

Task-Agnostic Self-Distillation for Few-Shot Action Recognition

Task Adaptive Feature Distribution Based Network for Few-shot Fine-grained Target Classification

Multi-Scale Adaptive Task Attention Network for Few-Shot Learning.

Few-Shot Learning Based on Deep Learning for Image Classification

Learning to Learn Adaptive Classifier–Predictor for Few-Shot Learning

TAFSSL: Task-Adaptive Feature Sub-Space Learning for few-shot classification

A Hybrid Approach with Optimization-Based and Metric-Based Meta-Learner for Few-Shot Learning

Adaptive Few-Shot Deep Metric Learning

Improving metric-based few-shot learning with dynamically scaled softmax loss

Task-aware prototype refinement for improved few-shot learning

Task-Adaptive Clustering for Semi-Supervised Few-Shot Classification

Few-shot Learning with Meta Metric Learners

Adaptive Cross-Modal Few-Shot Learning

Spatial Attention Network for Few-Shot Learning

TAdaNet: Task-Adaptive Network for Graph-Enriched Meta-Learning

Task-Related Saliency for Few-Shot Image Classification

Learning task-specific discriminative embeddings for few-shot image classification

Task-Adapter: Task-specific Adaptation of Image Models for Few-shot Action Recognition