Abstract:Meta-learning aims to leverage prior knowledge from related tasks to enable a base learner to quickly adapt to new tasks with limited labeled samples. However, traditional meta-learning methods have limitations as they provide an optimal initialization for all new tasks, disregarding the inherent uncertainty induced by few-shot tasks and impeding task-specific self-adaptation initialization. In response to this challenge, this article proposes a novel probabilistic meta-learning approach called prototype Bayesian meta-learning (PBML). PBML focuses on meta-learning variational posteriors within a Bayesian framework, guided by prototype-conditioned prior information. Specifically, to capture model uncertainty, PBML treats both meta-and task-specific parameters as random variables and integrates their posterior estimates into hierarchical Bayesian modeling through variational inference (VI). During model inference, PBML employs Laplacian estimation to approximate the integral term over the likelihood loss, deriving a rigorous upper-bound for generalization errors. To enhance the model's expressiveness and enable task-specific adaptive initialization, PBML proposes a data-driven approach to model the task-specific variational posteriors. This is achieved by designing a generative model structure that incorporates prototype-conditioned task-dependent priors into the random generation of task-specific variational posteriors. Additionally, by performing latent embedding optimization, PBML decouples the gradient-based meta-learning from the high-dimensional variational parameter space. Experimental results on benchmark datasets for few-shot image classification illustrate that PBML attains state-of-the-art or competitive performance when compared to other related works. Versatility studies demonstrate the adaptability and applicability of PBML in addressing diverse and challenging few-shot tasks. Furthermore, ablation studies validate the performance gains attributed to the inference and model components.

A meta-learning based progressive prototype network technique in image classification

Amortized Bayesian Prototype Meta-learning: A New Probabilistic Meta-learning Approach to Few-shot Image Classification

A Closer Look at Prototype Classifier for Few-shot Image Classification

Few-Shot Cross-Domain Object Detection With Instance-Level Prototype-Based Meta-Learning

Research on image classification method based on improved multi-scale relational network

Prototype Bayesian Meta-Learning for Few-Shot Image Classification

Contrastive prototype network with prototype augmentation for few-shot classification

MetaNODE: Prototype Optimization as a Neural ODE for Few-Shot Learning

Progressive Neural Networks for Image Classification

ProtoDiff: Learning to Learn Prototypical Networks by Task-Guided Diffusion

Progressive Learning of Low-Precision Networks for Image Classification

Is the Meta-Learning Idea Able to Improve the Generalization of Deep Neural Networks on the Standard Supervised Learning?

Local descriptor-based multi-prototype network for few-shot Learning

Peer Review #1 of "research on Image Classification Method Based on Improved Multi-Scale Relational Network (V0.1)"

A Joint Optimization Framework of the Embedding Model and Classifier for Meta-Learning

Peer Review #2 of "research on Image Classification Method Based on Improved Multi-Scale Relational Network (V0.1)"

Progressive Meta-Pooling Learning for Lightweight Image Classification Model

Trainable Class Prototypes for Few-Shot Learning

Meta-learning Siamese Network for Few-Shot Text Classification.

Progressive Meta-Learning With Curriculum

Meta-Learning for Semi-Supervised Few-Shot Classification