Abstract:Humans excel at adapting perceptions and actions to diverse environments, enabling efficient interaction with the external world. This adaptive capability relies on the biological nervous system (BNS), which activates different brain regions for distinct tasks. Meta-learning similarly trains machines to handle multiple tasks but relies on a fixed network structure, not as flexible as BNS. To investigate the role of flexible network structure (FNS) in meta-learning, we conduct extensive empirical and theoretical analyses, finding that model performance is tied to structure, with no universally optimal pattern across tasks. This reveals the crucial role of FNS in meta-learning, ensuring meta-learning to generate the optimal structure for each task, thereby maximizing the performance and learning efficiency of meta-learning. Motivated by this insight, we propose to define, measure, and model FNS in meta-learning. First, we define that an effective FNS should possess frugality, plasticity, and sensitivity. Then, to quantify FNS in practice, we present three measurements for these properties, collectively forming the \emph{structure constraint} with theoretical supports. Building on this, we finally propose Neuromodulated Meta-Learning (NeuronML) to model FNS in meta-learning. It utilizes bi-level optimization to update both weights and structure with the structure constraint. Extensive theoretical and empirical evaluations demonstrate the effectiveness of NeuronML on various tasks. Code is publicly available at \href{<a class="link-external link-https" href="https://github.com/WangJingyao07/NeuronML" rel="external noopener nofollow">this https URL</a>}{<a class="link-external link-https" href="https://github.com/WangJingyao07/NeuronML" rel="external noopener nofollow">this https URL</a>}.

The reinforcement metalearner as a biologically plausible meta-learning framework

Meta-Learned Models of Cognition

Meta-learning goes hand-in-hand with metacognition

Meta-learning in active inference

Reinforcement Teaching

Meta-learning as a bridge between neural networks and symbolic Bayesian models

Towards Biologically Plausible Deep Learning

Meta-learning biologically plausible plasticity rules with random feedback pathways

Interpretable Meta-Learning of Physical Systems

Probabilistic programming versus meta-learning as models of cognition

MAMBA: an Effective World Model Approach for Meta-Reinforcement Learning

Meta-Models: An Architecture for Decoding LLM Behaviors Through Interpreted Embeddings and Natural Language

Deep Interactive Bayesian Reinforcement Learning via Meta-Learning

Meta-learning in natural and artificial intelligence

A Meta Understanding of Meta-Learning

Meta-Learning Strategies through Value Maximization in Neural Networks

Meta-Learning in Neural Networks: A Survey

Rethinking the hippocampal cognitive map as a meta-learning computational module

Neuromodulated Meta-Learning

Meta-Learning Requires Meta-Augmentation