Abstract:The intersection between neuroscience and artificial intelligence (AI) research has created synergistic effects in both fields. While neuroscientific discoveries have inspired the development of AI architectures, new ideas and algorithms from AI research have produced new ways to study brain mechanisms. A well-known example is the case of reinforcement learning (RL), which has stimulated neuroscience research on how animals learn to adjust their behavior to maximize reward. In this review article, we cover recent collaborative work between the two fields in the context of meta-learning and its extension to social cognition and consciousness. Meta-learning refers to the ability to learn how to learn, such as learning to adjust hyperparameters of existing learning algorithms and how to use existing models and knowledge to efficiently solve new tasks. This meta-learning capability is important for making existing AI systems more adaptive and flexible to efficiently solve new tasks. Since this is one of the areas where there is a gap between human performance and current AI systems, successful collaboration should produce new ideas and progress. Starting from the role of RL algorithms in driving neuroscience, we discuss recent developments in deep RL applied to modeling prefrontal cortex functions. Even from a broader perspective, we discuss the similarities and differences between social cognition and meta-learning, and finally conclude with speculations on the potential links between intelligence as endowed by model-based RL and consciousness. For future work we highlight data efficiency, autonomy and intrinsic motivation as key research areas for advancing both fields.

Meta-learning goes hand-in-hand with metacognition

Meta-learning in active inference

Meta-Learned Models of Cognition

The reinforcement metalearner as a biologically plausible meta-learning framework

Meta-learning: Data, architecture, and both

Meta-learning as a bridge between neural networks and symbolic Bayesian models

A Meta Understanding of Meta-Learning

Meta-learning, social cognition and consciousness in brains and machines

Quo vadis, planning?

Meta-learning in natural and artificial intelligence

Meta-Learning Requires Meta-Augmentation

Meta-in-context learning in large language models

Meta-Learning in Neural Networks: A Survey

A Comprehensive Overview and Survey of Recent Advances in Meta-Learning

Learning a metacognition for object perception

A Survey of Meta-learning for Classification Tasks

Informed Meta-Learning

Probabilistic programming versus meta-learning as models of cognition

More Flexible PAC-Bayesian Meta-Learning by Learning Learning Algorithms

Metacognition is all you need? Using Introspection in Generative Agents to Improve Goal-directed Behavior

Meta-Models: An Architecture for Decoding LLM Behaviors Through Interpreted Embeddings and Natural Language