Abstract:Creating autonomous robots that can actively explore the environment, acquire knowledge and learn skills continuously is the ultimate achievement envisioned in cognitive and developmental robotics. Importantly, if the aim is to create robots that can continuously develop through interactions with their environment, their learning processes should be based on interactions with their physical and social world in the manner of human learning and cognitive development. Based on this context, in this paper, we focus on the two concepts of world models and predictive coding . Recently, world models have attracted renewed attention as a topic of considerable interest in artificial intelligence. Cognitive systems learn world models to better predict future sensory observations and optimize their policies, i.e. controllers. Alternatively, in neuroscience, predictive coding proposes that the brain continuously predicts its inputs and adapts to model its own dynamics and control behavior in its environment. Both ideas may be considered as underpinning the cognitive development of robots and humans capable of continual or lifelong learning. Although many studies have been conducted on predictive coding in cognitive robotics and neurorobotics, the relationship between world model-based approaches in AI and predictive coding in robotics has rarely been discussed. Therefore, in this paper, we clarify the definitions, relationships, and status of current research on these topics, as well as missing pieces of world models and predictive coding in conjunction with crucially related concepts such as the free-energy principle and active inference in the context of cognitive and developmental robotics. Furthermore, we outline the frontiers and challenges involved in world models and predictive coding toward the further integration of AI and robotics, as well as the creation of robots with real cognitive and developmental capabilities in the future. GRAPHICAL

World models and predictive coding for cognitive and developmental robotics: frontiers and challenges

World model learning and inference

Predictive World Models from Real-World Partial Observations

Robotic world models-conceptualization, review, and engineering best practices

Predictive Processing in Cognitive Robotics: A Review

Autonomous cognitive developmental models of robots-a survey

Transferring Adaptive Theory of Mind to social robots: insights from developmental psychology to robotics

Understanding World or Predicting Future? A Comprehensive Survey of World Models

The Development and Challenges of Robot Cognition

Discovering Latent States for Model Learning: Applying Sensorimotor Contingencies Theory and Predictive Processing to Model Context

Active Predictive Coding: A Unified Neural Framework for Learning Hierarchical World Models for Perception and Planning

How Cognitive Models of Human Body Experience Might Push Robotics

Efficient multitask learning with an embodied predictive model for door opening and entry with whole-body control

A whole brain probabilistic generative model: Toward realizing cognitive architectures for developmental robots

A psychology based approach for longitudinal development in cognitive robotics

From Babies to Robots: The Contribution of Developmental Robotics to Developmental Psychology

Sample Efficient Robot Learning with Structured World Models

Development model of autonomous developing robots with independent environmental cognition

Deep Dive into Model-free Reinforcement Learning for Biological and Robotic Systems: Theory and Practice

DayDreamer: World Models for Physical Robot Learning

Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imagination