Abstract:Recently, AI systems have made remarkable progress in various tasks. Deep Reinforcement Learning(DRL) is an effective tool for agents to learn policies in low-level state spaces to solve highly complex tasks. Researchers have introduced Intrinsic Motivation(IM) to the RL mechanism, which simulates the agent's curiosity, encouraging agents to explore interesting areas of the environment. This new feature has proved vital in enabling agents to learn policies without being given specific goals. However, even though DRL intelligence emerges through a sub-symbolic model, there is still a need for a sort of abstraction to understand the knowledge collected by the agent. To this end, the classical planning formalism has been used in recent research to explicitly represent the knowledge an autonomous agent acquires and effectively reach extrinsic goals. Despite classical planning usually presents limited expressive capabilities, PPDDL demonstrated usefulness in reviewing the knowledge gathered by an autonomous system, making explicit causal correlations, and can be exploited to find a plan to reach any state the agent faces during its experience. This work presents a new architecture implementing an open-ended learning system able to synthesize from scratch its experience into a PPDDL representation and update it over time. Without a predefined set of goals and tasks, the system integrates intrinsic motivations to explore the environment in a self-directed way, exploiting the high-level knowledge acquired during its experience. The system explores the environment and iteratively: (a) discover options, (b) explore the environment using options, (c) abstract the knowledge collected and (d) plan. This paper proposes an alternative approach to implementing open-ended learning architectures exploiting low-level and high-level representations to extend its knowledge in a virtuous loop.

Autonomous Discovery of Abstract Concepts by a Robot

Beyond imitation: Zero-shot task transfer on robots by learning concepts as cognitive programs

Towards Abstract Relational Learning in Human Robot Interaction

From Reals to Logic and Back: Inventing Symbolic Vocabularies, Actions and Models for Planning from Raw Data

How a Minimal Learning Agent can Infer the Existence of Unobserved Variables in a Complex Environment

Humanoid infers Archimedes' principle: understanding physical relations and object affordances through cumulative learning experiences

Abstraction and Analogy-Making in Artificial Intelligence

Discovering Conceptual Knowledge with Analytic Ontology Templates for Articulated Objects

Object-centric proto-symbolic behavioural reasoning from pixels

From Concrete to Abstract: A Multimodal Generative Approach to Abstract Concept Learning

Incremental learning of high-level concepts by imitation

Unsupervised, Bottom-up Category Discovery for Symbol Grounding with a Curious Robot

Bridging Intelligence and Instinct: A New Control Paradigm for Autonomous Robots

Adaptive Language-Guided Abstraction from Contrastive Explanations

Can I do it

Online Grounding of Symbolic Planning Domains in Unknown Environments

Synthesizing Evolving Symbolic Representations for Autonomous Systems

A survey of ontology-enabled processes for dependable robot autonomy

An Experimental Autonomous Articulated Robot that can Learn

Integrated Commonsense Reasoning and Deep Learning for Transparent Decision Making in Robotics

Learning abstract structure for drawing by efficient motor program induction