Abstract:Recently, AI systems have made remarkable progress in various tasks. Deep Reinforcement Learning(DRL) is an effective tool for agents to learn policies in low-level state spaces to solve highly complex tasks. Researchers have introduced Intrinsic Motivation(IM) to the RL mechanism, which simulates the agent's curiosity, encouraging agents to explore interesting areas of the environment. This new feature has proved vital in enabling agents to learn policies without being given specific goals. However, even though DRL intelligence emerges through a sub-symbolic model, there is still a need for a sort of abstraction to understand the knowledge collected by the agent. To this end, the classical planning formalism has been used in recent research to explicitly represent the knowledge an autonomous agent acquires and effectively reach extrinsic goals. Despite classical planning usually presents limited expressive capabilities, PPDDL demonstrated usefulness in reviewing the knowledge gathered by an autonomous system, making explicit causal correlations, and can be exploited to find a plan to reach any state the agent faces during its experience. This work presents a new architecture implementing an open-ended learning system able to synthesize from scratch its experience into a PPDDL representation and update it over time. Without a predefined set of goals and tasks, the system integrates intrinsic motivations to explore the environment in a self-directed way, exploiting the high-level knowledge acquired during its experience. The system explores the environment and iteratively: (a) discover options, (b) explore the environment using options, (c) abstract the knowledge collected and (d) plan. This paper proposes an alternative approach to implementing open-ended learning architectures exploiting low-level and high-level representations to extend its knowledge in a virtuous loop.

SDRL: Interpretable and Data-efficient Deep Reinforcement Learning Leveraging Symbolic Planning

Learning Symbolic Rules for Interpretable Deep Reinforcement Learning

Creativity of AI: Automatic Symbolic Option Discovery for Facilitating Deep Reinforcement Learning

Symbolic Visual Reinforcement Learning: A Scalable Framework with Object-Level Abstraction and Differentiable Expression Search

What Should I Do Now? Marrying Reinforcement Learning and Symbolic Planning

Efficient Symbolic Policy Learning with Differentiable Symbolic Expression

Interpretable Modeling of Deep Reinforcement Learning Driven Scheduling

Synthesizing Evolving Symbolic Representations for Autonomous Systems

Towards Symbolic Reinforcement Learning with Common Sense

Learning for Long-Horizon Planning via Neuro-Symbolic Abductive Imitation

Understanding Via Exploration: Discovery of Interpretable Features with Deep Reinforcement Learning.

Leveraging Reward Consistency for Interpretable Feature Discovery in Reinforcement Learning

Effective Reinforcement Learning Based on Structural Information Principles

Self-Supervised Discovering of Interpretable Features for Reinforcement Learning

DeRL: Coupling Decomposition in Action Space for Reinforcement Learning Task

Learning Sketch Decompositions in Planning via Deep Reinforcement Learning

SADRL: Merging human experience with machine intelligence via supervised assisted deep reinforcement learning

Neurosymbolic Reinforcement Learning and Planning: A Survey

A data-efficient goal-directed deep reinforcement learning method for robot visuomotor skill

Exploration-efficient Deep Reinforcement Learning with Demonstration Guidance for Robot Control

Interpretable end-to-end Neurosymbolic Reinforcement Learning agents