Abstract:Recently, AI systems have made remarkable progress in various tasks. Deep Reinforcement Learning(DRL) is an effective tool for agents to learn policies in low-level state spaces to solve highly complex tasks. Researchers have introduced Intrinsic Motivation(IM) to the RL mechanism, which simulates the agent's curiosity, encouraging agents to explore interesting areas of the environment. This new feature has proved vital in enabling agents to learn policies without being given specific goals. However, even though DRL intelligence emerges through a sub-symbolic model, there is still a need for a sort of abstraction to understand the knowledge collected by the agent. To this end, the classical planning formalism has been used in recent research to explicitly represent the knowledge an autonomous agent acquires and effectively reach extrinsic goals. Despite classical planning usually presents limited expressive capabilities, PPDDL demonstrated usefulness in reviewing the knowledge gathered by an autonomous system, making explicit causal correlations, and can be exploited to find a plan to reach any state the agent faces during its experience. This work presents a new architecture implementing an open-ended learning system able to synthesize from scratch its experience into a PPDDL representation and update it over time. Without a predefined set of goals and tasks, the system integrates intrinsic motivations to explore the environment in a self-directed way, exploiting the high-level knowledge acquired during its experience. The system explores the environment and iteratively: (a) discover options, (b) explore the environment using options, (c) abstract the knowledge collected and (d) plan. This paper proposes an alternative approach to implementing open-ended learning architectures exploiting low-level and high-level representations to extend its knowledge in a virtuous loop.

DReAM: Dynamic Reconfigurable Architecture Modeling (full paper)

Parameterized Abstract Model for Reconfigurable Systems

Design Of A Simulator For Mesh-Based Reconfigurable Architectures

Simulation of Dynamically Structured Systems in a Model-Based System Engineering Approach Applied to Reconfigurable Hardware

An Automated Formal Approach to Managing Dynamic Reconfiguration

DEVSMO: an ontology of DEVS model representation for model reuse

Modeling Reconfigurable Information Systems by Using an Executable Algebraic Framework

Issues of Architectural Description Languages for Handling Dynamic Reconfiguration

An Empirical Comparison of Formalisms for Modelling and Analysis of Dynamic Reconfiguration of Dependable Systems

A Model-Driven Platform for Dynamic Partially Reconfigurable Architectures: A Case Study of a Watermarking System

An Open Distributed Architecture for Flexible Hybrid Assembly Systems: A Model Driven Engineering Approach

Integrated Research and Development Environment for Real-Time Distributed Embodied Intelligent Systems

Design of Embedded System Supporting Remote Dynamic Reconfiguration

Modeling and Simulation Framework for Dynamic Reconfigurable Computing System Using Term-rewriting

DReAC:A Novel Dynamically Reconfigurable Co-Processor

DECAF: a Discrete-Event based Collaborative Human-Robot Framework for Furniture Assembly

Synthesizing Evolving Symbolic Representations for Autonomous Systems

MA-Dreamer: Coordination and communication through shared imagination

A Hierarchical Architectural Framework for Reconfigurable Logic Computing

Reconfigurable Electromagnetic Environments: A General Framework

Architecture, Challenges And Applications Of Dynamic Reconfigurable Computing