Abstract:Model-based reasoning agents are ill-equipped to act in novel situations in which their model of the environment no longer sufficiently represents the world. We propose HYDRA, a framework for designing model-based agents operating in mixed discrete-continuous worlds that can autonomously detect when the environment has evolved from its canonical setup, understand how it has evolved, and adapt the agents' models to perform effectively. HYDRA is based upon PDDL+, a rich modeling language for planning in mixed, discrete-continuous environments. It augments the planning module with visual reasoning, task selection, and action execution modules for closed-loop interaction with complex environments. HYDRA implements a novel meta-reasoning process that enables the agent to monitor its own behavior from a variety of aspects. The process employs a diverse set of computational methods to maintain expectations about the agent's own behavior in an environment. Divergences from those expectations are useful in detecting when the environment has evolved and identifying opportunities to adapt the underlying models. HYDRA builds upon ideas from diagnosis and repair and uses a heuristics-guided search over model changes such that they become competent in novel conditions. The HYDRA framework has been used to implement novelty-aware agents for three diverse domains - CartPole++ (a higher dimension variant of a classic control problem), Science Birds (an IJCAI competition problem 1 ), and PogoStick (a specific problem domain in Minecraft). We report empirical observations from these domains to demonstrate the efficacy of various components in the novelty meta-reasoning process.

DyKnow: A Framework for Processing Dynamic Knowledge and Object Structures in Autonomous Systems

Hastily formed knowledge networks and distributed situation awareness for collaborative robotics

Knowledge-Enabled Decision Making for Robotic System Utilizing Ambient Service Components

KRIOTA: A framework for Knowledge-management of dynamic Reference Information and Optimal Task Assignment in hybrid edge–cloud environments to support situation-aware robot-assisted operations

Knowledge-based and Data-driven Reasoning and Learning for Ad Hoc Teamwork

A dynamic knowledge graph approach to distributed self-driving laboratories

Linear independence of Gamma values in positive characteristic

Using Knowledge Awareness to improve Safety of Autonomous Driving

Hidden unity in the quantum description of matter

An Agent-based Architecture for a Knowledge-work Support System

Integrated Commonsense Reasoning and Deep Learning for Transparent Decision Making in Robotics

DAC-h3: A Proactive Robot Cognitive Architecture to Acquire and Express Knowledge About the World and the Self

KANT: A tool for Grounding and Knowledge Management

Robo-CSK-Organizer: Commonsense Knowledge to Organize Detected Objects for Multipurpose Robots

A Reasoning System about Knowledge Acquisition in Bi-Agent Interaction

LAAIR: A Layered Architecture for Autonomous Interactive Robots

A Multi-Layered Component-Based Approach for the Development of Aerial Robotic Systems: The Aerostack Framework

Knowledge-based dialogue for dynamic systems

A Framework for Function Knowledge Processing in Complex System Design

A Domain-Independent Agent Architecture for Adaptive Operation in Evolving Open Worlds

A Reasoning System about Bi-Agent Knowledge Sharing