Abstract:We often specify tasks for a robot using temporal language that can include different levels of abstraction. For example, the command “go to the kitchen before going to the second floor” contains spatial abstraction, given that “floor” consists of individual rooms that can also be referred to in isolation (“kitchen”, for example). There is also a temporal ordering of events, defined by the word “before”. Previous works have used syntactically co-safe Linear Temporal Logic (sc-LTL) to interpret temporal language (such as “before”), and Abstract Markov Decision Processes (AMDPs) to interpret hierarchical abstractions (such as “kitchen” and “second floor”), separately. To handle both types of commands at once, we introduce the Abstract Product Markov Decision Process (AP-MDP), a novel approach capable of representing non-Markovian reward functions at different levels of abstractions. The AP-MDP framework translates LTL into its corresponding automata, creates a product Markov Decision Process (MDP) of the LTL specification and the environment MDP, and decomposes the problem into subproblems to enable efficient planning with abstractions. AP-MDP performs faster than a non-hierarchical method of solving LTL problems in over 95 % of path planning tasks, and this number only increases as the size of the environment domain increases. In a cleanup world domain, AP-MDP performs faster in over 98% of tasks. We also present a neural sequence-to-sequence model trained to translate language commands into LTL expression, and a new corpus of non-Markovian language commands spanning different levels of abstraction. We test our framework with the collected language commands on two drones, demonstrating that our approach enables robots to efficiently solve temporal commands at different levels of abstraction in both indoor and outdoor environments.

Hierarchical Extraction, Planning and Behavior Tree Process Control Based on Historical Trajectory

Hierarchical Path Planning for Autonomous Forklifts in Complex Industrial Environments

Robot Planning Based on Behavior Tree and Knowledge Graph

Decomposition-based Hierarchical Task Allocation and Planning for Multi-Robots under Hierarchical Temporal Logic Specifications

Hierarchical Learning with Heuristic Guidance for Multi-task Assignment and Distributed Planning in Interactive Scenarios

Hierarchical Planning with State Abstractions for Temporal Task Specifications.

Application of Hierarchical Task Network Planning to Uninhabited Combat Aerial Vehicles Planning

Hierarchical Task Planning for Power Line Flow Regulation

A Hybrid Approach to Planning and Execution in Dynamic Environments Through Hierarchical Task Networks and Behavior Trees

Planning-Augmented Hierarchical Reinforcement Learning

Knowledge-Based Hierarchical POMDPs for Task Planning

Broadly-Exploring, Local-Policy Trees for Long-Horizon Task Planning

Human-Aware Robot Task Planning Based on a Hierarchical Task Model

A hierarchical system modelling mechanism for planning in transportation and logistics

Hierarchical Planning for Agent-Based Traffic Management and Control

The hierarchical task network planning method based on Monte Carlo Tree Search

Hierarchical Reinforcement Learning Based on Planning Operators

Compositional Foundation Models for Hierarchical Planning

Hierarchical Task Planning for Space Manipulator with Multi-constraint

HDPlanner: Advancing Autonomous Deployments in Unknown Environments through Hierarchical Decision Networks

Optimized Execution of PDDL Plans using Behavior Trees