Abstract:To enable non-experts to specify long-horizon, multi-robot collaborative tasks, language models are increasingly used to translate natural language commands into formal specifications. However, because translation can occur in multiple ways, such translations may lack accuracy or lead to inefficient multi-robot planning. Our key insight is that concise hierarchical specifications can simplify planning while remaining straightforward to derive from human instructions. We propose~\acronym{}, a framework that translates natural language commands into hierarchical Linear Temporal Logic (LTL) and solves the corresponding planning problem. The translation involves two steps leveraging Large Language Models (LLMs). First, an LLM transforms instructions into a Hierarchical Task Tree, capturing logical and temporal relations. Next, a fine-tuned LLM converts sub-tasks into flat LTL formulas, which are aggregated into hierarchical specifications, with the lowest level corresponding to ordered robot actions. These specifications are then used with off-the-shelf planners. Our~\acronym{} demonstrates the potential of LLMs in hierarchical reasoning for multi-robot task planning. Evaluations in simulation and real-world experiments with human participants show that~\acronym{} outperforms existing methods, handling more complex instructions while achieving higher success rates and lower costs in task allocation and planning. Additional details are available at <a class="link-external link-https" href="https://nl2hltl2plan.github.io" rel="external noopener nofollow">this https URL</a> .

An Accurate HDDL Domain Learning Algorithm from Partial and Noisy Observations

Hagan: Hierarchical Attentive Adversarial Learning For Task-Oriented Dialogue System

HILONet: Hierarchical Imitation Learning from Non-Aligned Observations

Automatically Learning HTN Methods from Landmarks

Refining HTN Methods via Task Insertion with Preferences

HATP: An HTN Planner for Robotics

Task Interaction in an HTN Planner

Hierarchical Modular Reinforcement Learning Method and Knowledge Acquisition of State-Action Rule for Multi-target Problem

Goal-Conditioned Hierarchical Reinforcement Learning with High-Level Model Approximation.

Hierarchical reinforcement learning for efficient exploration and transfer

Hierarchical Reinforcement Learning for Deep Goal Reasoning: An Expressiveness Analysis

Une approche totalement instanciée pour la planification HTN

Hierarchical Reinforcement Learning with Abductive Planning

Hierarchical Task Network Planning for Facilitating Cooperative Multi-Agent Reinforcement Learning

Hierarchical Subtask Discovery With Non-Negative Matrix Factorization

Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Representation

Retrieval-Augmented Hierarchical in-Context Reinforcement Learning and Hindsight Modular Reflections for Task Planning with LLMs

Hierarchical Reinforcement Learning in Complex 3D Environments

HirMTL: Hierarchical Multi-Task Learning for dense scene understanding

LLM Augmented Hierarchical Agents

HYDRA: Hybrid Robot Actions for Imitation Learning