Abstract:To enable non-experts to specify long-horizon, multi-robot collaborative tasks, language models are increasingly used to translate natural language commands into formal specifications. However, because translation can occur in multiple ways, such translations may lack accuracy or lead to inefficient multi-robot planning. Our key insight is that concise hierarchical specifications can simplify planning while remaining straightforward to derive from human instructions. We propose~\acronym{}, a framework that translates natural language commands into hierarchical Linear Temporal Logic (LTL) and solves the corresponding planning problem. The translation involves two steps leveraging Large Language Models (LLMs). First, an LLM transforms instructions into a Hierarchical Task Tree, capturing logical and temporal relations. Next, a fine-tuned LLM converts sub-tasks into flat LTL formulas, which are aggregated into hierarchical specifications, with the lowest level corresponding to ordered robot actions. These specifications are then used with off-the-shelf planners. Our~\acronym{} demonstrates the potential of LLMs in hierarchical reasoning for multi-robot task planning. Evaluations in simulation and real-world experiments with human participants show that~\acronym{} outperforms existing methods, handling more complex instructions while achieving higher success rates and lower costs in task allocation and planning. Additional details are available at <a class="link-external link-https" href="https://nl2hltl2plan.github.io" rel="external noopener nofollow">this https URL</a> .

NL2STL: Transformation from Logic Natural Language to Signal Temporal Logics Using Llama2

DeepSTL -- From English Requirements to Signal Temporal Logic

Learning Signal Temporal Logic through Neural Network for Interpretable Classification

TLINet: Differentiable Neural Network Temporal Logic Inference

Neural Network for Weighted Signal Temporal Logic

stl2vec: Semantic and Interpretable Vector Representation of Temporal Logic

Funnel-based Reward Shaping for Signal Temporal Logic Tasks in Reinforcement Learning

nl2spec: Interactively Translating Unstructured Natural Language to Temporal Logics with Large Language Models

Tractable Reinforcement Learning of Signal Temporal Logic Objectives

An Efficient Formula Synthesis Method with Past Signal Temporal Logic

Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Representation

Signal Temporal Logic Synthesis under Model Predictive Control: A Low Complexity Approach

Unlocking Temporal Question Answering for Large Language Models Using Code Execution

Tractable Reinforcement Learning for Signal Temporal Logic Tasks with Counterfactual Experience Replay

Multi-class Temporal Logic Neural Networks

Rethinking STS and NLI in Large Language Models

STL: Still Tricky Logic (for System Validation, Even When Showing Your Work)

Learning to Program with Natural Language

Scalable Signal Temporal Logic Guided Reinforcement Learning via Value Function Space Optimization

A Flexible and Efficient Temporal Logic Tool for Python: PyTeLo

Speech Translation with Large Language Models: An Industrial Practice