Abstract:Despite significant advancements in large language models (LLMs) that enhance robot agents' understanding and execution of natural language (NL) commands, ensuring the agents adhere to user-specified constraints remains challenging, particularly for complex commands and long-horizon tasks. To address this challenge, we present three key insights, equivalence voting, constrained decoding, and domain-specific fine-tuning, which significantly enhance LLM planners' capability in handling complex tasks. Equivalence voting ensures consistency by generating and sampling multiple Linear Temporal Logic (LTL) formulas from NL commands, grouping equivalent LTL formulas, and selecting the majority group of formulas as the final LTL formula. Constrained decoding then uses the generated LTL formula to enforce the autoregressive inference of plans, ensuring the generated plans conform to the LTL. Domain-specific fine-tuning customizes LLMs to produce safe and efficient plans within specific task domains. Our approach, Safe Efficient LLM Planner (SELP), combines these insights to create LLM planners to generate plans adhering to user commands with high confidence. We demonstrate the effectiveness and generalizability of SELP across different robot agents and tasks, including drone navigation and robot manipulation. For drone navigation tasks, SELP outperforms state-of-the-art planners by 10.8% in safety rate (i.e., finishing tasks conforming to NL commands) and by 19.8% in plan efficiency. For robot manipulation tasks, SELP achieves 20.4% improvement in safety rate. Our datasets for evaluating NL-to-LTL and robot task planning will be released in <a class="link-external link-http" href="http://github.com/lt-asset/selp" rel="external noopener nofollow">this http URL</a>.

Using Language to Generate State Abstractions for Long-Range Planning in Outdoor Environments

From Natural Language to Long-Range Path Plans in Outdoor Environments

SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Task Planning

SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning

Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Representation

Leveraging Environment Interaction for Automated PDDL Translation and Planning with Large Language Models

Reasoning about the Unseen for Efficient Outdoor Object Navigation

Leveraging LLMs, Graphs and Object Hierarchies for Task Planning in Large-Scale Environments

SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Models

Grounding Complex Natural Language Commands for Temporal Tasks in Unseen Environments

Conformal Temporal Logic Planning using Large Language Models

Large Language Models as Commonsense Knowledge for Large-Scale Task Planning

From Abstractions to Grounded Languages for Robust Coordination of Task Planning Robots

CARTIER: Cartographic lAnguage Reasoning Targeted at Instruction Execution for Robots

Learning to reason over scene graphs: a case study of finetuning GPT-2 into a robot language model for grounded task planning

Learning adaptive planning representations with natural language guidance

Open-vocabulary Queryable Scene Representations for Real World Planning

Robot Task Planning Based on Large Language Model Representing Knowledge with Directed Graph Structures

Language-Augmented Symbolic Planner for Open-World Task Planning

Human Planning of Robot Actions through LLM-guided State Machine Synthesis