Abstract:Despite significant advancements in large language models (LLMs) that enhance robot agents' understanding and execution of natural language (NL) commands, ensuring the agents adhere to user-specified constraints remains challenging, particularly for complex commands and long-horizon tasks. To address this challenge, we present three key insights, equivalence voting, constrained decoding, and domain-specific fine-tuning, which significantly enhance LLM planners' capability in handling complex tasks. Equivalence voting ensures consistency by generating and sampling multiple Linear Temporal Logic (LTL) formulas from NL commands, grouping equivalent LTL formulas, and selecting the majority group of formulas as the final LTL formula. Constrained decoding then uses the generated LTL formula to enforce the autoregressive inference of plans, ensuring the generated plans conform to the LTL. Domain-specific fine-tuning customizes LLMs to produce safe and efficient plans within specific task domains. Our approach, Safe Efficient LLM Planner (SELP), combines these insights to create LLM planners to generate plans adhering to user commands with high confidence. We demonstrate the effectiveness and generalizability of SELP across different robot agents and tasks, including drone navigation and robot manipulation. For drone navigation tasks, SELP outperforms state-of-the-art planners by 10.8% in safety rate (i.e., finishing tasks conforming to NL commands) and by 19.8% in plan efficiency. For robot manipulation tasks, SELP achieves 20.4% improvement in safety rate. Our datasets for evaluating NL-to-LTL and robot task planning will be released in <a class="link-external link-http" href="http://github.com/lt-asset/selp" rel="external noopener nofollow">this http URL</a>.

Isr-llm: Iterative self-refined large language model for long-horizon sequential task planning

ISR-LLM: Iterative Self-Refined Large Language Model for Long-Horizon Sequential Task Planning

FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models

DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Models

LLM as BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planning

MLDT: Multi-Level Decomposition for Complex Long-Horizon Robotic Task Planning with Open-Source Large Language Model

Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Representation

RePLan: Robotic Replanning with Perception and Language Models

LASP: Surveying the State-of-the-Art in Large Language Model-Assisted AI Planning

Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Tasks

SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Models

Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents

LLM+P: Empowering Large Language Models with Optimal Planning Proficiency

Translating Natural Language to Planning Goals with Large-Language Models

SRLM: Human-in-Loop Interactive Social Robot Navigation with Large Language Model and Deep Reinforcement Learning

Language models are robotic planners: reframing plans as goal refinement graphs

Asynchronous Large Language Model Enhanced Planner for Autonomous Driving

From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous Systems

LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworks

Large Language Models are Learnable Planners for Long-Term Recommendation

Interactive and Expressive Code-Augmented Planning with Large Language Models