Abstract:This research focuses on how Large Language Models (LLMs) can help with (path) planning for mobile embodied agents such as robots, in a human-in-the-loop and interactive manner. A novel framework named LLM A*, aims to leverage the commonsense of LLMs, and the utility-optimal A* is proposed to facilitate few-shot near-optimal path planning. Prompts are used for two main purposes: 1) to provide LLMs with essential information like environments, costs, heuristics, etc.; 2) to communicate human feedback on intermediate planning results to LLMs. This approach takes human feedback on board and renders the entire planning process transparent (akin to a `white box') to humans. Moreover, it facilitates code-free path planning, thereby fostering the accessibility and inclusiveness of artificial intelligence techniques to communities less proficient in coding. Comparative analysis against A* and RL demonstrates that LLM A* exhibits greater efficiency in terms of search space and achieves paths comparable to A* while outperforming RL. The interactive nature of LLM A* also makes it a promising tool for deployment in collaborative human-robot tasks. Codes and Supplemental Materials can be found at GitHub: <a class="link-external link-https" href="https://github.com/speedhawk/LLM-A-" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper aims to address the problem of path planning for mobile robots, specifically how to achieve efficient and approximately optimal path planning in human-robot interaction environments through large language models (LLMs). Specifically, the paper proposes a new framework called LLM A*, which combines the common-sense understanding of LLMs with the optimality of the A* algorithm to achieve the following goals: 1. **Improve path planning efficiency**: By leveraging the common-sense knowledge of LLMs and the search capabilities of the A* algorithm, reduce the search space and improve the efficiency of path planning. 2. **Enhance path planning transparency**: Through human-robot interaction, make the entire path planning process transparent to human users, similar to a "white-box" operation, thereby improving safety. 3. **Promote code-independent path planning**: Through natural language interaction, enable non-programming experts to easily perform path planning, increasing the accessibility and inclusivity of artificial intelligence technology. 4. **Optimize path quality**: Compared to traditional A* algorithms and reinforcement learning (RL) methods, LLM A* can perform better in terms of search space, path length, and path smoothness. ### Main Contributions 1. **First proposed LLM-based A* algorithm**: Proposed LLM A*, a novel path planning method that combines LLMs and the A* algorithm, and defined a series of metrics to evaluate performance. 2. **Interactivity and code independence**: The interactivity and code independence of LLM A* make it attractive to non-professional robot users. 3. **Enhanced safety**: Due to human involvement in the planning process and full control, LLM A* is superior in safety compared to A* and RL. ### Experimental Results Experimental results show that LLM A* outperforms or is comparable to A* and RL in multiple environments, particularly in terms of search complexity and path smoothness. Specifically: - **Search complexity**: The search complexity of LLM A* is lower than that of A* and PPO, indicating its effectiveness in reducing the search space. - **Path length**: LLM A* is comparable to A* in path length and superior to PPO and LLM Greedy. - **Maximum Deviation Times (MDT)**: LLM A* performs well in path smoothness, similar to A* and PPO, but better than LLM Greedy. ### Conclusion By combining LLMs with the classic A* algorithm, the paper proposes a new path planning method, LLM A*, which has made significant progress in improving path planning efficiency, enhancing transparency, and safety. Although there is still room for improvement in some aspects of LLM A*, its unique advantages make it an important direction for future research in robot path planning.

LLM A: Human in the Loop Large Language Models Enabled A Search for Robotics

LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planning

Embodied AI in Mobile Robots: Coverage Path Planning with Large Language Models

SRLM: Human-in-Loop Interactive Social Robot Navigation with Large Language Model and Deep Reinforcement Learning

From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous Systems

LLM+P: Empowering Large Language Models with Optimal Planning Proficiency

3P-LLM: Probabilistic Path Planning using Large Language Model for Autonomous Robot Navigation

Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environments

LAP, Using Action Feasibility for Improved Uncertainty Alignment of Large Language Model Planners

LLM+ A: Grounding Large Language Models in Physical World with Affordance Prompting

Understanding Large-Language Model (LLM)-powered Human-Robot Interaction

Leveraging Large Language Models for Comprehensive Locomotion Control in Humanoid Robots Design

LLM-Based Human-Robot Collaboration Framework for Manipulation Tasks

Towards Human Awareness in Robot Task Planning with Large Language Models

LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning with LM-Driven PDDL Planner

SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models

GG-LLM: Geometrically Grounding Large Language Models for Zero-shot Human Activity Forecasting in Human-Aware Task Planning

Autonomous Behavior Planning For Humanoid Loco-manipulation Through Grounded Language Model

LLM as BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planning

Grounding Language Models in Autonomous Loco-manipulation Tasks

ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoning

LLM A*: Human in the Loop Large Language Models Enabled A* Search for Robotics