Abstract:Large language models have found utility in the domain of robot task planning and task decomposition. Nevertheless, the direct application of these models for instructing robots in task execution is not without its challenges. Limitations arise in handling more intricate tasks, encountering difficulties in effective interaction with the environment, and facing constraints in the practical executability of machine control instructions directly generated by such models. In response to these challenges, this research advocates for the implementation of a multi-layer large language model to augment a robot's proficiency in handling complex tasks. The proposed model facilitates a meticulous layer-by-layer decomposition of tasks through the integration of multiple large language models, with the overarching goal of enhancing the accuracy of task planning. Within the task decomposition process, a visual language model is introduced as a sensor for environment perception. The outcomes of this perception process are subsequently assimilated into the large language model, thereby amalgamating the task objectives with environmental information. This integration, in turn, results in the generation of robot motion planning tailored to the specific characteristics of the current environment. Furthermore, to enhance the executability of task planning outputs from the large language model, a semantic alignment method is introduced. This method aligns task planning descriptions with the functional requirements of robot motion, thereby refining the overall compatibility and coherence of the generated instructions. To validate the efficacy of the proposed approach, an experimental platform is established utilizing an intelligent unmanned vehicle. This platform serves as a means to empirically verify the proficiency of the multi-layer large language model in addressing the intricate challenges associated with both robot task planning and execution.

FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models

MLDT: Multi-Level Decomposition for Complex Long-Horizon Robotic Task Planning with Open-Source Large Language Model

Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Representation

DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Models

ISR-LLM: Iterative Self-Refined Large Language Model for Long-Horizon Sequential Task Planning

CLFR-M: Continual Learning Framework for Robots Via Human Feedback and Dynamic Memory

LLM as BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planning

RePLan: Robotic Replanning with Perception and Language Models

Enhancing Robot Task Planning and Execution through Multi-Layer Large Language Models

Conformal Temporal Logic Planning using Large Language Models

Robot Task Planning Based on Large Language Model Representing Knowledge with Directed Graph Structures

Learning to Plan with Natural Language

Task and Motion Planning with Large Language Models for Object Rearrangement

SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Models

Retrieval-Augmented Hierarchical in-Context Reinforcement Learning and Hindsight Modular Reflections for Task Planning with LLMs

Towards Human Awareness in Robot Task Planning with Large Language Models

Enhancing Robot Task Planning: Integrating Environmental Information and Feedback Insights Through Large Language Models

Can We Rely on LLM Agents to Draft Long-Horizon Plans? Let's Take TravelPlanner as an Example

Translating Natural Language to Planning Goals with Large-Language Models

SRLM: Human-in-Loop Interactive Social Robot Navigation with Large Language Model and Deep Reinforcement Learning

LLM-based Robot Task Planning with Exceptional Handling for General Purpose Service Robots