Abstract:Large language models have found utility in the domain of robot task planning and task decomposition. Nevertheless, the direct application of these models for instructing robots in task execution is not without its challenges. Limitations arise in handling more intricate tasks, encountering difficulties in effective interaction with the environment, and facing constraints in the practical executability of machine control instructions directly generated by such models. In response to these challenges, this research advocates for the implementation of a multi-layer large language model to augment a robot's proficiency in handling complex tasks. The proposed model facilitates a meticulous layer-by-layer decomposition of tasks through the integration of multiple large language models, with the overarching goal of enhancing the accuracy of task planning. Within the task decomposition process, a visual language model is introduced as a sensor for environment perception. The outcomes of this perception process are subsequently assimilated into the large language model, thereby amalgamating the task objectives with environmental information. This integration, in turn, results in the generation of robot motion planning tailored to the specific characteristics of the current environment. Furthermore, to enhance the executability of task planning outputs from the large language model, a semantic alignment method is introduced. This method aligns task planning descriptions with the functional requirements of robot motion, thereby refining the overall compatibility and coherence of the generated instructions. To validate the efficacy of the proposed approach, an experimental platform is established utilizing an intelligent unmanned vehicle. This platform serves as a means to empirically verify the proficiency of the multi-layer large language model in addressing the intricate challenges associated with both robot task planning and execution.

Robot Debater: Debate-styled Text Auto-generation System Based on Large Foundation Language Models

Can LLMs Beat Humans in Debating? A Dynamic Multi-agent Framework for Competitive Debate

Automatic Robotic Development through Collaborative Framework by Large Language Models

Decision-Making in Robotic Grasping with Large Language Models.

Debatrix: Multi-dimensional Debate Judge with Iterative Chronological Analysis Based on LLM

ARO: Large Language Model Supervised Robotics Text2Skill Autonomous Learning

Evaluating the Performance of Large Language Models via Debates

Understanding Large-Language Model (LLM)-powered Human-Robot Interaction

ACC-Debate: An Actor-Critic Approach to Multi-Agent Debate

Assisted Debate Builder with Large Language Models

Domain-Specific Fine-Tuning of Large Language Models for Interactive Robot Programming

Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate

RoboCoder: Robotic Learning from Basic Skills to General Tasks with Large Language Models

Enhancing Robot Task Planning and Execution through Multi-Layer Large Language Models

Diagnosing Robotics Systems Issues with Large Language Models

A Full-duplex Speech Dialogue Scheme Based On Large Language Models

MHRC: Closed-loop Decentralized Multi-Heterogeneous Robot Collaboration with Large Language Models

Cocobo: Exploring Large Language Models as the Engine for End-User Robot Programming

An Empirical Analysis on Large Language Models in Debate Evaluation

Building a hospitable and reliable dialogue system for android robots: a scenario-based approach with large language models

LLMs as Debate Partners: Utilizing Genetic Algorithms and Adversarial Search for Adaptive Arguments