SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models

Shyam Sundar Kannan,Vishnunandan L. N. Venkatesh,Byung-Cheol Min

2024-03-23

Abstract:In this work, we introduce SMART-LLM, an innovative framework designed for embodied multi-robot task planning. SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models (LLMs), harnesses the power of LLMs to convert high-level task instructions provided as input into a multi-robot task plan. It accomplishes this by executing a series of stages, including task decomposition, coalition formation, and task allocation, all guided by programmatic LLM prompts within the few-shot prompting paradigm. We create a benchmark dataset designed for validating the multi-robot task planning problem, encompassing four distinct categories of high-level instructions that vary in task complexity. Our evaluation experiments span both simulation and real-world scenarios, demonstrating that the proposed model can achieve promising results for generating multi-robot task plans. The experimental videos, code, and datasets from the work can be found at <a class="link-external link-https" href="https://sites.google.com/view/smart-llm/" rel="external noopener nofollow">this https URL</a>.

Robotics

What problem does this paper attempt to address?

The paper attempts to address the problem of how to efficiently decompose, allocate, and execute complex tasks described in natural language within a multi-robot system. Specifically, the authors propose a framework called SMART-LLM, which leverages large language models (LLMs) to achieve this goal. The main issues include:

1. **Task Decomposition**: Breaking down high-level task instructions into multiple subtasks, each corresponding to specific actions or operations.
2. **Coalition Formation**: Forming appropriate robot teams to complete the subtasks based on the robots' skills and environmental conditions.
3. **Task Allocation**: Assigning subtasks to individual robots or robot teams with the corresponding skills.
4. **Task Execution**: Ensuring that tasks are executed in the correct order and schedule to maximize the efficiency of the multi-robot system.

Through these steps, SMART-LLM aims to address the limitations of traditional multi-robot task planning methods in handling diverse and complex tasks. Particularly, in cases where task descriptions are incomplete or ambiguous, it can utilize the powerful natural language understanding and reasoning capabilities of LLMs to generate effective multi-robot task plans.