Abstract:This paper presents an innovative exploration of the application potential of large language models (LLM) in addressing the challenging task of automatically generating behavior trees (BTs) for complex tasks. The conventional manual BT generation method is inefficient and heavily reliant on domain expertise. On the other hand, existing automatic BT generation technologies encounter bottlenecks related to task complexity, model adaptability, and reliability. In order to overcome these challenges, we propose a novel methodology that leverages the robust representation and reasoning abilities of LLMs. The core contribution of this paper lies in the design of a BT generation framework based on LLM, which encompasses the entire process, from data synthesis and model training to application developing and data verification. Synthetic data is introduced to train the BT generation model (BTGen model), enhancing its understanding and adaptability to various complex tasks, thereby significantly improving its overall performance. In order to ensure the effectiveness and executability of the generated BTs, we emphasize the importance of data verification and introduce a multilevel verification strategy. Additionally, we explore a range of agent design and development schemes with LLM as the central element. We hope that the work in this paper may provide a reference for the researchers who are interested in BT generation based on LLMs.

Automatic Behavior Tree Expansion with LLMs for Robotic Manipulation

LLM as BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planning

LLM-BT: Performing Robotic Adaptive Tasks based on Large Language Models and Behavior Trees

Behavior Tree Generation using Large Language Models for Sequential Manipulation Planning with Human Instructions and Feedback

BTGenBot: Behavior Tree Generation for Robotic Tasks with Lightweight LLMs

Integrating Intent Understanding and Optimal Behavior Planning for Behavior Tree Generation from Human Instructions

LLM-BRAIn: AI-driven Fast Generation of Robot Behaviour Tree based on Large Language Model

A Study on Training and Developing Large Language Models for Behavior Tree Generation

HBTP: Heuristic Behavior Tree Planning with Large Language Model Reasoning

Large Language Models as Commonsense Knowledge for Large-Scale Task Planning

BT Expansion: a Sound and Complete Algorithm for Behavior Planning of Intelligent Robots with Behavior Trees

Adaptive Manipulation using Behavior Trees

From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Control

Grounding Language Models in Autonomous Loco-manipulation Tasks

Natural Language as Policies: Reasoning for Coordinate-Level Embodied Control with LLMs

LLM-Based Human-Robot Collaboration Framework for Manipulation Tasks

Consolidating Trees of Robotic Plans Generated Using Large Language Models to Improve Reliability

Generalizable Long-Horizon Manipulations with Large Language Models

Large Language Models for Orchestrating Bimanual Robots

On the programming effort required to generate Behavior Trees and Finite State Machines for robotic applications