Toward Automated Programming for Robotic Assembly Using ChatGPT

Annabella Macaluso,Nicholas Cote,Sachin Chitta

2024-05-14

Abstract:Despite significant technological advancements, the process of programming robots for adaptive assembly remains labor-intensive, demanding expertise in multiple domains and often resulting in task-specific, inflexible code. This work explores the potential of Large Language Models (LLMs), like ChatGPT, to automate this process, leveraging their ability to understand natural language instructions, generalize examples to new tasks, and write code. In this paper, we suggest how these abilities can be harnessed and applied to real-world challenges in the manufacturing industry. We present a novel system that uses ChatGPT to automate the process of programming robots for adaptive assembly by decomposing complex tasks into simpler subtasks, generating robot control code, executing the code in a simulated workcell, and debugging syntax and control errors, such as collisions. We outline the architecture of this system and strategies for task decomposition and code generation. Finally, we demonstrate how our system can autonomously program robots for various assembly tasks in a real-world project.

Robotics

What problem does this paper attempt to address?

The problem this paper attempts to address is: **How to automate the robot assembly programming process using large language models (such as ChatGPT)**.

Specifically, the current robot assembly programming faces the following issues:
1. **Labor-intensive**: The process of programming, testing, and debugging robot systems is very time-consuming and requires a lot of manual intervention.
2. **Highly specialized**: Writing code suitable for specific products requires deep expertise, including knowledge in robotics, perception, manufacturing, and software engineering.
3. **Lack of flexibility**: Existing programming methods are usually tailored to specific tasks and are difficult to adapt to diverse assembly tasks.

To solve these problems, the paper proposes a new method based on large language models (LLM) to achieve automated programming through the following steps:
1. **Task decomposition**: Decompose complex assembly tasks into simple subtasks.
2. **Code generation**: Use LLM to generate robot control code.
3. **Simulated execution**: Execute the generated code in a simulated environment and debug it.
4. **Error handling**: Detect and fix syntax and control errors, such as collisions.

The paper demonstrates the application of this new method in real projects, proving its potential in automating robot assembly programming.