Abstract:In this paper, we present a novel framework that combines large language models (LLMs), digital twins and industrial automation system to enable intelligent planning and control of production processes. We retrofit the automation system for a modular production facility and create executable control interfaces of fine-granular functionalities and coarse-granular skills. Low-level functionalities are executed by automation components, and high-level skills are performed by automation modules. Subsequently, a digital twin system is developed, registering these interfaces and containing additional descriptive information about the production system. Based on the retrofitted automation system and the created digital twins, LLM-agents are designed to interpret descriptive information in the digital twins and control the physical system through service interfaces. These LLM-agents serve as intelligent agents on different levels within an automation system, enabling autonomous planning and control of flexible production. Given a task instruction as input, the LLM-agents orchestrate a sequence of atomic functionalities and skills to accomplish the task. We demonstrate how our implemented prototype can handle un-predefined tasks, plan a production process, and execute the operations. This research highlights the potential of integrating LLMs into industrial automation systems in the context of smart factory for more agile, flexible, and adaptive production processes, while it also underscores the critical insights and limitations for future work. Demos at: <a class="link-external link-https" href="https://github.com/YuchenXia/GPT4IndustrialAutomation" rel="external noopener nofollow">this https URL</a>

Embodied intelligence in manufacturing: leveraging large language models for autonomous industrial robotics

Large Language Models for Robotics: Opportunities, Challenges, and Perspectives

Large Language Models for Manufacturing

Large Language Model-Enabled Multi-Agent Manufacturing Systems

Towards autonomous system: flexible modular production system enhanced with large language model agents

Applying Large Language Models for Intelligent Industrial Automation

Incorporating Large Language Models into Production Systems for Enhanced Task Automation and Flexibility

Large Language Models for Robotics: A Survey

An LLM-based vision and language cobot navigation approach for Human-centric Smart Manufacturing

Control Industrial Automation System with Large Language Models

Decision-Making in Robotic Grasping with Large Language Models.

Large Language Model Empowered by Domain-Specific Knowledge Base for Industrial Equipment Operation and Maintenance

How Can Large Language Models Help Humans in Design and Manufacturing?

Embodied AI in Mobile Robots: Coverage Path Planning with Large Language Models

Exploring Large Language Models to Facilitate Variable Autonomy for Human-Robot Teaming

TPTU: Large Language Model-based AI Agents for Task Planning and Tool Usage

Enhancing Human-Robot Collaborative Assembly in Manufacturing Systems Using Large Language Models

A Survey on Integration of Large Language Models with Intelligent Robots

WALL-E: Embodied Robotic WAiter Load Lifting with Large Language Model

Embodied Intelligence in Mining: Leveraging Multi-Modal Large Language Models for Autonomous Driving in Mines