Abstract:<p>Filling the gaps between virtual and physical systems will open new doors in Smart Manufacturing. This work proposes a data-driven approach to utilize digital transformation methods to automate smart manufacturing systems. This is fundamentally enabled by using a digital twin to represent manufacturing cells, simulate system behaviors, predict process faults, and adaptively control manipulated variables. First, the manufacturing cell is accommodated to environments such as computer-aided applications, industrial Product Lifecycle Management solutions, and control platforms for automation systems. Second, a network of interfaces between the environments is designed and implemented to enable communication between the digital world and physical manufacturing plant, so that near-synchronous controls can be achieved. Third, capabilities of some members in the family of Deep Reinforcement Learning (DRL) are discussed with manufacturing features within the context of Smart Manufacturing. Trained results for Deep Q Learning algorithms are finally presented in this work as a case study to incorporate DRL-based artificial intelligence to the industrial control process. As a result, developed control methodology, named <em>Digital Engine</em>, is expected to acquire process knowledges, schedule manufacturing tasks, identify optimal actions, and demonstrate control robustness. The authors show that integrating a smart agent into the industrial platforms further expands the usage of the system-level digital twin, where intelligent control algorithms are trained and verified upfront before deployed to the physical world for implementation. Moreover, DRL approach to automated manufacturing control problems under facile optimization environments will be a novel combination between data science and manufacturing industries.</p>

Digital Twin Enhanced Assembly Based on Deep Reinforcement Learning

A flexible manufacturing assembly system with deep reinforcement learning

Digital twin model-based smart assembly strategy design and precision evaluation for PCB kit-box build

An Adaptive Evolutionary Framework for the Decision-Making Models of Digital Twin Machining System

A Digital Twin-Driven Guidance Method for Human-Machine Collaborative Assembly Operations Based on Machine Learning and Computer Vision

A Modeling Method of Complex Assembly Based on Digital Twin

Digital-Twin-Assisted Skill Learning for 3C Assembly Tasks

A Digital Twin-Based Method for Assembly Deviations Analysis

A digital twin to train deep reinforcement learning agent for smart manufacturing plants: Environment, interfaces and intelligence

Hand-in-Hand Guidance: an Explore-Exploit Based Reinforcement Learning Method for Performance Driven Assembly-Adjustment

A digital twin-based sim-to-real transfer for deep reinforcement learning-enabled industrial robot grasping

Deep Reinforcement Learning for High Precision Assembly Tasks

Digital twin-enabled advance execution for human-robot collaborative assembly

Implementation of Digital Twin in Actual Production: Intelligent Assembly Paradigm for Large-Scale Industrial Equipment

A digital twin-driven human–robot collaborative assembly-commissioning method for complex products

A digital twin-driven human-machine interactive assembly method based on lightweight multi-target detection and assembly feature generation

Autonomous Human-Robot Collaborative Assembly Method Driven by the Fusion of Large Language Model and Digital Twin

Digital twin-driven multi-dimensional assembly error modeling and control for complex assembly process in Industry 4.0

Evolutionary digital twin model with an agent-based discrete-event simulation method

Deep learning-enabled intelligent process planning for digital twin manufacturing cell

Reinforcement Twinning: from digital twins to model-based reinforcement learning