Abstract:Purpose This paper aim to solve the problem of low assembly success rate for 3c assembly lines designed based on classical control algorithms due to inevitable random disturbances and other factors,by incorporating intelligent algorithms into the assembly line, the assembly process can be extended to uncertain assembly scenarios. Design/methodology/approach This work proposes a reinforcement learning framework based on digital twins. First, the authors used Unity3D to build a simulation environment that matches the real scene and achieved data synchronization between the real environment and the simulation environment through the robot operating system. Then, the authors trained the reinforcement learning model in the simulation environment. Finally, by creating a digital twin environment, the authors transferred the skill learned from the simulation to the real environment and achieved stable algorithm deployment in real-world scenarios. Findings In this work, the authors have completed the transfer of skill-learning algorithms from virtual to real environments by establishing a digital twin environment. On the one hand, the experiment proves the progressiveness of the algorithm and the feasibility of the application of digital twins in reinforcement learning transfer. On the other hand, the experimental results also provide reference for the application of digital twins in 3C assembly scenarios. Originality/value In this work, the authors designed a new encoder structure in the simulation environment to encode image information, which improved the model’s perception of the environment. At the same time, the authors used the fixed strategy combined with the reinforcement learning strategy to learn skills, which improved the rate of convergence and stability of skills learning. Finally, the authors transferred the learned skills to the physical platform through digital twin technology and realized the safe operation of the flexible printed circuit assembly task.

Evolutionary digital twin model with an agent-based discrete-event simulation method

An Adaptive Evolutionary Framework for the Decision-Making Models of Digital Twin Machining System

Digital Twins in Engineering Dynamics: Variational Equation Identification, Feedback Control Design and Their Rapid Update

Digital Twin System Design for Dual-Manipulator Cooperation Unit

Evolutionary digital twin: A new approach for intelligent industrial product development

Discrete event-driven twin workshop modeling and simulation technology

Constructing and Evaluating Digital Twins: An Intelligent Framework for DT Development

Evolutionary method of digital twin model for building physics mechanism

Modeling of Digital Twin Workshop Based on Perception Data.

Research on Construction Method of Digital Twin Workshop Based on Digital Twin Engine

An Agent-based Realisation for a continuous Model Adaption Approach in intelligent Digital Twins

Design and Implementation of Workshop Virtual Simulation Experiment Platform Based on Digital Twin

Multisource Model-Driven Digital Twin System of Robotic Assembly

Digital Twin Enhanced Assembly Based on Deep Reinforcement Learning

From Simple Digital Twin to Complex Digital Twin Part I: A Novel Modeling Method for Multi-Scale and Multi-Scenario Digital Twin

Adaptive hybrid reasoning for agent-based digital twins of distributed multi-robot systems

Using Digital Twin to Enhance Sim2real Transfer for Reinforcement Learning in 3C Assembly.

Reinforcement Twinning: from digital twins to model-based reinforcement learning

Behavior-Centered Digital-Twin Design for Dynamic Cyber-Physical System Development

A Scalable Digital Twin Framework Based on a Novel Adaptive Ensemble Surrogate Model

From Virtual Simulation to Digital Twins in Online Laboratories