Abstract:<p>Filling the gaps between virtual and physical systems will open new doors in Smart Manufacturing. This work proposes a data-driven approach to utilize digital transformation methods to automate smart manufacturing systems. This is fundamentally enabled by using a digital twin to represent manufacturing cells, simulate system behaviors, predict process faults, and adaptively control manipulated variables. First, the manufacturing cell is accommodated to environments such as computer-aided applications, industrial Product Lifecycle Management solutions, and control platforms for automation systems. Second, a network of interfaces between the environments is designed and implemented to enable communication between the digital world and physical manufacturing plant, so that near-synchronous controls can be achieved. Third, capabilities of some members in the family of Deep Reinforcement Learning (DRL) are discussed with manufacturing features within the context of Smart Manufacturing. Trained results for Deep Q Learning algorithms are finally presented in this work as a case study to incorporate DRL-based artificial intelligence to the industrial control process. As a result, developed control methodology, named <em>Digital Engine</em>, is expected to acquire process knowledges, schedule manufacturing tasks, identify optimal actions, and demonstrate control robustness. The authors show that integrating a smart agent into the industrial platforms further expands the usage of the system-level digital twin, where intelligent control algorithms are trained and verified upfront before deployed to the physical world for implementation. Moreover, DRL approach to automated manufacturing control problems under facile optimization environments will be a novel combination between data science and manufacturing industries.</p>

Automated Guided Vehicle Dispatching and Routing Integration Via Digital Twin with Deep Reinforcement Learning

A digital twin-driven dynamic path planning approach for multiple automatic guided vehicles based on deep reinforcement learning

A digital twin-based decision support approach for AGV scheduling

Deep Reinforcement Learning for Dynamic Scheduling of Energy-Efficient Automated Guided Vehicles

Dynamic Scheduling and Optimization of AGV in Factory Logistics Systems Based on Digital Twin

Digital-Twin-Driven AGV Scheduling and Routing in Automated Container Terminals

Digital Twin-Based Automated Guided Vehicle Scheduling: A Solution for Its Charging Problems

Multi-AGVs Dispatching Strategy in Automobile Assembly Line Based on Deep Reinforcement Learning

Digital twin-based reinforcement learning framework: application to autonomous mobile robot dispatching

A Self-Attention-Based Deep Reinforcement Learning Approach for AGV Dispatching Systems

Multi-Objective Optimization of AGV Real-Time Scheduling Based on Deep Reinforcement Learning

Research on Multi-AGVs dynamic scheduling based on deep reinforcement learning

An Improved DQN Algorithm for Automated Guided Vehicle Pathfinding Problem in Port Environment

A digital twin to train deep reinforcement learning agent for smart manufacturing plants: Environment, interfaces and intelligence

Real-Time Charging Scheduling of Automated Guided Vehicles in Cyber-Physical Smart Factories Using Feature-Based Reinforcement Learning

A Deep Reinforcement Learning Based Approach for AGVs Path Planning

Digital Twin-Assisted Controlling of AGVs in Flexible Manufacturing Environments

A new knowledge-guided multi-objective optimisation for the multi-AGV dispatching problem in dynamic production environments

Adaptive Digital Twin and Multiagent Deep Reinforcement Learning for Vehicular Edge Computing and Networks

Learning to Optimize Industry-Scale Dynamic Pickup and Delivery Problems

Communication-Efficient Decision-Making of Digital Twin Assisted Internet of Vehicles:A Hierarchical Multi-Agent Reinforcement Learning Approach