Abstract:Driven by the trend away from mass production towards more customization and individualism, manufacturing is under massive price pressure. Therefore, continuously improving production efficiency and reducing costs have always been the focus of manufacturing companies. With recent advances in Industry 4.0 and industrial Artificial Intelligence (AI), Automated Guided Vehicles (AGVs) have become a very promising technology to support this trend. Nowadays, they are widely used in job shop environments for material handling. However, this promising technology goes along with various new challenges, such as the high dynamics, complexity, and uncertainty of the job shop environment for AGV scheduling. To address these challenges, an adaptive Deep Reinforcement Learning (DRL) based AGV real-time scheduling approach is approached to optimize several efficiency parameters of the overall job shop system. Firstly, the DRL optimization problem is formulated as Markov Decision Process (MDP). The state and action representation, reward, and optimal policy function are described in detail. Then a novel DRL method is further developed to achieve the optimal mixed rule policy. For that, a novel RL algorithm, Proximal Policy Optimization (PPO), is applied to the Deep Neural Network (DNN) and implemented in TensorForce, a reinforcement learning package in Python based on TensorFlow. This algorithm is compared to conventional heuristic rules. Furthermore, SimPy, a relatively new discrete-event simulation package in Python, is used to implement the job shop environment. The job shop environment is based on a real-world scenario of a semiconductor factory, which is implemented in a simplified manner and applied to the DRL agent. The results are presented afterward, followed by a feasibility and effectiveness analysis of this approach.

Multi-AGVs Dispatching Strategy in Automobile Assembly Line Based on Deep Reinforcement Learning

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Research on Cooperative Scheduling of AGV Transportation and Charging in Intelligent Warehouse System Based on Dynamic Task Chain

A Novel Multi-AGV Coordination Strategy Based on the Combination of Nodes and Grids

A Self-Attention-Based Deep Reinforcement Learning Approach for AGV Dispatching Systems

Optimization for AGV in Automated Warehouse System

Research on Multi-AGVs dynamic scheduling based on deep reinforcement learning

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Cooperative Control of Multiple AGVs Based on Multi-Agent Reinforcement Learning

Multi-Objective Optimization of AGV Real-Time Scheduling Based on Deep Reinforcement Learning

A Multiobjective Reinforcement Learning Approach for AGV Task Clustering

Decentralized Multi-AGV Task Allocation based on Multi-Agent Reinforcement Learning with Information Potential Field Rewards

Multi-objective Dynamic AGV Scheduling Method Based on Deep Reinforcement Learning

Multi-AGV Dynamic Scheduling in an Automated Container Terminal: A Deep Reinforcement Learning Approach

Research on Intelligent Dynamic Scheduling Algorithm for Automated Guided Vehicles in Container Terminal Based on Deep Reinforcement Learning

Multi-AGVs conflict-free routing and dynamic dispatching strategies for automated warehouses

Real-Time Charging Scheduling of Automated Guided Vehicles in Cyber-Physical Smart Factories Using Feature-Based Reinforcement Learning

A decentralized path planning model based on deep reinforcement learning

Random Network Distillation Based Deep Reinforcement Learning for AGV Path Planning

A new knowledge-guided multi-objective optimisation for the multi-AGV dispatching problem in dynamic production environments

Artificial intelligence empowered multi-AGVs in manufacturing systems