Abstract:Driven by the trend away from mass production towards more customization and individualism, manufacturing is under massive price pressure. Therefore, continuously improving production efficiency and reducing costs have always been the focus of manufacturing companies. With recent advances in Industry 4.0 and industrial Artificial Intelligence (AI), Automated Guided Vehicles (AGVs) have become a very promising technology to support this trend. Nowadays, they are widely used in job shop environments for material handling. However, this promising technology goes along with various new challenges, such as the high dynamics, complexity, and uncertainty of the job shop environment for AGV scheduling. To address these challenges, an adaptive Deep Reinforcement Learning (DRL) based AGV real-time scheduling approach is approached to optimize several efficiency parameters of the overall job shop system. Firstly, the DRL optimization problem is formulated as Markov Decision Process (MDP). The state and action representation, reward, and optimal policy function are described in detail. Then a novel DRL method is further developed to achieve the optimal mixed rule policy. For that, a novel RL algorithm, Proximal Policy Optimization (PPO), is applied to the Deep Neural Network (DNN) and implemented in TensorForce, a reinforcement learning package in Python based on TensorFlow. This algorithm is compared to conventional heuristic rules. Furthermore, SimPy, a relatively new discrete-event simulation package in Python, is used to implement the job shop environment. The job shop environment is based on a real-world scenario of a semiconductor factory, which is implemented in a simplified manner and applied to the DRL agent. The results are presented afterward, followed by a feasibility and effectiveness analysis of this approach.

A Multiobjective Reinforcement Learning Approach for AGV Task Clustering

Research on Cooperative Scheduling of AGV Transportation and Charging in Intelligent Warehouse System Based on Dynamic Task Chain

Research on Tasks Allocation of Multi-Agvs System Based on a Hybrid Genetic Algorithm

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

A Novel Hierarchical Charging Algorithm for the AGV Dispatching Problem in a Multi-Robot System

A Novel Multi-AGV Coordination Strategy Based on the Combination of Nodes and Grids

Research on Multi-AGVs dynamic scheduling based on deep reinforcement learning

Multi-AGV Scheduling Based on Hierarchical Intrinsically Rewarded Multi-Agent Reinforcement Learning

Decentralized Multi-AGV Task Allocation based on Multi-Agent Reinforcement Learning with Information Potential Field Rewards

Research on Intelligent Warehouse Path Planning Based on Multi-Objective Reinforcement Learning

Multi-objective AGV scheduling in an automatic sorting system of an unmanned (intelligent) warehouse by using two adaptive genetic algorithms and a multi-adaptive genetic algorithm

A Self-Attention-Based Deep Reinforcement Learning Approach for AGV Dispatching Systems

Multi-objective Dynamic AGV Scheduling Method Based on Deep Reinforcement Learning

Multi-AGVs Dispatching Strategy in Automobile Assembly Line Based on Deep Reinforcement Learning

Multi-Objective Optimization of AGV Real-Time Scheduling Based on Deep Reinforcement Learning

Multi-AGVs Scheduling with Vehicle Conflict Consideration in Ship Outfitting Items Warehouse

An Efficient Genetic Algorithm for Multi Agv Scheduling Problem About Intelligent Warehouse

Multi-AGV Dynamic Scheduling in an Automated Container Terminal: A Deep Reinforcement Learning Approach

Genetic Scheduling and Reinforcement Learning in Multirobot Systems for Intelligent Warehouses

Task and intelligent path planning algorithm for teams of AGVs based on multi-stage method

Real-Time Conflict-Free Task Assignment and Path Planning of Multi-AGV System in Intelligent Warehousing