Abstract:Driven by the trend away from mass production towards more customization and individualism, manufacturing is under massive price pressure. Therefore, continuously improving production efficiency and reducing costs have always been the focus of manufacturing companies. With recent advances in Industry 4.0 and industrial Artificial Intelligence (AI), Automated Guided Vehicles (AGVs) have become a very promising technology to support this trend. Nowadays, they are widely used in job shop environments for material handling. However, this promising technology goes along with various new challenges, such as the high dynamics, complexity, and uncertainty of the job shop environment for AGV scheduling. To address these challenges, an adaptive Deep Reinforcement Learning (DRL) based AGV real-time scheduling approach is approached to optimize several efficiency parameters of the overall job shop system. Firstly, the DRL optimization problem is formulated as Markov Decision Process (MDP). The state and action representation, reward, and optimal policy function are described in detail. Then a novel DRL method is further developed to achieve the optimal mixed rule policy. For that, a novel RL algorithm, Proximal Policy Optimization (PPO), is applied to the Deep Neural Network (DNN) and implemented in TensorForce, a reinforcement learning package in Python based on TensorFlow. This algorithm is compared to conventional heuristic rules. Furthermore, SimPy, a relatively new discrete-event simulation package in Python, is used to implement the job shop environment. The job shop environment is based on a real-world scenario of a semiconductor factory, which is implemented in a simplified manner and applied to the DRL agent. The results are presented afterward, followed by a feasibility and effectiveness analysis of this approach.

Airport gate assignment problem with deep reinforcement learning

Deep Reinforcement Learning for Real-Time Ground Delay Program Revision and Corresponding Flight Delay Assignments

Neural Airport Ground Handling

Airport Gate Assignment A Hybrid Model and Implementation

A Hybrid Genetic Algorithm Based on Imitation Learning for the Airport Gate Assignment Problem

An Efficient GEP-based Hyper-heuristic Approach for Automatic Airport Gate Assignment Problem

Airport Gate Assignment: New Model and Implementation

Optimization of multi-objective airport gate assignment problem: considering fairness between airlines

Freeway network traffic management based on distributed reinforcement learning

Multi-AGV Dynamic Scheduling in an Automated Container Terminal: A Deep Reinforcement Learning Approach

Learning-driven Feasible and Infeasible Tabu Search for Airport Gate Assignment

Multi-Objective Optimization of AGV Real-Time Scheduling Based on Deep Reinforcement Learning

Airport gate assignment based on Greedy Tabu Search algorithm

Optimizing Airport Gate Assignment with Operational Safety Constraints

Multiairport Departure Scheduling Via Multiagent Reinforcement Learning

Solving Airport Gate Assignment Problem Using an Improved Genetic Algorithm with Dynamic Topology

Research on Intelligent Dynamic Scheduling Algorithm for Automated Guided Vehicles in Container Terminal Based on Deep Reinforcement Learning

An Improved Adaptive Parallel Genetic Algorithm for the Airport Gate Assignment Problem

Demand-Driven Task Scheduling and Resource Allocation in Space-Air-Ground Integrated Network: A Deep Reinforcement Learning Approach

A robust strategy to address the airport gate assignment problem considering operators' preferences

Research on Multi-AGVs dynamic scheduling based on deep reinforcement learning