Abstract:Reinforcement learning-based methods have addressed production scheduling problems with flexible processing constraints. However, delayed rewards arise due to the dynamic arrival of jobs and transportation constraints between two successive operations. The flow time of operations can only be determined after processing due to the possibility that the solution for job sequencing may change if new operations are inserted in dynamic environments. Job sequencing is often overlooked in single-agent-based scheduling methods. The lack of information sharing between multiple agents necessitates that researchers manually design reward functions to fit the relationship between optimization objectives and rewards, thereby reducing the accuracy of the learned policies. Thus, this paper proposes a multi-agent-based scheduling optimization framework that facilitates collaboration between the agents of both machines and jobs to address dynamic flexible job-shop scheduling problems (DFJSP) with transportation time constraints. Then, this paper formulates the Partial Observation Markov Decision Process and constructs a reward-sharing mechanism to tackle the delayed reward issue and facilitate policy learning. Finally, we develop an improved multi-agent dueling double deep Q network algorithm to optimize scheduling policy during long-term training. The results show that, compared with the state-of-the-art methods, the proposed method efficiently shortens the weighted flow time under the trained and unseen scenarios. Additionally, the case study results demonstrate its efficiency and responsiveness. It indicates that the proposed method efficiently addresses production scheduling problems with complex constraints, including the insertion of jobs, transportation time constraints, and flexible processing routes.

Research on Agent-Based Approaches to Freight Transport Scheduling

Research on Grid-Service Scheduling Based on Intelligent Agent

Agent-Based Modeling and Simulation for Systematic Operations of Shared Automated Electric Vehicles

Agent-Based Microsimulation Approach for Design and Evaluation of Flexible Work Schedules

Research on networked control system based on Agent technology

Dynamic Transportation Planning and Operations: Concept, Framework and Applications in China

Towards the applications of multi-agent techniques in intelligent transportation systems

Experimental Macroscopic Phenomena in Urban Transportation System

Hybrid modeling of collaborative freight transportation planning using agent-based simulation, auction-based mechanisms, and optimization

Multi-Agent Simulation for Multi-Mode Travel Policy to Improve Park and Ride Efficiency

A Framework of Urban Mixed-Traffic Simulation System Based on Multi-Agent Systems

Research on Emergency Logistics Vehicle Route Scheduling and Optimization Method Based on Multi-Intelligent Decision System

A decentralised multi-agent system for rail freight traffic management

Real-Time Multi-Vehicle Scheduling in Tasks With Dependency Relationships Using Multi-Agent Reinforcement Learning

A capacity matching model in a collaborative urban public transport system: integrating passenger and freight transportation

Agent-Based Modeling And Dynamic Optimization Of Shop Logistics System In Discrete Manufacturing Enterprises

Vehicle Dispatching and Routing of On-Demand Intercity Ride-Pooling Services: A Multi-Agent Hierarchical Reinforcement Learning Approach

Dynamic flexible scheduling with transportation constraints by multi-agent reinforcement learning

Managing Autonomous Mobility on Demand Systems for Better Passenger Experience

Research On Urban Mass Transit Network Passenger Flow Simulation On The Basis Of Multi-Agent

A Collaborative Optimization Method for Train Scheduling and Passenger Flow Assignment Based on Multi-Agent Reinforcement Learning