Abstract:Dynamic production and service scheduling are critical in manufacturing servitization. Unlike previous research assuming unrealistic specific mappings between products and services, this paper studies a more general and complex setting with a two-product-two-service mapping in a product service system, formulating it as a Markov Decision Process model. To solve this model with large-scale cases, designing a data-driven prediction algorithm is a common approach to overcome the curse of dimensionality. However, there might exist inconsistencies in the statistical distribution between the training and testing sets, as the training samples generated by the exact algorithm may not cover the entire state space. To tackle this problem, we propose a novel model-and-data-driven framework. We extract a service priority rule from the model as prior knowledge and embed it into the machine learning algorithm through tailored feature engineering. This strengthens prediction capabilities in unexplored state space regions compared to a purely data-driven approach. Numerical experiments validate our contributions, displaying the potential for embracing industrial automation and exploring the synergy effects for further exploration of the optimal structure as more effective prior knowledge. Note to Practitioners —Dynamic joint scheduling of production and service plays an important role in industrial automation. In this context, a wide range of studies are dedicated to developing efficient algorithms to meet the quick response requirement to tackle large-scale cases beyond the capability of exact algorithms. However, these studies often rely on unrealistic assumptions or have unsatisfactory computational performance, limiting potential cost reduction. To overcome this challenge, we relax unnecessary hypotheses and generalize the problem by allowing for a more generalized production-service mapping, which better reflects the reality. Apart from that, we integrate the prior knowledge into existing data to construct a more powerful approximation algorithm and enrich the prediction capability to accommodate the dynamic environment. With greater computation resources and data samples, the proposed algorithm achieves superior solutions. Furthermore, our research uncovers some key properties of the product service system, which could be leveraged to customize more effective automated scheduling rules.

Agent-based dynamic scheduling model for product-driven production

A Dynamic Joint Production-Service Scheduling Approach by a Model-and-Data Driven Algorithm

Concepts and Algorithms for Agent-based Decentralized and Integrated Scheduling of Production and Auxiliary Processes

A product-driven system with an evolutionary algorithm to increase flexibility in planning a job shop

SMART AGENT-BASED PRIORITY DISPATCHING RULES FOR JOB SHOP SCHEDULING IN A FURNITURE MANUFACTURING WORKSHOP

A Multi-Agent Reinforcement Learning Approach to the Dynamic Job Shop Scheduling Problem

A Deep Multi-Agent Reinforcement Learning Approach to Solve Dynamic Job Shop Scheduling Problem

Dynamic Job Shop Scheduling Based on Order Remaining Completion Time Prediction

Real time distributed shop floor scheduling using an agent-based service-oriented architecture

Dynamic scheduling of manufacturing systems: a product-driven approach using hyper-heuristics

Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems

Multiagent-based scheduling optimization for Intelligent Manufacturing System

An agent-oriented approach to resolve scheduling optimization in intelligent manufacturing

Deep reinforcement learning for dynamic scheduling of a flexible job shop

Dynamic production scheduling towards self-organizing mass personalization: A multi-agent dueling deep reinforcement learning approach

Real-Time Decision-Support System for High-Mix Low-Volume Production Scheduling in Industry 4.0

Scheduling in Industrial environment toward future: insights from Jean-Marie Proth

Digital twin and deep reinforcement learning enabled real-time scheduling for complex product flexible shop-floor

Multi-agent Based Dynamic Job Shop Scheduling Method

Multi-agent-based deep reinforcement learning for dynamic flexible job shop scheduling

Solving comprehensive dynamic job shop scheduling problem by using a GRASP-based approach