Abstract:This paper explores the potential application of Deep Reinforcement Learning in the furniture industry. To offer a broad product portfolio, most furniture manufacturers are organized as a job shop, which ultimately results in the Job Shop Scheduling Problem (JSSP). The JSSP is addressed with a focus on extending traditional models to better represent the complexities of real-world production environments. Existing approaches frequently fail to consider critical factors such as machine setup times or varying batch sizes. A concept for a model is proposed that provides a higher level of information detail to enhance scheduling accuracy and efficiency. The concept introduces the integration of DRL for production planning, particularly suited to batch production industries such as the furniture industry. The model extends traditional approaches to JSSPs by including job volumes, buffer management, transportation times, and machine setup times. This enables more precise forecasting and analysis of production flows and processes, accommodating the variability and complexity inherent in real-world manufacturing processes. The RL agent learns to optimize scheduling decisions. It operates within a discrete action space, making decisions based on detailed observations. A reward function guides the agent's decision-making process, thereby promoting efficient scheduling and meeting production deadlines. Two integration strategies for implementing the RL agent are discussed: episodic planning, which is suitable for low-automation environments, and continuous planning, which is ideal for highly automated plants. While episodic planning can be employed as a standalone solution, the continuous planning approach necessitates the integration of the agent with ERP and Manufacturing Execution Systems. This integration enables real-time adjustments to production schedules based on dynamic changes.

Towards Standardising Reinforcement Learning Approaches for Production Scheduling Problems

Smaller Batches, Bigger Gains? Investigating the Impact of Batch Sizes on Reinforcement Learning Based Real-World Production Scheduling

Scalable Multi-agent Reinforcement Learning for Factory-wide Dynamic Scheduling

A Review on Reinforcement Learning in Production Scheduling: An Inferential Perspective

Optimizing Job Shop Scheduling in the Furniture Industry: A Reinforcement Learning Approach Considering Machine Setup, Batch Variability, and Intralogistics

Reinforcement Learning as an Improvement Heuristic for Real-World Production Scheduling

Distributional Reinforcement Learning for Scheduling of Chemical Production Processes

Reinforcement learning applied to production planning and control

Intelligent Scheduling of Discrete Automated Production Line Via Deep Reinforcement Learning

A Review of Reinforcement Learning Based Intelligent Optimization for Manufacturing Scheduling

Deep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions

A Reinforcement Learning Based Approach For Multi-Projects Scheduling In Cloud Manufacturing

Robust-stable scheduling in dynamic flow shops based on deep reinforcement learning

Real-time production scheduling using a deep reinforcement learning-based multi-agent approach

Demystifying Reinforcement Learning in Production Scheduling via Explainable AI

Reinforcement Learning and Mixed-Integer Programming for Power Plant Scheduling in Low Carbon Systems: Comparison and Hybridisation

A Memetic Algorithm with Reinforcement Learning for Sociotechnical Production Scheduling

Reinforcement Learning with Composite Rewards for Production Scheduling in a Smart Factory.

A Reinforcement Learning Environment For Job-Shop Scheduling

Hierarchical Reinforcement Learning for Multi-Objective Real-Time Flexible Scheduling in a Smart Shop Floor

Towards Solving Industrial Sequential Decision-making Tasks under Near-predictable Dynamics via Reinforcement Learning: an Implicit Corrective Value Estimation Approach