Abstract:Generative design can be an effective approach to generate optimized factory layouts. One evolving topic in this field is the use of reinforcement learning (RL)-based approaches. Existing research has focused on the utilization of the approach without providing additional insights into the learned metrics and the derived policy. This information, however, is valuable from a layout planning perspective since the planner needs to ensure the trustworthiness and comprehensibility of the results. Furthermore, a deeper understanding of the learned policy and its influencing factors can help improve the manual planning process that follows as well as the acceptance of the results. These gaps in the existing approaches can be addressed by methods categorized as explainable artificial intelligence methods which have to be aligned with the properties of the problem and its audience. Consequently, this paper presents a method that will increase the trust in layouts generated by the RL approach. The method uses policy summarization and perturbation together with the state value evaluation. The method also uses explainable generative design for analyzing interrelationships between state values and actions at a feature level. The result is that the method identifies whether the RL approach learns the problem characteristics or if the solution is a result of random behavior. Furthermore, the method can be used to ensure that the reward function is aligned with the overall optimization goal and supports the planner in further detailed planning tasks by providing insights about the problem-defining interdependencies. The applicability of the proposed method is validated based on an industrial application scenario considering a layout planning case of 43 functional units. The results show that the method allows evaluation of the trustworthiness of the generated results by preventing randomly generated solutions from being considered in a detailed manual planning step. The paper concludes with a discussion of the results and a presentation of future research directions which also includes the transfer potentials of the proposed method to other application fields in RL-based generative design.

Performance comparison of reinforcement learning and metaheuristics for factory layout planning

A simulation-based factory layout planning approach using reinforcement learning

A Framework for Automated Multiobjective Factory Layout Planning using Reinforcement Learning

GoodFloorplan: Graph Convolutional Network and Reinforcement Learning-Based Floorplanning

Explainable generative design in manufacturing for reinforcement learning based factory layout planning

Comparing Heuristics, Constraint Optimization, and Reinforcement Learning for an Industrial 2D Packing Problem

Deep reinforcement learning for layout planning - An MDP-based approach for the facility layout problem

Optimization of the Factory Layout and Production Flow Using Production-Simulation-Based Reinforcement Learning

Multi agent reinforcement learning for online layout planning and scheduling in flexible assembly systems

Reimagining space layout design through deep reinforcement learning

Reinforcement Learning as an Improvement Heuristic for Real-World Production Scheduling

Genetic Programming and Reinforcement Learning on Learning Heuristics for Dynamic Scheduling: A Preliminary Comparison

Deep reinforcement learning for community architectural layout generation

Optimizing Job Shop Scheduling in the Furniture Industry: A Reinforcement Learning Approach Considering Machine Setup, Batch Variability, and Intralogistics

Deep Reinforcement Learning for Producing Furniture Layout in Indoor Scenes

Reinforcement Learning Approach for Multi-Agent Flexible Scheduling Problems

Enhancing architectural space layout design by pretraining deep reinforcement learning agents

Scalable Multi-agent Reinforcement Learning for Factory-wide Dynamic Scheduling

A multi-objective reinforcement learning approach for resequencing scheduling problems in automotive manufacturing systems

Integrating multi-agent reinforcement learning and 3D A* search for facility layout problem considering connector-assembly

Multi-Agent Reinforcement Learning of 3D Furniture Layout Simulation in Indoor Graphics Scenes