Abstract:Generative design can be an effective approach to generate optimized factory layouts. One evolving topic in this field is the use of reinforcement learning (RL)-based approaches. Existing research has focused on the utilization of the approach without providing additional insights into the learned metrics and the derived policy. This information, however, is valuable from a layout planning perspective since the planner needs to ensure the trustworthiness and comprehensibility of the results. Furthermore, a deeper understanding of the learned policy and its influencing factors can help improve the manual planning process that follows as well as the acceptance of the results. These gaps in the existing approaches can be addressed by methods categorized as explainable artificial intelligence methods which have to be aligned with the properties of the problem and its audience. Consequently, this paper presents a method that will increase the trust in layouts generated by the RL approach. The method uses policy summarization and perturbation together with the state value evaluation. The method also uses explainable generative design for analyzing interrelationships between state values and actions at a feature level. The result is that the method identifies whether the RL approach learns the problem characteristics or if the solution is a result of random behavior. Furthermore, the method can be used to ensure that the reward function is aligned with the overall optimization goal and supports the planner in further detailed planning tasks by providing insights about the problem-defining interdependencies. The applicability of the proposed method is validated based on an industrial application scenario considering a layout planning case of 43 functional units. The results show that the method allows evaluation of the trustworthiness of the generated results by preventing randomly generated solutions from being considered in a detailed manual planning step. The paper concludes with a discussion of the results and a presentation of future research directions which also includes the transfer potentials of the proposed method to other application fields in RL-based generative design.

Deep reinforcement learning for layout planning - An MDP-based approach for the facility layout problem

GoodFloorplan: Graph Convolutional Network and Reinforcement Learning-Based Floorplanning

Reimagining space layout design through deep reinforcement learning

Deep Reinforcement Learning for Producing Furniture Layout in Indoor Scenes

Workshop Facility Layout Optimization Based on Deep Reinforcement Learning

A simulation-based factory layout planning approach using reinforcement learning

A Framework for Automated Multiobjective Factory Layout Planning using Reinforcement Learning

Explainable generative design in manufacturing for reinforcement learning based factory layout planning

Deep reinforcement learning applied to an assembly sequence planning problem with user preferences

Automatic Design Method of Building Pipeline Layout Based on Deep Reinforcement Learning

Optimizing Job Shop Scheduling in the Furniture Industry: A Reinforcement Learning Approach Considering Machine Setup, Batch Variability, and Intralogistics

Adaptive Disassembly Sequence Planning for VR Maintenance Training Via Deep Reinforcement Learning

A Deep Reinforcement Learning Approach to the Flexible Flowshop Scheduling Problem with Makespan Minimization

Hierarchical Reinforcement Learning for Furniture Layout in Virtual Indoor Scenes

Performance comparison of reinforcement learning and metaheuristics for factory layout planning

Spatial Geometric Reasoning for Room Layout Estimation via Deep Reinforcement Learning

Multi agent reinforcement learning for online layout planning and scheduling in flexible assembly systems

Deep Reinforcement Learning-based Task Assignment and Path Planning for Multi-agent Construction Robots

Design Process is a Reinforcement Learning Problem

Solving flexible job shop scheduling problems via deep reinforcement learning

Integrating multi-agent reinforcement learning and 3D A* search for facility layout problem considering connector-assembly