Optimization of the Factory Layout and Production Flow Using Production-Simulation-Based Reinforcement Learning

Hyekyung Choi,Seokhwan Yu,DongHyun Lee,Sang Do Noh,Sanghoon Ji,Horim Kim,Hyunsik Yoon,Minsu Kwon,Jagyu Han
DOI: https://doi.org/10.3390/machines12060390
IF: 2.899
2024-06-06
Machines
Abstract:Poor layout designs in manufacturing facilities severely reduce production efficiency and increase short- and long-term costs. Analyzing and deriving efficient layouts for novel line designs or improvements to existing lines considering both the layout design and logistics flow is crucial. In this study, we performed production simulation in the design phase for factory layout optimization and used reinforcement learning to derive the optimal factory layout. To facilitate factory-wide layout design, we considered the facility layout, logistics movement paths, and the use of automated guided vehicles (AGVs). The reinforcement-learning process for optimizing each component of the layout was implemented in a multilayer manner, and the optimization results were applied to the design production simulation for verification. Moreover, a flexible simulation system was developed. Users can efficiently review and execute alternative scenarios by considering both facility and logistics layouts in the workspace. By emphasizing the redesign and reuse of the simulation model, we achieved layout optimization through an automated process and propose a flexible simulation system that can adapt to various environments through a multilayered modular approach. By adjusting weights and considering various conditions, throughput increased by 0.3%, logistics movement distance was reduced by 3.8%, and the number of AGVs required was reduced by 11%.
engineering, mechanical, electrical & electronic
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to address the issues of factory layout design and logistics process optimization in manufacturing facilities to improve production efficiency and reduce both short-term and long-term costs. Specifically, the paper tackles the problem through the following points: 1. **Factory Layout Optimization**: - Utilizing production simulation technology to optimize factory layout during the design phase. - Employing reinforcement learning algorithms to derive the optimal factory layout scheme. 2. **Multi-layer Optimization Framework**: - Implementing the reinforcement learning process for layout components within a multi-layer framework and applying the optimization results to design production simulations for validation. 3. **Flexible Simulation System**: - Developing a flexible simulation system that allows users to efficiently review and execute alternative scenarios in the workspace considering facility and logistics layout. - Achieving optimization of production efficiency, logistics distance, and the required number of AGVs by adjusting weights and considering various conditions. Through these methods, the paper proposes a layout optimization solution that can adapt to various environments and automate the process using a multi-layer modular approach. This method not only fills gaps in existing research but also provides a robust solution that ensures higher efficiency and productivity in different manufacturing environments.