Deep reinforcement learning for solving car resequencing with selectivity banks in automotive assembly shops
Yuzhe Huang Gaocai Fu Buyun Sheng Yingkang Lu Junpeng Yu Xiyan Yin a Department of Mechanical and Electrical Engineering,Wuhan University of Technology,Wuhan,People's Republic of Chinab Department of Mechanical Engineering,Hubei University of Technology,Wuhan,People's Republic of ChinaYuzhe Huang was born in Wuhan,Hubei Province,China in 1998. He received his B.S. degree in mechanical and electrical engineering from Wuhan University of Science and Technology,China,in 2020. Currently,he is pursuing his Ph.D. in mechanical engineering at Wuhan University of Technology,China. His research interests include deep reinforcement learning,intelligent optimisation,production scheduling and evolutionary computation.Gaocai Fu was born in Guangshui,Hubei Province,China in 1989. He received the M.S. and Ph.D. degree in mechanical engineering from Wuhan University of Technology,Wuhan,China in 2016 and 2023. He is a lecturer at the Department of Mechanical and Electrical Engineering of Wuhan University of Technology. His research interests include CAD/CAPP/PDM,intelligent manufacturing,and digital manufacturing.Buyun Sheng is currently a Professor with the Department of Mechanical and Electronic Engineering,Wuhan University of Technology. He received the B.S.,M.S. and Ph.D. degree in mechanical engineering from Wuhan University of Technology,Wuhan,China,in 1985,1988 and 2001. He is the author of two books and more than 100 articles. His research interests include the digital and intelligent manufacturing,cloud manufacturing and service,computer graphics,and CAD/CAPP/PDM.Yingkang Lu was born in Liu'an,Anhui Province,China in 1995. He received his B.S. and M.S. degrees in mechanical engineering from Wuhan University of Technology,China,in 2013 and 2017. Currently,he is pursuing his Ph.D. in mechanical engineering at Wuhan University of Technology,China. His research interests include energy consumption prediction,digital twin,and intelligent operation and maintenance.Junpeng Yu was born in Hubei Province,China in 1998. He received his M.S. degrees in mechanical engineering from Wuhan Polytechnic University,China,in 2023. Currently,he is pursuing his Ph.D. in mechanical engineering at Wuhan University of Technology,China. His research interests include deep learning,digital twin,and intelligent operation and fault diagnosis.Xiyan Yin was born in Hubei Province,China in 1988. He received the Ph.D. degree in mechanical engineering from Wuhan University of Technology,Wuhan,China in 2020. He is now a lecturer in the Department of Mechanical Engineering at Hubei University of Technology. His research interests include digital twin,and intelligent manufacturing and CAD/CAPP/PDM.
DOI: https://doi.org/10.1080/00207543.2024.2403112
IF: 9.018
2024-09-25
International Journal of Production Research
Abstract:In the automobile manufacturing process, the complexity of the production environment and the different objectives of the upstream and downstream shops necessitate the resequencing of the car sequences using buffers. This paper addresses a car resequencing problem in automotive assembly shops by utilising selectivity banks to reshuffle the given upstream sequences to minimise the number of violations of sequencing rules in the downstream sequence. A new resequencing approach combining heuristics and deep reinforcement learning is proposed to solve the problem. Heuristics solve the automobile storage problem, while a deep reinforcement learning method based on proximal policy optimisation addresses the automobile release problem. Three state matrices, agent actions, and the reward function are designed based on the characteristics of the objective and selectivity banks. Additionally, a novel network structure combining convolutional neural networks and long short-term memory networks is proposed to train the agent. The results demonstrate that the proposed method outperforms two efficient deep reinforcement learning algorithms and two heuristics and obtains better solutions in handling dynamic events.
engineering, manufacturing, industrial,operations research & management science