Solve Large-Scale Strip Packing Problem Via Reinforcement Learning

Yang Xu,Zhouwang Yang

DOI: https://doi.org/10.2139/ssrn.4267698

2022-01-01

SSRN Electronic Journal

Abstract:Considerable advances applying reinforcement learning (RL) to packing problems have been made recently. However, most of these methods lack attention to the difficulties in practice, particularly the large-scale situations. To address this research gap, an RL method to solve large-scale strip packing problems is proposed in this paper. Two graph neural networks called SkylineNet and PackNet are designed to fully incorporate the structure of the problem and enhance the generalization performance. Specifically, SkylineNet encodes the geometry of the free space as the context feature, and then PackNet, supporting the symmetry of rectangles, chooses the next rectangle to pack from the remaining rectangles at each timestep. We conduct a fixed-length experiment and a scalable-length experiment, depending on whether the training length of rectangles is equal to the test length, to test our method. The experimental results indicate that our method outperforms the classical heuristic methods and previous RL methods. It is noteworthy that in the scalable-length experiment, our network trained by small-size problems generalizes well to large-scale problems, surpassing Google's OR-Tools.