A novel deep ensemble reinforcement learning based control method for strip flatness in cold rolling steel industry

Wen Peng,Jiawei Lei,Chenyan Ding,Chongxiang Yue,Gengsheng Ma,Jie Sun,Dianhua Zhang,Chengyan Ding
DOI: https://doi.org/10.1016/j.engappai.2024.108695
IF: 8
2024-08-01
Engineering Applications of Artificial Intelligence
Abstract:The flatness control system of cold-rolled strip is characterized by nonlinearity, strong coupling, and multivariable features. Theoretical models of flatness derived from physical mechanisms of the rolling process are intricate. This complexity makes it challenging to establish an accurate control model. Reinforcement learning (RL) is a machine learning method that uses an intelligent agent to learn from data interacting with its environment. In this study, considering the large quantity of historical data generated by the strip steel control system, we used the RL method to analyze the data offline in order to train a data-driven controller. We combined it with ensemble learning to propose a novel method for flatness control based on ensemble deep reinforcement learning (EDRL). Initially, we constructed a state space model for the cold-rolled flatness utilizing historical production data. This model served as the environment for offline RL training. We present an EDRL-based flatness control method that incorporates the principles of ensemble learning. Ensemble learning amalgamates multiple individual models to achieve superior performances. In the online simulation of rolling production, the EDRL-controlled flatness value was less than 5 (I-Unit) IU from the target flatness value, exceeding the performance of the proportional–integral (PI) controller. The proposed method surpassed the conventional approach in terms of both robustness and its capability to regulate flatness.
automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
What problem does this paper attempt to address?