Data-Driven Predictive Control Using Closed-Loop Data: An Instrumental Variable Approach

Yibo Wang,Yiwen Qiu,Malika Sader,Dexian Huang,Chao Shang
2023-09-12
Abstract:Current data-driven predictive control (DDPC) methods heavily rely on data collected in open-loop operation with elaborate design of inputs. However, due to safety or economic concerns, systems may have to be under feedback control, where only closed-loop data are available. In this context, it remains challenging to implement DDPC using closed-loop data. In this paper, we propose a new DDPC method using closed-loop data by means of instrumental variables (IVs). By drawing from closed-loop subspace identification, the use of two forms of IVs is suggested to address the closed-loop issues caused by feedback control and the correlation between inputs and noise. Furthermore, a new DDPC formulation with a novel IV-inspired regularizer is proposed, where a balance between control cost minimization and weighted least-squares data fitting can be made for improvement of control performance. Numerical examples and application to a simulated industrial furnace showcase the improved performance of the proposed DDPC based on closed-loop data.
Optimization and Control
What problem does this paper attempt to address?
The paper primarily focuses on addressing the challenges of applying Data-Driven Predictive Control (DDPC) under closed-loop data conditions. Traditional DDPC methods typically require carefully designed inputs under open-loop operation to collect data that ensures persistent excitation. However, in actual industrial scenarios, systems are often under closed-loop control for safety or economic reasons, thus only closed-loop data can be obtained. In such cases, directly implementing DDPC using closed-loop data becomes highly challenging. The paper proposes a new DDPC method based on closed-loop data by introducing Instrumental Variables (IVs) to address the issue of implementing DDPC under closed-loop conditions. Specifically, the authors draw on the methods of Closed-Loop Subspace Identification (SID) and propose two forms of IVs: one is the future feedback reference signal, and the other is an IV designed based on the Left Coprime Factorization (LCF) of the controller. Additionally, the paper presents a new regularized DDPC formulation that includes a novel IV-inspired regularization term, which can balance minimizing control costs and weighted least squares data fitting, thereby improving control performance. Through numerical examples and an application case of a simulated industrial furnace system, the proposed closed-loop data-based DDPC method is shown to have better control performance compared to traditional DDPC algorithms. These results demonstrate the effectiveness and superiority of implementing DDPC using closed-loop data.