Active learning for anti-disturbance dual control of unknown nonlinear systems

Xuehui Ma,Shiliang Zhang,Fucai Qian,Jinbao Wang,Yushuai Li
DOI: https://doi.org/10.48550/arXiv.2212.08934
2022-12-18
Abstract:This work concerns the control of unknown nonlinear systems corrupted by disturbances. For such systems, we propose an anti-disturbance dual control approach with active learning of the disturbances. Our approach holds the dual property of handling the two tasks simultaneously and iteratively: (i) learn the disturbances affecting the system and (ii) drive the system output towards a reference trajectory. Particularly, we model nonlinear system dynamics using a specialized neural network (SNN). This SNN formulates the disturbances via the designed additive and multiplicative disturbance components. We consider both additive and multiplicative disturbances for precise description and recognition of disturbance profile. We achieve the disturbance recognition in the SNN via the design of a Bayesian-based active learning approach, which allows the disturbance learning to be decoupled from the control law derivation. Such a decoupling contributes to the control robustness in the existence of varying and abrupt disturbances. We derive the dual control law based on the active learning of the SNN, and validate our approach via one-time and Monte Carlo simulations. The results demonstrate a fast disturbance recognition by our method in real-time and the robustness of control of unknown systems with abrupt disturbances. We evaluate our approach on the speed control of high-speed train, and the results manifest efficient control of the train speed with disturbance resilience, without prior knowledge about the train dynamics and the disturbances imposed on the train. We openly released the code for this work for reproduction purpose.
Optimization and Control
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to effectively handle and suppress the influence of disturbances in an unknown nonlinear system while achieving robust control of the system. Specifically, the paper focuses on those unknown nonlinear systems affected by external environmental interference or internal uncertain factors. These disturbances may come from the external environment (such as wind, rain, snow, etc.) or internal components of the system (such as wear, aging and failure of mechanical and electronic parts), which have an adverse impact on the control performance of the system and may lead to a decline in production efficiency and economic losses. To meet this challenge, the paper proposes an anti - disturbance dual control approach with active learning. This method has dual characteristics and can simultaneously and iteratively complete two tasks: 1. **Learning Disturbances**: Identify the disturbances affecting the system. 2. **Driving System Output**: Make the system output approach the reference trajectory. To achieve these two tasks, the paper adopts the following key technologies: - **Specialized Neural Network (SNN)**: Used to model the nonlinear system dynamics and describe the disturbances through the designed additive and multiplicative disturbance components. - **Bayesian Active Learning**: Realize real - time disturbance learning through the Bayesian method, decoupling the disturbance learning from the control law derivation, thereby improving the robustness of control, especially in the presence of changing and sudden disturbances. - **Dual Control Law Derivation**: Based on the active learning results of SNN, derive the dual control law to ensure the stability and performance of the system under unknown disturbances. The paper verifies the effectiveness of the proposed method through one - time and Monte Carlo simulations and evaluates it in high - speed train speed control, demonstrating the advantages of this method in real - time rapid identification of disturbances and robust control.