Abstract:This work concerns the control of unknown nonlinear systems corrupted by disturbances. For such systems, we propose an anti-disturbance dual control approach with active learning of the disturbances. Our approach holds the dual property of handling the two tasks simultaneously and iteratively: (i) learn the disturbances affecting the system and (ii) drive the system output towards a reference trajectory. Particularly, we model nonlinear system dynamics using a specialized neural network (SNN). This SNN formulates the disturbances via the designed additive and multiplicative disturbance components. We consider both additive and multiplicative disturbances for precise description and recognition of disturbance profile. We achieve the disturbance recognition in the SNN via the design of a Bayesian-based active learning approach, which allows the disturbance learning to be decoupled from the control law derivation. Such a decoupling contributes to the control robustness in the existence of varying and abrupt disturbances. We derive the dual control law based on the active learning of the SNN, and validate our approach via one-time and Monte Carlo simulations. The results demonstrate a fast disturbance recognition by our method in real-time and the robustness of control of unknown systems with abrupt disturbances. We evaluate our approach on the speed control of high-speed train, and the results manifest efficient control of the train speed with disturbance resilience, without prior knowledge about the train dynamics and the disturbances imposed on the train. We openly released the code for this work for reproduction purpose.

Deep Reinforcement Learning Control for Disturbance Rejection in a Nonlinear Dynamic System with Parametric Uncertainty

Reinforcement Learning-Based $\mathcal{h}_{\infty }$ Control of 2-D Markov Jump Roesser Systems with Optimal Disturbance Attenuation

Disturbance Rejection of a Class of Discrete-Time Multi-Agent Systems with Pinning Control

Dynamic Linearization Based Adaptive Nonlinear Active Disturbance Rejection Control

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Active learning for anti-disturbance dual control of unknown nonlinear systems

Single degree of freedom control based on deep reinforcement learning for underwater unmanned vehicle

Fractional-Order Control Method Based on Twin-Delayed Deep Deterministic Policy Gradient Algorithm

Learning Robust Policies via Interpretable Hamilton-Jacobi Reachability-Guided Disturbances

Deep Reinforcement Learning for Online Control of Stochastic Partial Differential Equations

Stability-certified reinforcement learning: A control-theoretic perspective

Reinforcement Learning Policies in Continuous-Time Linear Systems

Robust Reinforcement Learning for Risk-Sensitive Linear Quadratic Gaussian Control

Simulation Study on Auto-disturbance rejection Control for Unstable Systems and Non-minimum Phase Systems

Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Control

Reinforcement Learning for Adaptive Optimal Stationary Control of Linear Stochastic Systems

Deterministic policy gradient based optimal control with probabilistic constraints

Deep reinforcement learning with reward shaping for tracking control and vibration suppression of flexible link manipulator

Disturbance Observer-based Control Barrier Functions with Residual Model Learning for Safe Reinforcement Learning

Adaptive Control of an Inverted Pendulum by a Reinforcement Learning-based LQR Method