Abstract:Designing a stabilizing controller for nonlinear systems is a challenging task, especially for high-dimensional problems with unknown dynamics. Traditional reinforcement learning algorithms applied to stabilization tasks tend to drive the system close to the equilibrium point. However, these approaches often fall short of achieving true stabilization and result in persistent oscillations around the equilibrium point. In this work, we propose a reinforcement learning algorithm that stabilizes the system by learning a local linear representation ofthe dynamics. The main component of the algorithm is integrating the learned gain matrix directly into the neural policy. We demonstrate the effectiveness of our algorithm on several challenging high-dimensional dynamical systems. In these simulations, our algorithm outperforms popular reinforcement learning algorithms, such as soft actor-critic (SAC) and proximal policy optimization (PPO), and successfully stabilizes the system. To support the numerical results, we provide a theoretical analysis of the feasibility of the learned algorithm for both deterministic and stochastic reinforcement learning settings, along with a convergence analysis of the proposed learning algorithm. Furthermore, we verify that the learned control policies indeed provide asymptotic stability for the nonlinear systems.

Stabilization of Continuous-discrete Fractional-order 2D Roesser Model Via Reinforcement Learning and Linear Matrix Equalities

LMI-Based Stability Analysis of Continuous-Discrete Fractional-Order 2D Roesser Model

Reinforcement Learning-Based $\mathcal{h}_{\infty }$ Control of 2-D Markov Jump Roesser Systems with Optimal Disturbance Attenuation

Robust stabilization of feedback linearizable time-delay systems

Controller and Observer Design for Lipschitz Nonlinear Systems

Positive Real Lemmas for Fractional-Order Two-Dimensional Roesser Model: the 0< Ρ _1≤ 1,0<ρ _2≤ 1 Case

Optimal Control of Two-Dimensional Roesser Model: Solution Based on Reinforcement Learning

Robust H∞ Model Reduction for Fractional-order Two-dimensional Continuous Roesser System: the 1 < Ε < 2 Case

Stability analysis and stabilisation of continuous-discrete fractional-order 2D Fornasini-Marchesini first model

H∞ Filtering for Continuous Fractional‐order 2D Roesser Model: the 0<α≤1 Case

Stabilization of two-dimensional mixed continuous-discrete-time systems via dynamic output feedback with application to iterative learning control design

Finite Frequency <i>H<sub>8</sub></i> Control of Fractional-Order Continuous-Discrete 2-D Roesser Models

Robust H∞ Model Reduction for the Continuous Fractional-Order Two-Dimensional Roesser System: the 0< Ε ≤1 Case

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Finite Frequency <i>H<sub>∞</sub> </i> Control of Fractional-Order Continuous–Discrete 2-D Roesser Models

Stability robust for fractional generalized multi-dimensional state–space models

Robust H∞$$ {h}_{\infty } $$ Model Reduction for the Continuous Fractional‐order Two‐dimensional Roesser System: the 0<ε≤1$$ 0<\varepsilon \le 1 $$ Case

Stochastic Reinforcement Learning with Stability Guarantees for Control of Unknown Nonlinear Systems

Necessary and Sufficient Stability Criterion and Stabilization for Positive 2‐D Continuous‐Time Systems with Multiple Delays

LMI-Based Stability Conditions for Continuous Fractional-Order Two-Dimensional Fornasini-Marchesini First Model

Reinforcement Learning of Structured Control for Linear Systems with Unknown State Matrix