Abstract:The design of stabilizing controller for uncertain nonlinear systems with control constraints is a challenging problem. The constrained-input coupled with the inability to identify accurately the uncertainties motivates the design of stabilizing controller based on reinforcement-learning (RL) methods. In this paper, a novel RL-based robust adaptive control algorithm is developed for a class of continuous-time uncertain nonlinear systems subject to input constraints. The robust control problem is converted to the constrained optimal control problem with appropriately selecting value functions for the nominal system. Distinct from typical action-critic dual networks employed in RL, only one critic neural network (NN) is constructed to derive the approximate optimal control. Meanwhile, unlike initial stabilizing control often indispensable in RL, there is no special requirement imposed on the initial control. By utilizing Lyapunov's direct method, the closed-loop optimal control system and the estimated weights of the critic NN are proved to be uniformly ultimately bounded. In addition, the derived approximate optimal control is verified to guarantee the uncertain nonlinear system to be stable in the sense of uniform ultimate boundedness. Two simulation examples are provided to illustrate the effectiveness and applicability of the present approach.

Unifying Controller Design for Stabilizing Nonlinear Systems with Norm-Bounded Control Inputs

A Constructive Procedure Based on Dynamic Scaling for Adaptive Control of Nonlinearly Parameterized Nonlinear Systems

On adaptive control of nonlinearly parameterized nonlinear systems: Towards a constructive procedure

A Controller-Design Method For Nonlinear-Systems Via A Staged-Transformation Technique

Universal Stabilisation Design for Uncertain Nonlinear System with Sign-Switching Unknown Control Direction.

Designing of the robust stabilizing controller for uncertain delay systems - LMI approach

Asymptotic Tracking Controller Design for Nonlinear Systems with Guaranteed Performance.

Global stabilisation for a class of uncertain non-linear systems: a novel non-recursive design framework

Robust and Adaptive Stabilization Controllers of State-Constrained Nonholonomic Chained Systems: A Discontinuous Approach

Controller of stabilization for generalized bilinear systems

Global stabilization of nonlinear systems with marginally unstable free dynamics by small controls

A Tunable Universal Formula for Safety-Critical Control

Reinforcement-Learning-Based Robust Controller Design for Continuous-Time Uncertain Nonlinear Systems Subject to Input Constraints

Unified Sufficient Conditions for Predefined-Time Stability of Non-Linear Systems and Its Standard Controller Design

Nussbaum Function Based Control Design for A Class of Uncertain Stochastic High-order Nonlinear Systems

Design of Stabilizing Controllers for Nonlinear Systems

A New Method For Stabilization Of A Class Of Nonlinear Discrete-Time Systems

An LMI-based Unified Approach to Reduced-Order Controller Design

Stabilizing Controllers For Nonlinear Systems Based On Standard Neural Network Models

Robust Stabilization Controller Design Technique for Linear Time-Varying Systems

NN/RISE-based Controller Design for a Class of Uncertain Nonlinear Systems with Time-Varying Constraints.