Abstract:In this paper, an online neural network (NN) approach for solving H∞ optimal control problem is proposed for unknown affine nonlinear discrete-time systems with input quantization over finite-horizon. Different from value and policy iteration of traditional approximation dynamic programming (ADP) technology which always requires adequate number of iterations and more than one iteration loops to guarantee stability of the controlled systems and convergence of system states and control laws, an online NN-based finite-horizon H∞ constrained-input optimal control method is presented using actor-critic-disturbance structure which can be applied as time goes forward. The terminal cost function has been considered, though the value of system state converges to zero in the regulation problem over finite-horizon. Additionally, an input quantization has been implemented to eliminate the quantization error by using the dynamic quantizer in the control process. Moreover, an NN identification strategy is presented to obviate the dependance of the system input dynamics. The stability analysis of the proposed control algorithm is provided by using Lyapunov stability theorem. Finally, a simulation example is given to verify the feasibility and effectiveness of designed control algorithm.

Neural network-based finite-horizon optimal control of uncertain affine nonlinear discrete-time systems

A neural network-based approach for solving quantized discrete-time optimal control with input constraint over finite-horizon.

Neural network-based finite horizon stochastic optimal control design for nonlinear networked control systems

Adaptive optimal control for nonlinear discrete-time systems

Neural-Network-Based Online Optimal Control for Uncertain Non-Linear Continuous-Time Systems with Control Constraints

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Finite-horizon Optimal Control of Unknown Nonlinear Time-Delay Systems

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Finite-Horizon Near-Optimal Output Feedback Neural Network Control of Quantized Nonlinear Discrete-Time Systems With Input Constraint

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Neuro-Optimal Control of Unknown Nonaffine Nonlinear Systems with Saturating Actuators.

The Finite-Horizon Optimal Control for a Class of Time-Delay Affine Nonlinear System

Adaptive Optimal Control for a Class of Continuous-Time Affine Nonlinear Systems with Unknown Internal Dynamics

Reinforcement Learning for Adaptive Optimal Control of Unknown Continuous-Time Nonlinear Systems with Input Constraints.

Neural-Network-Based Online HJB Solution for Optimal Robust Guaranteed Cost Control of Continuous-Time Uncertain Nonlinear Systems

Finite-horizon Neural Optimal Tracking Control for a Class of Nonlinear Systems with Unknown Dynamics

Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming

Adaptive dynamic programming for infinite horizon optimal robust guaranteed cost control of a class of uncertain nonlinear systems

Adaptive Neural Inverse Optimal Control for a Class of Strict Feedback Stochastic Nonlinear Systems