Abstract:This paper presents a comprehensive framework addressing optimal nonlinear analysis and feedback control synthesis for nonlinear stochastic dynamical systems. The focus lies on establishing connections between stochastic Lyapunov theory and stochastic Hamilton–Jacobi–Bellman theory within a unified perspective. We demonstrate that the closed-loop nonlinear system's asymptotic stability in probability is ensured through a Lyapunov function, identified as the solution to the steady-state form of the stochastic Hamilton–Jacobi–Bellman equation. This dual assurance guarantees both stochastic stability and optimality. Additionally, optimal feedback controllers for affine nonlinear systems are developed using an inverse optimality framework tailored to the stochastic stabilization problem. Furthermore, the paper derives stability margins for optimal and inverse optimal stochastic feedback regulators. Gain, sector, and disk margin guarantees are established for nonlinear stochastic dynamical systems controlled by nonlinear optimal and inverse optimal Hamilton–Jacobi–Bellman controllers.

Problems in Control and Intrinsic Nonlinearities

Nonlinear Stochastic Dynamics and Control in Hamiltonian Formulation

Recent Developments in Nonlinear Stochastic Dynamics and Control

Frequency-domain and Time-Domain Methods for Feedback Nonlinear Systems and Applications to Chaos Control

Two Kinds of Harmonic Problems in Control Systems.

New Trends in Nonlinear Control Systems and Applications

Mechanics and control science

Strongly practical robust control for a class of nonlinear systems

L2 Approach and Constrained Robust Control for Nonlinear Systems

Controllability of a class of infinite dimensional linear systems

Several Harmonic Control Problems and Their Applications

Nonlinear Control Systems and Power System Dynamics

Controllability of Infinite Dimensional Linear Systems in Banach Spaces

Dynamics And Chaos Control Of Nonlinear Systems With Attraction/Repulsion Function

Restricted Finite Time Control of Nonlinear Systems

Nonlinear robust control for complex dynamical systems

Chaotic Vibration of the Wave Equation with Nonlinear Feedback Boundary Control: Progress and Open Questions

Nonlinear control systems - A brief overview of historical and recent advances

Controlling network-coupled neural dynamics with nonlinear network control theory

Design of controller for a class of pendulum-like system guaranteeing dichotomy

Nonlinear Optimal Control for Stochastic Dynamical Systems