Abstract:This paper considers the problem of controlling a dynamical system when the state cannot be directly measured and the control performance metrics are unknown or partially known. In particular, we focus on the design of data-driven controllers to regulate a dynamical system to the solution of a constrained convex optimization problem where: i) the state must be estimated from nonlinear and possibly high-dimensional data; and, ii) the cost of the optimization problem -- which models control objectives associated with inputs and states of the system -- is not available and must be learned from data. We propose a data-driven feedback controller that is based on adaptations of a projected gradient-flow method; the controller includes neural networks as integral components for the estimation of the unknown functions. Leveraging stability theory for perturbed systems, we derive sufficient conditions to guarantee exponential input-to-state stability (ISS) of the control loop. In particular, we show that the interconnected system is ISS with respect to the approximation errors of the neural network and unknown disturbances affecting the system. The transient bounds combine the universal approximation property of deep neural networks with the ISS characterization. Illustrative numerical results are presented in the context of control of robotics and epidemics.

On the design of persistently exciting inputs for data-driven control of linear and nonlinear systems

Nonlinear Control under Discrete Transport Pdes on Domains of Time-Varying Length

Designing Experiments for Data-Driven Control of Nonlinear Systems

Data-Driven Event-Triggered Adaptive Dynamic Programming Control for Nonlinear Systems with Input Saturation.

Hybrid Persistency of Excitation in Adaptive Estimation for Hybrid Systems

Sequential learning and control: Targeted exploration for robust performance

Impulsive Control of Stochastic Systems with Applications in Chaos Control, Chaos Synchronization, and Neural Networks

Relaxed Excitation Conditions for Robust Identification and Adaptive Control Using Estimation with Memory

Sample- and computationally efficient data-driven predictive control

Data-driven input-to-state stabilization

Data-Based Control of Continuous-Time Linear Systems with Performance Specifications

Control of Discrete-Time Singularly Perturbed Systems Via Static Output Feedback

Online Optimization of Dynamical Systems with Deep Learning Perception

Formulas for Data-driven Control: Stabilization, Optimality and Robustness

Data-driven learning and control of nonlinear system dynamics

Exponential stability and relative controllability of first‐order delayed integro‐differential systems with impulses

Data-driven input-to-state stabilization with respect to measurement errors

Integral Input-to-State Stability of Nonlinear Time-Delay Systems with Delay-Dependent Impulse Effects

Exponential Stability of Nonlinear Systems With Delayed Impulses and Applications

Input-to-State Stability of Nonlinear Impulsive Systems Subjects to Actuator Saturation and External Disturbance

Robust Control Design for Linear Systems via Multiplicative Noise