Abstract:We consider a nonlinear control system modeled as an ordinary differential equation subject to disturbance, with a state feedback controller parameterized as a feedforward neural network. We propose a framework for training controllers with certified robust forward invariant polytopes, where any trajectory initialized inside the polytope remains within the polytope, regardless of the disturbance. First, we parameterize a family of lifted control systems in a higher dimensional space, where the original neural controlled system evolves on an invariant subspace of each lifted system. We use interval analysis and neural network verifiers to further construct a family of lifted embedding systems, carefully capturing the knowledge of this invariant subspace. If the vector field of any lifted embedding system satisfies a sign constraint at a single point, then a certain convex polytope of the original system is robustly forward invariant. Treating the neural network controller and the lifted system parameters as variables, we propose an algorithm to train controllers with certified forward invariant polytopes in the closed-loop control system. Through two examples, we demonstrate how the simplicity of the sign constraint allows our approach to scale with system dimension to over $50$ states, and outperform state-of-the-art Lyapunov-based sampling approaches in runtime.

Direct Data-Driven Computation of Polytopic Robust Control Invariant Sets and State-Feedback Controllers

Data-Driven Computation of Robust Invariant Sets and Gain-Scheduled Controllers for Linear Parameter-Varying Systems

Data-Driven Synthesis of Configuration-Constrained Robust Invariant Sets for Linear Parameter-Varying Systems

LMI-based Data-Driven Robust Model Predictive Control

Computing robust control invariant sets of constrained nonlinear systems: A graph algorithm approach

Bias correction and instrumental variables for direct data-driven model-reference control

Parameter Dependent Robust Control Invariant Sets for LPV Systems with Bounded Parameter Variation Rate

Direct Optimization Based Compensation Adaptive Robust Control of Nonlinear Systems with State and Input Constraints

Computation of safe disturbance sets using implicit RPI sets

Data-driven approximation of control invariant set for linear system based on convex piecewise linear fitting

Data-Driven Robust Covariance Control for Uncertain Linear Systems

Learning Robust Safety Controllers for Uncertain Input-Affine Polynomial Systems

Direct Data-Driven Control of Linear Time-Varying Systems

Data-Based Control of Continuous-Time Linear Systems with Performance Specifications

Robust Data-Driven Predictive Control for Unknown Linear Time-Invariant Systems

Robust invariance-based explicit reference control for constrained linear systems

Data-Driven Controlled Invariant Sets for Gaussian Process State Space Models

Data-Driven Structured Robust Control of Linear Systems

Data-Driven Robust Backward Reachable Sets for Set-Theoretic Model Predictive Control

Robust Distributed Control Beyond Quadratic Invariance

Certified Robust Invariant Polytope Training in Neural Controlled ODEs