Abstract:This paper studies formal synthesis of controllers for continuous-space systems with unknown dynamics to satisfy requirements expressed as linear temporal logic formulas. Formal abstraction-based synthesis schemes rely on a precise mathematical model of the system to build a finite abstract model, which is then used to design a controller. The abstraction-based schemes are not applicable when the dynamics of the system are unknown. We propose a data-driven approach that computes a growth bound of the system using a finite number of trajectories. The computed growth bound together with the sampled trajectories are then used to construct the abstraction and synthesise a controller. Our approach casts the computation of a growth bound as a robust convex optimisation program (RCP). Since the unknown dynamics appear in the optimisation, we formulate a scenario convex program (SCP) corresponding to the RCP using a finite number of sampled trajectories. We establish a sample complexity result that gives a lower bound for the number of sampled trajectories to guarantee the correctness of the growth bound computed from the SCP with a given confidence. Our sample complexity result requires knowing a possibly conservative bound on the Lipschitz constant of the system. We also provide a sample complexity result for the satisfaction of the specification on the system in closed loop with the designed controller for a given confidence. Our data-driven synthesised controller can provide guarantees on satisfaction of both finite and infinite-horizon specifications. We show that our data-driven approach can be readily used as a model-free abstraction refinement scheme by modifying the formulation of the system’s growth bounds and providing similar sample complexity results. The performance of our approach is shown on three case studies.

Convex Constrained Controller Synthesis for Evolution Equations

A Constructive Procedure Based on Dynamic Scaling for Adaptive Control of Nonlinearly Parameterized Nonlinear Systems

Immersion and Invariance Adaptive Control of Nonlinearly Parameterized Nonlinear Systems

Systematic, Lyapunov-Based, Safe and Stabilizing Controller Synthesis for Constrained Nonlinear Systems

Synthesis of a Regulator for a Linear-Quadratic Optimal Control Problem

Simultaneous Controller and Lyapunov Function Design for Constrained Nonlinear Systems

On the convexity of static output feedback control synthesis for systems with lossless nonlinearities

Model Predictive Control for Regular Linear Systems

State Feedback System Level Synthesis in Continuous Time

Second-Order Non-Convex Optimization for Constrained Fixed-Structure Static Output Feedback Controller Synthesis

On Infinite-horizon System Level Synthesis Problems

Systematic Stabilization of Constrained Piecewise Affine Systems

Online Regulation of Dynamical Systems to Solutions of Constrained Optimization Problems

Learning Control-Oriented Dynamical Structure from Data

Direct Data-Driven State-Feedback Control of Linear Parameter-Varying Systems

A Synthesis Approach of On-Line Constrained Robust Model Predictive Control

Designing System Level Synthesis Controllers for Nonlinear Systems with Stability Guarantees

Synthesizing Control Laws from Data using Sum-of-Squares Optimization

Cooptimizing Safety and Performance with a Control-Constrained Formulation

Data-driven abstraction-based control synthesis

Direct data-driven state-feedback control of general nonlinear systems