Abstract:This paper studies formal synthesis of controllers for continuous-space systems with unknown dynamics to satisfy requirements expressed as linear temporal logic formulas. Formal abstraction-based synthesis schemes rely on a precise mathematical model of the system to build a finite abstract model, which is then used to design a controller. The abstraction-based schemes are not applicable when the dynamics of the system are unknown. We propose a data-driven approach that computes a growth bound of the system using a finite number of trajectories. The computed growth bound together with the sampled trajectories are then used to construct the abstraction and synthesise a controller. Our approach casts the computation of a growth bound as a robust convex optimisation program (RCP). Since the unknown dynamics appear in the optimisation, we formulate a scenario convex program (SCP) corresponding to the RCP using a finite number of sampled trajectories. We establish a sample complexity result that gives a lower bound for the number of sampled trajectories to guarantee the correctness of the growth bound computed from the SCP with a given confidence. Our sample complexity result requires knowing a possibly conservative bound on the Lipschitz constant of the system. We also provide a sample complexity result for the satisfaction of the specification on the system in closed loop with the designed controller for a given confidence. Our data-driven synthesised controller can provide guarantees on satisfaction of both finite and infinite-horizon specifications. We show that our data-driven approach can be readily used as a model-free abstraction refinement scheme by modifying the formulation of the system’s growth bounds and providing similar sample complexity results. The performance of our approach is shown on three case studies.

A structure exploiting SDP solver for robust controller synthesis

Structured controller synthesis through block-diagonal factorization and parameter space optimization

Koopman-based control using sum-of-squares optimization: Improved stability guarantees and data efficiency

Multi-objective Robust Controller Synthesis for Discrete-Time Systems with Convex Polytopic Uncertain Domain

Synthesizing Control Laws from Data using Sum-of-Squares Optimization

Simultaneous Controller and Lyapunov Function Design for Constrained Nonlinear Systems

Control Synthesis for Polynomial Nonlinear Systems and Application in Attitude Control

Parameter Space Optimization for Robust Controller Synthesis With Structured Feedback Gain

Scalable control synthesis for stochastic systems via structural IMDP abstractions

Formal controller synthesis for hybrid systems using genetic programming

Data-driven abstraction-based control synthesis

Control Synthesis for Stability and Safety by Differential Complementarity Problem

Decomposed Structured Subsets for Semidefinite Optimization

Structured controller synthesis with restricted frequency domain specifications

Safe and Stable Control Synthesis for Uncertain System Models via Distributionally Robust Optimization

Robust Dynamic Programming for Temporal Logic Control of Stochastic Systems

Fast System Level Synthesis: Robust Model Predictive Control using Riccati Recursions

Approximate Optimal Controller Synthesis for Cart-Poles and Quadrotors via Sums-of-Squares

Data-Driven Control of Linear Parabolic Systems using Koopman Eigenstructure Assignment

Robust Optimal Control for Nonlinear Systems with Parametric Uncertainties via System Level Synthesis

Optimal Control for Structurally Sparse Systems using Graphical Inference