Abstract:We propose a piecewise learning framework for controlling nonlinear systems with unknown dynamics. While model-based reinforcement learning techniques in terms of some basis functions are well known in the literature, when it comes to more complex dynamics, only a local approximation of the model can be obtained using a limited number of bases. The complexity of the identifier and the controller can be considerably high if obtaining an approximation over a larger domain is desired. To overcome this limitation, we propose a general piecewise nonlinear framework where each piece is responsible for locally learning and controlling over some region of the domain. We obtain rigorous uncertainty bounds for the learned piecewise models. The piecewise affine (PWA) model is then studied as a special case, for which we propose an optimization-based verification technique for stability analysis of the closed-loop system. Accordingly, given a time-discretization of the learned PWA system, we iteratively search for a common piecewise Lyapunov function in a set of positive definite functions, where a non-monotonic convergence is allowed. This Lyapunov candidate is verified on the uncertain system to either provide a certificate for stability or find a counter-example when it fails. This counter-example is added to a set of samples to facilitate the further learning of a Lyapunov function. We demonstrate the results on two examples and show that the proposed approach yields a less conservative region of attraction (ROA) compared with alternative state-of-the-art approaches. Moreover, we provide the runtime results to demonstrate potentials of the proposed framework in real-world implementations.

Pwa State Feedback Controller Synthesis for Piecewise-Linear Systems

Improved State Feedback Controller Synthesis For Piecewise-Linear Systems

Observer-Based Controller Design of Discrete-Time Piecewise Affine Systems

Stabilizing Model Predictive Control Scheme for Piecewise Affine Systems with Maximal Positively Invariant Terminal Set

Dynamic Sliding-Mode Control for Piecewise Affine Systems

State feedback stabilization of uncertain discrete linear impulsive systems

Data-driven control for discrete-time piecewise affine systems

Lmi-Based H-Infinity Control Scheme For Discrete-Time Piecewise Affine Systems

New Approach to Fixed-Order Output-Feedback Control for Piecewise-Affine Systems

LMI-based H<inf>&#x221E;</inf> control scheme for discrete-time piecewise affine systems

A Novel Approach to Reliable Control of Piecewise Affine Systems with Actuator Faults.

Robust Control of Piecewise Affine System with Constrained Input and Parameter Perturbation

Controller Synthesis of Continuous-Time Piecewise Linear Systems Based on Piecewise Lyapunov Functions

Adaptive control design for piecewise-linear differential inclusion with parameter uncertainty

H∞ Control Scheme Research of Piecewise Affine Discrete-Time Systems Based on Describing Regions As Polyhedra

A Piecewise Learning Framework for Control of Unknown Nonlinear Systems with Stability Guarantees

An integral sliding-mode parallel control approach for general nonlinear systems via piecewise affine linear models

Sampling-based Polytopic Trees for Approximate Optimal Control of Piecewise Affine Systems

Adaptive robust control of piecewise-linear systems with parametric uncertainties

State Feedback Controller Design for Affine Parameter-Dependent LPV Systems

Optimizing the Performance of the Feedback Controller for State‐based Switching Bilinear Systems