Abstract:We propose a piecewise learning framework for controlling nonlinear systems with unknown dynamics. While model-based reinforcement learning techniques in terms of some basis functions are well known in the literature, when it comes to more complex dynamics, only a local approximation of the model can be obtained using a limited number of bases. The complexity of the identifier and the controller can be considerably high if obtaining an approximation over a larger domain is desired. To overcome this limitation, we propose a general piecewise nonlinear framework where each piece is responsible for locally learning and controlling over some region of the domain. We obtain rigorous uncertainty bounds for the learned piecewise models. The piecewise affine (PWA) model is then studied as a special case, for which we propose an optimization-based verification technique for stability analysis of the closed-loop system. Accordingly, given a time-discretization of the learned PWA system, we iteratively search for a common piecewise Lyapunov function in a set of positive definite functions, where a non-monotonic convergence is allowed. This Lyapunov candidate is verified on the uncertain system to either provide a certificate for stability or find a counter-example when it fails. This counter-example is added to a set of samples to facilitate the further learning of a Lyapunov function. We demonstrate the results on two examples and show that the proposed approach yields a less conservative region of attraction (ROA) compared with alternative state-of-the-art approaches. Moreover, we provide the runtime results to demonstrate potentials of the proposed framework in real-world implementations.

An integral sliding-mode parallel control approach for general nonlinear systems via piecewise affine linear models

A new adaptive sliding mode control of uncertain nonlinear systems

Passivity-based adaptive integral sliding mode control of uncertain nonlinear systems

A New Robust Adaptive Control of Uncertain Nonlinear Systems and Pendulum Application

Continuous sliding mode control for uncertain linear time-invariant systems with matched and unmatched uncertainties using the Lyapunov-function integral sliding mode

Integral Sliding-Mode Control of Piecewise Linear systems

Dynamic Sliding-Mode Control for Piecewise Affine Systems

Finite-Time Sliding Mode Control Design for Unknown Nonaffine Pure-Feedback Systems

A new nonlinear sliding mode control system design

A Robust Adaptive CMAC Neural Network-Based Multisliding Mode Control Method for Unmatched Uncertain Nonlinear Systems

A Piecewise Learning Framework for Control of Unknown Nonlinear Systems with Stability Guarantees

A fuzzy integral sliding-mode parallel control approach for nonlinear descriptor systems

Global Sliding-Mode Control for Companion Nonlinear System with Bounded Control

Guaranteed Stabilization and Safety of Nonlinear Systems Via Sliding Mode Control

A New Approach to Stabilization of Uncertain Nonlinear Systems

Pwa State Feedback Controller Synthesis for Piecewise-Linear Systems

Nearly optimal stabilization of unknown continuous-time nonlinear systems: A new parallel control approach

A New Integral Sliding Mode Design Method for Nonlinear Stochastic Systems.

A Special Kind of Sliding Mode Control for Nonlinear System with State Constraints.

An Optimal Integral Sliding Mode Control Strategy Based on A Pseudospectral Method for A Class of Affine Systems

Adaptive Control Design of Uncertain Piecewise-Linear Systems