Abstract:Infinite-horizon optimal control of constrained piecewise affine (PWA) systems has been approximately addressed by hybrid model predictive control (MPC), which, however, has computational limitations, both in offline design and online implementation. In this paper, we consider an alternative approach based on approximate dynamic programming (ADP), an important class of methods in reinforcement learning. We accommodate non-convex union-of-polyhedra state constraints and linear input constraints into ADP by designing PWA penalty functions. PWA function approximation is used, which allows for a mixed-integer encoding to implement ADP. The main advantage of the proposed ADP method is its online computational efficiency. Particularly, we propose two control policies, which lead to solving a smaller-scale mixed-integer linear program than conventional hybrid MPC, or a single convex quadratic program, depending on whether the policy is implicitly determined online or explicitly computed offline. We characterize the stability and safety properties of the closed-loop systems, as well as the sub-optimality of the proposed policies, by quantifying the approximation errors of value functions and policies. We also develop an offline mixed-integer linear programming-based method to certify the reliability of the proposed method. Simulation results on an inverted pendulum with elastic walls and on an adaptive cruise control problem validate the control performance in terms of constraint satisfaction and CPU time.

Approximate Explicit Model Predictive Control Using High-Level Canonical Piecewise-Affine Functions.

Fast Linear Parameter Varying Model Predictive Control of Buck DC-DC Converters Based on FPGA.

An Improved Model Predictive Control Approach Based on Extended Non-Minimal State Space Formulation

Robust Dual-Model Predictive Control for a Class of Piecewise Affine Systems

Piecewise Linear Approximation and Its Application in Model Predictive Control

Error-free Approximation of Explicit Linear MPC Through Lattice Piecewise Affine Expression

Lebesgue-Approximation Model Predictive Control of Nonlinear Sampled-Data Systems

A Fuzzy Approximation for FCS-MPC in Power Converters

Model predictive control based on adaptive hinging hyperplanes model

Lattice piecewise affine approximation of explicit model predictive control with application to satellite attitude control

A Survey on Explicit Model Predictive Control

Robust Low Complexity Predictive Control of Constrained Piecewise Affine Systems with Bounded Disturbances

Model Predictive Control of Piecewise Affine System with Constrained Input and Time Delay

Model Predictive Bang-Bang Controller Synthesis via Approximate Value Functions

Explicit machine learning-based model predictive control of nonlinear processes via multi-parametric programming

Lyapunov-Based Fast Finite-State Model Predictive Control for Sensorless Three-Phase Four-Arm MMC

Fuzzy Approximation ARX Model-based Intelligent Two-Horizon Robust FCS-MPC for Power Converter

Approximate Dynamic Programming for Constrained Piecewise Affine Systems with Stability and Safety Guarantees

Approximate Dynamic Programming based Model Predictive Control of Nonlinear systems

An interpretative and adaptive MPC for nonlinear systems

An Orthogonal Partitioning Approach to Simplify Robust Model Predictive Control