Abstract:The paper provides a new approach to the determination of a single state value for stochastic output feedback problems using paradigms from Model Predictive Control, particularly the distinction between open-loop and closed-loop control and between deterministic optimal control and stochastic optimal control. The State Selection Algorithm is presented and relies on given dynamics and constraints, a nominal deterministic state-feedback controller, and a sampling based method to select the best state value, based on optimizing a prescribed finite-horizon performance function, over the available candidates provided by a particle filter. The cost function is minimized over the horizon with controls determined by the nominal controller and the selected states. So, the minimization is performed not over the selection of the control other than through the choice of state value to use. The algorithm applies generally to nonlinear stochastic systems and relies on Monte Carlo sampling and averaging. However, in linear quadratic polyhedrally constrained cases the technique reduces to a quadratic program for the state value. The algorithm is evaluated in a set of computational examples, which illustrate its efficacy and limitations. Numerical aspects and the opportunity for parallelization are discussed. The examples demonstrate the algorithm operating, in closed-loop with its attendant particle filter, over the long horizon.

Learning-based State Estimation and Control using MHE and MPC Schemes with Imperfect Models

An Improved Model Predictive Control Approach Based on Extended Non-Minimal State Space Formulation

Learning-Based Hierarchical Model Predictive Control for Drift Vehicles

Multi-step Prediction Error Approach for Controller Performance Monitoring

Learning-Based MPC Controller for Drift Control of Autonomous Vehicles

Policy Gradient Reinforcement Learning for Uncertain Polytopic LPV Systems based on MHE-MPC

Sub-Optimal Moving Horizon Estimation in Feedback Control of Linear Constrained Systems

Learning-based model predictive control with moving horizon state estimation for autonomous racing

Learning MPC for Process Dynamic Working Condition Change Tasks under Model Mismatch

State estimation for control: an approach for output-feedback stochastic MPC

Neural Lyapunov Model Predictive Control: Learning Safe Global Controllers from Sub-optimal Examples

Learning-Based Model Predictive Control: Toward Safe Learning in Control

Learning an Approximate Model Predictive Controller With Guarantees

Model Predictive Control via On-Policy Imitation Learning

Experimental evaluations of model-based reinforcement learning combined with MPC

Safe Learning-based Gradient-free Model Predictive Control Based on Cross-entropy Method

Reinforcement learning based MPC with neural dynamical models

Performance-Oriented Model Learning for Data-Driven MPC Design

Safe Learning-Based Model Predictive Control Using The Compatible Models Approach

Stability-informed Bayesian Optimization for MPC Cost Function Learning

Differentiable MPC for End-to-end Planning and Control