Abstract:The paper provides a new approach to the determination of a single state value for stochastic output feedback problems using paradigms from Model Predictive Control, particularly the distinction between open-loop and closed-loop control and between deterministic optimal control and stochastic optimal control. The State Selection Algorithm is presented and relies on given dynamics and constraints, a nominal deterministic state-feedback controller, and a sampling based method to select the best state value, based on optimizing a prescribed finite-horizon performance function, over the available candidates provided by a particle filter. The cost function is minimized over the horizon with controls determined by the nominal controller and the selected states. So, the minimization is performed not over the selection of the control other than through the choice of state value to use. The algorithm applies generally to nonlinear stochastic systems and relies on Monte Carlo sampling and averaging. However, in linear quadratic polyhedrally constrained cases the technique reduces to a quadratic program for the state value. The algorithm is evaluated in a set of computational examples, which illustrate its efficacy and limitations. Numerical aspects and the opportunity for parallelization are discussed. The examples demonstrate the algorithm operating, in closed-loop with its attendant particle filter, over the long horizon.

Gaussian process-based state derivative estimator with temporal input in incremental flight control design

DERIVATIVE AND INTEGRAL SLIDING MODE ADAPTIVE CONTROL FOR A CLASS OF NONLINE ARSYSTEM AND ITS APPLICATION TO AN ELECTRO-HYDRAULIC SERVO SYSTEM

Learning the Dynamics of Flapping Wing Robots via Gaussian Process Regression during Three-Dimensional Trajectory Tracking.

Model Reference Gaussian Process Regression: Data-Driven State Feedback Controller

State Estimation for Nonlinear Dynamic Systems Using Gaussian Processes and Pre-Computed Local Linear Models

Model Reference Gaussian Process Regression: Data-Driven Output Feedback Controller

Real-Time Numerical Differentiation of Sampled Data Using Adaptive Input and State Estimation

Fault-Tolerant Control for Aircraft with Structural Damage Using Sparse Online Gaussian Process Regression

Learning-Based Design of Off-Policy Gaussian Controllers: Integrating Model Predictive Control and Gaussian Process Regression

Data‐based nonlinear learning control for aircraft trajectory tracking via Gaussian process regression

Gaussian Processes with State-Dependent Noise for Stochastic Control

Cautious Model Predictive Control Using Gaussian Process Regression

Adaptive predefined time neural filtered control design for an uncertain nonlinear system and application to flight control

Gaussian process learning of nonlinear dynamics

Temporal Difference Learning for Model Predictive Control

Adaptive finite-time incremental backstepping fault-tolerant control for flying-wing aircraft with state constraints

State estimation for control: an approach for output-feedback stochastic MPC

Incorporating Control Inputs in Continuous-Time Gaussian Process State Estimation for Robotics

Application of the Improved Incremental Nonlinear Dynamic Inversion in Fixed-Wing UAV Flight Tests

Modified Gaussian process regression based adaptive control for quadrotors