Abstract:Probabilistic control design is founded on the principle that a rational agent attempts to match modelled with an arbitrary desired closed-loop system trajectory density. The framework was originally proposed as a tractable alternative to traditional optimal control design, parametrizing desired behaviour through fictitious transition and policy densities and using the information projection as a proximity measure. In this work we introduce an alternative parametrization of desired closed-loop behaviour and explore alternative proximity measures between densities. It is then illustrated how the associated probabilistic control problems solve into uncertain or probabilistic policies. Our main result is to show that the probabilistic control objectives majorize conventional, stochastic and risk sensitive, optimal control objectives. This observation allows us to identify two probabilistic fixed point iterations that converge to the deterministic optimal control policies establishing an explicit connection between either formulations. Further we demonstrate that the risk sensitive optimal control formulation is also technically equivalent to a Maximum Likelihood estimation problem on a probabilistic graph model where the notion of costs is directly encoded into the model. The associated treatment of the estimation problem is then shown to coincide with the moment projected probabilistic control formulation. That way optimal decision making can be reformulated as an iterative inference problem. Based on these insights we discuss directions for algorithmic development.

A Bayesian perspective on classical control

A Proposal on Centralised and Distributed Optimisation Via Proportional-Integral-derivative Controllers (PID) Control Perspective

Iterative design of suboptimal feedback control for bilinear parabolic PDE systems

Bayesian Learning Approach to Model Predictive Control

Robustness of Control Design via Bayesian Learning

A PAC-Bayesian Framework for Optimal Control with Stability Guarantees

Stochastic Optimal Control as Approximate Input Inference

Control of coupled nonaffine multiagent stochastic systems by classical PID

Optimal control under unknown intensity with Bayesian learning

Towards a Theoretical Foundation of PID Control for Uncertain Nonlinear Systems

Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system

Unified Control Framework: A Novel Perspective on Constrained Optimization, Optimization-based Control, and Parameter Estimation

Probabilistic Control and Majorization of Optimal Control

Stochastic Model Predictive Control Utilizing Bayesian Neural Networks

Probabilistic inverse optimal control for non-linear partially observable systems disentangles perceptual uncertainty and behavioral costs

Using Bayesian Optimization to Design Time Step Size Controllers with Application to Modified Patankar--Runge--Kutta Methods

Bayesian Integration And Non-Linear Feedback Control In A Full-Body Motor Task

Control of Nonlinear Uncertain Systems by Extended PID

A Multilevel Approach for Stochastic Nonlinear Optimal Control

A Model-Based Reinforcement Learning Approach for PID Design

Improving Computational Cost of Bayesian Optimization for Controller Tuning with a Multi-stage Tuning Framework