Abstract:Probabilistic control design is founded on the principle that a rational agent attempts to match modelled with an arbitrary desired closed-loop system trajectory density. The framework was originally proposed as a tractable alternative to traditional optimal control design, parametrizing desired behaviour through fictitious transition and policy densities and using the information projection as a proximity measure. In this work we introduce an alternative parametrization of desired closed-loop behaviour and explore alternative proximity measures between densities. It is then illustrated how the associated probabilistic control problems solve into uncertain or probabilistic policies. Our main result is to show that the probabilistic control objectives majorize conventional, stochastic and risk sensitive, optimal control objectives. This observation allows us to identify two probabilistic fixed point iterations that converge to the deterministic optimal control policies establishing an explicit connection between either formulations. Further we demonstrate that the risk sensitive optimal control formulation is also technically equivalent to a Maximum Likelihood estimation problem on a probabilistic graph model where the notion of costs is directly encoded into the model. The associated treatment of the estimation problem is then shown to coincide with the moment projected probabilistic control formulation. That way optimal decision making can be reformulated as an iterative inference problem. Based on these insights we discuss directions for algorithmic development.

Towards optimal control: the probabilistic route in quantum systems

From certainty to chance: probabilistic insights into quantum control

Probabilistic Pathways: New Frontiers in Quantum Ensemble Control

Probability‐weighted Nonlinear Stochastic Optimal Control Strategy of Quasi‐integrable Hamiltonian Systems with Uncertain Parameters

Probabilistic Control for Uncertain Systems

Robustness of Controlled Quantum Dynamics

Binary Quantum Control Optimization with Uncertain Hamiltonians

Robust Optimization for Quantum Reinforcement Learning Control Using Partial Observations

Limits of Optimal Control Yields Achievable with Quantum Controllers

Optimal Control Strategies for Parameter Estimation of Quantum Systems

Introduction to Theoretical and Experimental aspects of Quantum Optimal Control

Subsystem-based Approach to Scalable Quantum Optimal Control

Quantum Pareto Optimal Control

Quantum State Transfer Optimization: Balancing Fidelity and Energy Consumption using Pontryagin Maximum Principle

A quantum approach for optimal control

Adaptive optimal control of entangled qubits

Probabilistic Control and Majorization of Optimal Control

Controlling Quantum Systems in the Presence of an Environment

Quantum Robust Optimal Control for Linear Complex Quantum Systems with Uncertainties