Abstract:Decentralized stochastic control problems with local information involve problems where multiple agents and subsystems which are coupled via dynamics and/or cost are present. Typically, however, the dynamics of such couplings is complex and difficult to precisely model, leading to questions on robustness in control design. Additionally, when such a coupling can be modeled, the problem arrived at is typically challenging and non-convex, due to decentralization of information. In this paper, we develop a robustness framework for optimal decentralized control of interacting agents, where we show that a decentralized control problem with interacting agents can be robustly designed by considering a risk-sensitive version of non-interacting agents/particles. This leads to a tractable robust formulation where we give a bound on the value of the cost function in terms of the risk-sensitive cost function for the non-interacting case plus a term involving the ``strength" of the interaction as measured by relative entropy. We will build on Gaussian measure theory and an associated variational equality. A particular application includes mean-field models consisting of (a generally large number of) interacting agents which are often hard to solve for the case with small or moderate numbers of agents, leading to an interest in effective approximations and robustness. By adapting a risk-sensitivity parameter, we also robustly control a non-symmetrically interacting problem with mean-field cost by one which is symmetric with a risk-sensitive criterion, and in the limit of small interactions, show the stability of optimal solutions to perturbations.

Robust Decentralized Control of Coupled Systems via Risk Sensitive Control of Decoupled or Simple Models with Measure Change

Decentralized Stabilization of Interconnected Stochastic Nonlinear Systems under a Risk-sensitive Cost Criterio

Nonsmooth Decentralized Stabilization for Interconnected Systems Subject to Strongly Coupled Uncertain Interactions.

Robustness Of Non-Linear Stochastic Optimal Control For Quasi-Hamiltonian Systems With Parametric Uncertainty

Controlling Multivariable Systems with Significant Uncertainty

Decentralized Stochastic Linear-Quadratic Optimal Control with Risk Constraint and Partial Observation

Non-concave distributionally robust stochastic control in a discrete time finite horizon setting

Decentralized Robust Control of Uncertain Interconnected Power Systems

Decentralized Stabilization for Nonlinear Similar Composite Systems with Uncertainty

Decentralized robust adaptive controller of modular stochastic control systems

Safe and Stable Control Synthesis for Uncertain System Models via Distributionally Robust Optimization

Robust Decentralized Stabilization of Markovian Jump Large-Scale Systems: A Neighboring Mode Dependent Control Approach

Distributed Robust Control of Linear Multi-Agent Systems with Parameter Uncertainties

Distributed Optimal Control with Recovered Robustness for Uncertain Network Systems: A Complementary Design Approach

Decentralized Robust Control for Nonlinear Large-Scale Systems with Similarity

Robustness of Stochastic Optimal Control to Approximate Diffusion Models under Several Cost Evaluation Criteria

Risk-Aware Finite-Horizon Social Optimal Control of Mean-Field Coupled Linear-Quadratic Subsystems

Decentralized Adaptive Control for a Class of Semi-Parametric Uncertain Multi-Agent Systems

Risk Aware Minimum Principle for Optimal Control of Stochastic Differential Equations

Convexity and monotonicity in nonlinear optimal control under uncertainty