Abstract:Decentralized stochastic control problems with local information involve problems where multiple agents and subsystems which are coupled via dynamics and/or cost are present. Typically, however, the dynamics of such couplings is complex and difficult to precisely model, leading to questions on robustness in control design. Additionally, when such a coupling can be modeled, the problem arrived at is typically challenging and non-convex, due to decentralization of information. In this paper, we develop a robustness framework for optimal decentralized control of interacting agents, where we show that a decentralized control problem with interacting agents can be robustly designed by considering a risk-sensitive version of non-interacting agents/particles. This leads to a tractable robust formulation where we give a bound on the value of the cost function in terms of the risk-sensitive cost function for the non-interacting case plus a term involving the ``strength" of the interaction as measured by relative entropy. We will build on Gaussian measure theory and an associated variational equality. A particular application includes mean-field models consisting of (a generally large number of) interacting agents which are often hard to solve for the case with small or moderate numbers of agents, leading to an interest in effective approximations and robustness. By adapting a risk-sensitivity parameter, we also robustly control a non-symmetrically interacting problem with mean-field cost by one which is symmetric with a risk-sensitive criterion, and in the limit of small interactions, show the stability of optimal solutions to perturbations.

On Decentralized Minimax Control with Nested Subsystems

Decentralized Adaptive Iterative Learning Control for Interconnected Systems with Uncertainties

Decentralized Model Predictive Control of Nonlinear Continuous Systems with Contractive Constraints

Multi-timescale Decentralized Predictive Control Algorithm

Decentralized Control of Two Agents with Nested Accessible Information

Decentralized Composite Suboptimal Control for a Class of Two-Time-scale Interconnected Networks with Unknown Slow Dynamics.

Decentralized Guaranteed Cost Control of Interconnected Systems with Uncertainties: A Learning-Based Optimal Control Strategy

A Novel Self-Learning Optimal Control Approach for Decentralized Guaranteed Cost Control of A Class of Complex Nonlinear Systems

Decentralized leader-following consensus control design for discrete-time multi-agent systems with switching topology

Decentralized robust adaptive controller of modular stochastic control systems

Special Decentralized Control Problems in Discrete-Time Interconnected Systems Composed of Two Subsystems

Adaptive Dynamic Programming for Decentralized Neuro‐control of Nonlinear Systems Subject to Mismatched Interconnections

Decentralized Adaptive Control in Overlapping Interconnected Large Scale Systems

Decentralized Adaptive Optimal Stabilization of Nonlinear Systems with Matched Interconnections

Decentralized Adaptive Consensus Control of Uncertain Nonlinear Systems under Directed Topologies

Decentralized Neurocontroller Design with Critic Learning for Nonlinear-Interconnected Systems

Robust Decentralized Control of Coupled Systems via Risk Sensitive Control of Decoupled or Simple Models with Measure Change

Decentralized Stabilization for a Class of Continuous-Time Nonlinear Interconnected Systems Using Online Learning Optimal Control Approach

Zero-Sum Game-Based Decentralized Optimal Control for Saturated Nonlinear Interconnected Systems via a Data and Event Driven Approach

On Distributed Model Predictive Control for Systems with Decoupled Dynamics

Some Special Decentralized Control Problems in Continuous-Time Interconnected Systems