Abstract:We develop a variational approach to address risk-sensitive optimal control problems with an exponential-of-integral cost functional in a general linear-quadratic-Gaussian (LQG) single-agent setup, offering new insights into such problems. Our analysis leads to the derivation of a nonlinear necessary and sufficient condition of optimality, expressed in terms of martingale processes. Subject to specific conditions, we find an equivalent risk-neutral measure, under which a linear state feedback form can be obtained for the optimal control. It is then shown that the obtained feedback control is consistent with the imposed condition and remains optimal under the original measure. Building upon this development, we (i) propose a variational framework for general LQG risk-sensitive mean-field games (MFGs) and (ii) advance the LQG risk-sensitive MFG theory by incorporating a major agent in the framework. The major agent interacts with a large number of minor agents, and unlike the minor agents, its influence on the system remains significant even with an increasing number of minor agents. We derive the Markovian closed-loop best-response strategies of agents in the limiting case where the number of agents goes to infinity. We establish that the set of obtained best-response strategies yields a Nash equilibrium in the limiting case and an $\varepsilon$-Nash equilibrium in the finite-player case. We conclude the paper by presenting illustrative numerical experiments.

Action Minimizing Stochastic Invariant Measures For A Class Of Lagrangian Systems

Minimal Measures on the Level Sets below Mañé Critical Value

Invariant measures for stochastic 3D Lagrangian-averaged Navier–Stokes equations with infinite delay

Dynamics And Variational Integrators Of Stochastic Hamiltonian Systems

Brief paper: Stochastic minimax control for stabilizing uncertain quasi- integrable Hamiltonian systems

A Variational Principle for Contact Hamiltonian Systems

A Minimax Stochastic Optimal Control for Bounded-Uncertain Systems

A Minimax Optimal Control Strategy for Partially Observable Uncertain Quasi-Hamiltonian Systems

Stochastic Variational Principles for Dissipative Equations with Advected Quantities

Invariant measures for stochastic delay nonlocal lattice dynamical systems

Existence and Monotonicity Property of Minimizers of a Nonconvex Variational Problem with a Second-Order Lagrangian

Lagrangian Descriptors and the Action Integral of Classical Mechanics

Limiting Behavior of Invariant Measures of Stochastic Delay Lattice Systems

Minimal Kullback–Leibler Divergence for Constrained Lévy–Itô Processes

Invariant measures for some dissipative systems from the Jacobi last multiplier

Invariant Measures for the Nonlinear Stochastic Heat Equation with No Drift Term

The Most Probable Transition Paths of Stochastic Dynamical Systems: A Sufficient and Necessary Characterization

Optimal Variational Principle for Backward Stochastic Control Systems Associated with Lévy Processes

Invariant Measures in Generic Dynamical Systems

An action principle for action-dependent Lagrangians: Toward an action principle to non-conservative systems

LQG Risk-Sensitive Single-Agent and Major-Minor Mean Field Game Systems: A Variational Framework