Abstract:We consider the infinite-horizon LQR control problem. Motivated by competitive analysis in online learning, as a criterion for controller design we introduce the dynamic regret, defined as the difference between the LQR cost of a causal controller (that has only access to past disturbances) and the LQR cost of the \emph{unique} clairvoyant one (that has also access to future disturbances) that is known to dominate all other controllers. The regret itself is a function of the disturbances, and we propose to find a causal controller that minimizes the worst-case regret over all bounded energy disturbances. The resulting controller has the interpretation of guaranteeing the smallest regret compared to the best non-causal controller that can see the future. We derive explicit formulas for the optimal regret and for the regret-optimal controller for the state-space setting. These explicit solutions are obtained by showing that the regret-optimal control problem can be reduced to a Nehari extension problem that can be solved explicitly. The regret-optimal controller is shown to be linear and can be expressed as the sum of the classical $H_2$ state-feedback law and an $n$-th order controller ($n$ is the state dimension), and its construction simply requires a solution to the standard LQR Riccati equation and two Lyapunov equations. Simulations over a range of plants demonstrate that the regret-optimal controller interpolates nicely between the $H_2$ and the $H_\infty$ optimal controllers, and generally has $H_2$ and $H_\infty$ costs that are simultaneously close to their optimal values. The regret-optimal controller thus presents itself as a viable option for control systems design.

Revisit Of Lqg Control-A New Paradigm With Recovered Robustness

Lqg Benchmarking For Economic Control Performance

Improved LQG Benchmark for Control Performance Assessment on ARMAX Model Process

Robust LQ optimal controller designing for refining process

Modified LQG/LTR Control Methodology in Active Structural Control

Robustness Bound of LQ Guaranteed Cost Control Systems for Parameter Uncertainty

Revisiting LQR Control from the Perspective of Receding-Horizon Policy Gradient

A Natural Approach to High Performance Robust Control: Another Look at Youla Parameterization

Learning Algorithm for LQG Model with Constrained Control

Robust Reinforcement Learning for Risk-Sensitive Linear Quadratic Gaussian Control

Analysis of the Optimization Landscape of Linear Quadratic Gaussian (LQG) Control

LQR approach to robust stabilization of state space systems with matched uncertainties

Learning Robust Data-based LQG Controllers from Noisy Data

ACTIVE STRUCTURAL CONTROL BASED ON LQG/LTR METHOD

Regret-Optimal LQR Control

Design of State Space Linear Quadratic Tracking Control Using GA Optimization for Batch Processes with Partial Actuator Failure

A New Perspective on ℋ2 Controller Reduction

Observation-based Optimal Control Law Learning with LQR Reconstruction

A Gradient Descent Approach to Optimal Coherent Quantum LQG Controller Design

Jitter-Robust LQG Control and Real-Time Scheduling Co-Design

Interactive Control Paradigm-Based Robust Lateral Stability Controller Design for Autonomous Automobile Path Tracking With Uncertain Disturbance: A Dynamic Game Approach.