Abstract:We study controlled filter stability and its effects on the robustness properties of optimal control policies designed for systems with incorrect priors applied to a true system. Filter stability refers to the correction of an incorrectly initialized filter for a partially observed stochastic dynamical system (controlled or control-free) with increasing measurements. This problem has been studied extensively in the control-free context, and except for the standard machinery for linear Gaussian systems involving the Kalman Filter, few studies exist for the controlled setup. One of the main differences between control-free and controlled partially observed Markov chains is that the filter is always Markovian under the former, whereas under a controlled model the filter process may not be Markovian since the control policy may depend on past measurements in an arbitrary (measurable) fashion. This complicates the dependency structure and therefore results from the control-free literature do not directly apply to the controlled setup. In this paper, we study the filter stability problem for controlled stochastic dynamical systems, and provide sufficient conditions for when a falsely initialized filter merges with the correctly initialized filter over time. These stability results are applied to robust stochastic control problems: under filter stability, we bound the difference in the expected cost incurred for implementing an incorrectly designed control policy compared to an optimal policy. A conclusion is that filter stability leads to stronger robustness results to incorrect priors (compared with setups without controlled filter stability). Furthermore, if the optimum cost is that same for each prior, the cost of mismatch between the true prior and the assumed prior is zero.

Regulating Stability Margins in Symbiotic Control: A Low-Pass Filter Approach

Command Filter-Based I I Adaptive Control for MIMO Uncertain Systems with Input Saturation and Disturbances

Symbiotic Control of Uncertain Dynamical Systems: Harnessing Synergy Between Fixed-Gain Control and Adaptive Learning Architectures

Stability Margins of $\mathcal{L}_1$ Adaptive Controller: Part II

Robust Control for Switched Systems Subject to Input Saturation and Parametric Uncertainties.

Sliding Mode Control with Adaptive Fuzzy Immune Feedback Reaching Law

An Alternative Control Synthesis for Stability Enhancement of Digital-Controlled LCL-filtered Grid-Connected Inverter

Stability Mechanisms for Predictive Safety Filters

Classical Stability Margins by PID Control

Low-Gain Stabilizers for Linear-Convex Optimal Steady-State Control

Safe and Stable Adaptive Control for a Class of Dynamic Systems

Safe and Stable Filter Design Using a Relaxed Compatibitlity Control Barrier -- Lyapunov Condition

Adaptive PI Control Based Stability Margin Configuration of Aircraft Control Systems with Unknown System Parameters and Time Delay

Robust adaptive control of uncertain nonlinear systems with unmodeled dynamics using command filter

Global Output-Feedback Control by Exploiting High-Gain Dynamic-Compensation Mechanisms

Robustness to Incorrect Priors and Controlled Filter Stability in Partially Observed Stochastic Control

Disturbance-observer-based Adaptive Command Filtered Control for Uncertain Nonlinear Systems.

A hybrid systems framework for data-based adaptive control of linear time-varying systems

Stability Margins of Neural Network Controllers

Command Filter Based Adaptive Fuzzy Finite-Time Control for a Class of Uncertain Nonlinear Systems With Hysteresis

New methodologies for adaptive sliding mode control