Abstract:This paper investigates the distributionally robust filtering of signals generated by state-space models driven by exogenous disturbances with noisy observations in finite and infinite horizon scenarios. The exact joint probability distribution of the disturbances and noise is unknown but assumed to reside within a Wasserstein-2 ambiguity ball centered around a given nominal distribution. We aim to derive a causal estimator that minimizes the worst-case mean squared estimation error among all possible distributions within this ambiguity set. We remove the iid restriction in prior works by permitting arbitrarily time-correlated disturbances and noises. In the finite horizon setting, we reduce this problem to a semi-definite program (SDP), with computational complexity scaling with the time horizon. For infinite horizon settings, we characterize the optimal estimator using Karush-Kuhn-Tucker (KKT) conditions. Although the optimal estimator lacks a rational form, i.e., a finite-dimensional state-space realization, it can be fully described by a finite-dimensional parameter. {Leveraging this parametrization, we propose efficient algorithms that compute the optimal estimator with arbitrary fidelity in the frequency domain.} Moreover, given any finite degree, we provide an efficient convex optimization algorithm that finds the finite-dimensional state-space estimator that best approximates the optimal non-rational filter in ${\cal H}_\infty$ norm. This facilitates the practical implementation of the infinite horizon filter without having to grapple with the ill-scaled SDP from finite time. Finally, numerical simulations demonstrate the effectiveness of our approach in practical scenarios.

Fast Bias-Constrained Optimal FIR Filtering for Time-Invariant State Space Models

Iterative Maximum Likelihood FIR Filter for State-Space Models with Time-Stamped Delayed and Missing Data

A Finite-Horizon Adaptive Kalman Filter for Linear Systems with Unknown Disturbances

Distributionally Robust Kalman Filtering over Finite and Infinite Horizon

Effective Improvement of Under-Modeling Frequency-Domain Kalman Filter

On Kalman-Like Finite Impulse Response Filters

Optimal Linear Filtering for Power Estimation of Slowly-Varying Complex-Valued Signals

Approximate Optimal Filter for Linear Gaussian Time-invariant Systems

An Optimal Adaptive Filtering Algorithm with a Polynomial Prediction Model

Stirling's Interpolation Filtering and Extended Kalman Filtering for Orientation Estimation

Biased Kalman Filter

FIR filters and recursive forms for discrete-time state-space models

Discrete Time $q$-Lag Maximum Likelihood FIR Smoothing and Iterative Recursive Algorithm

A Novel Real-Time Filtering Method to General Nonlinear Filtering Problem Without Memory

Extended fractional singular kalman filter

Outlier-Insensitive Kalman Filtering: Theory and Applications

Data-driven Optimal Filtering for Linear Systems with Unknown Noise Covariances

A Novel Adaptive Kalman Filter With Inaccurate Process and Measurement Noise Covariance Matrices

Synthesis of quasi-optimal fast filters by the least square criterion

Variational-Based Nonlinear Bayesian Filtering with Biased Observations