Abstract:Data assimilation (DA) combines partial observations with a dynamical model to improve state estimation. Filter-based DA uses only past and present data and is the prerequisite for real-time forecasts. Smoother-based DA exploits both past and future observations. It aims to fill in missing data, provide more accurate estimations, and develop high-quality datasets. However, the standard smoothing procedure requires using all historical state estimations, which is storage-demanding, especially for high-dimensional systems. This paper develops an adaptive-lag online smoother for a large class of complex dynamical systems with strong nonlinear and non-Gaussian features, which has important applications to many real-world problems. The adaptive lag allows the DA to utilize only observations within a nearby window, significantly reducing computational storage. Online lag adjustment is essential for tackling turbulent systems, where temporal autocorrelation varies significantly over time due to intermittency, extreme events, and nonlinearity. Based on the uncertainty reduction in the estimated state, an information criterion is developed to systematically determine the adaptive lag. Notably, the mathematical structure of these systems facilitates the use of closed analytic formulae to calculate the online smoother and the adaptive lag, avoiding empirical tunings as in ensemble-based DA methods. The adaptive online smoother is applied to studying three important scientific problems. First, it helps detect online causal relationships between state variables. Second, its advantage of computational storage is illustrated via Lagrangian DA, a high-dimensional nonlinear problem. Finally, the adaptive smoother advances online parameter estimation with partial observations, emphasizing the role of the observed extreme events in accelerating convergence.

Robust Adaptive Smoothing Algorithm for Nonlinear Stochastic Systems

Robust Adaptive Control of Uncertain Nonlinear Systems in the Presence of Input Saturation and External Disturbance.

Event-triggered Robust Adaptive Control for Discrete Time Uncertain Systems with Unmodelled Dynamics and Disturbances

Robust Adaptive Control of a Class of Uncertain Nonlinear Systems

A Robust Adaptive Image Smoothing Algorithm

Adaptive Image Smoothing Based on Robust Estimation

Robust Adaptive Control for a Class of Stochastic Nonlinear Systems Based on Gradient Algorithms

Robust Adaptive Tracking of Stochastic Nonlinear Systems with Uncertain Noises

A robust fixed-interval smoother for nonlinear systems with non-stationary heavy-tailed state and measurement noises

Modular Design of Adaptive Robust Controller for Strict-Feedback Stochastic Nonlinear Systems

Adaptive Neural Dynamic Surface Control With Prespecified Tracking Accuracy of Uncertain Stochastic Nonstrict-Feedback Systems

Robust Optimal Filtering for Linear Time-Varying Systems with Stochastic Uncertainties

Robust D-Stabilization Of Uncertain Discrete Delay Systems

Smoothing and parameter estimation by soft-adherence to governing equations

Robust Adaptive Control of a Class of Nonlinear Uncertain Systems

Adaptive Robust Least-Squares Smoothing Algorithm

Variable Structure Adaptive Robust Control Algorithm for a Class of Uncertain Nonlinear Systems

Robust adaptive output feedback control to a class of non-triangular stochastic nonlinear systems

Fixed-interval Optimal Kalman Smoother for Systems with Correlated Noises

Maximum Correntropy Rauch–Tung–Striebel Smoother for Nonlinear and Non-Gaussian Systems

An Adaptive Online Smoother with Closed-Form Solutions and Information-Theoretic Lag Selection for Conditional Gaussian Nonlinear Systems