Abstract:Time series analysis by state-space models is widely used in forecasting and extracting unobservable components like level, slope, and seasonality, along with explanatory variables. However, their reliance on traditional Kalman filtering frequently hampers their effectiveness, primarily due to Gaussian assumptions and the absence of efficient subset selection methods to accommodate the multitude of potential explanatory variables in today's big-data applications. Our research introduces the State Space Learning (SSL), a novel framework and paradigm that leverages the capabilities of statistical learning to construct a comprehensive framework for time series modeling and forecasting. By utilizing a regularized high-dimensional regression framework, our approach jointly extracts typical time series unobservable components, detects and addresses outliers, and selects the influence of exogenous variables within a high-dimensional space in polynomial time and global optimality guarantees. Through a controlled numerical experiment, we demonstrate the superiority of our approach in terms of subset selection of explanatory variables accuracy compared to relevant benchmarks. We also present an intuitive forecasting scheme and showcase superior performances relative to traditional time series models using a dataset of 48,000 monthly time series from the M4 competition. We extend the applicability of our approach to reformulate any linear state space formulation featuring time-varying coefficients into high-dimensional regularized regressions, expanding the impact of our research to other engineering applications beyond time series analysis. Finally, our proposed methodology is implemented within the Julia open-source package, ``StateSpaceLearning.jl".

State Space Reconstruction from Noisy Nonlinear Time Series: an Autoencoder-Based Approach.

Phase Space Reconstruction of Nonlinear Time Series Based on Kernel Method

Time series anomaly detection with reconstruction-based state-space models

Deep Neural Network-Embedded Stochastic Nonlinear State-Space Models and Their Applications to Process Monitoring

Nonuniform State Space Reconstruction for Multivariate Chaotic Time Series

NEURAL ORDINARY DIFFERENTIAL EQUATIONS FOR TIME SERIES RECONSTRUCTION

Elastographic Image Reconstruction: A Stochastic State Space Approach

A Survey of State Space Reconstruction of Chaotic Time Series Analysis

Research on Noise Reduction of Chaotic Time Series Using Non-linear State Space Projection

An Analytic and Application to State Space Reconstruction about Chaotic Time Series

Time Series Analysis by State Space Learning

State Space Reconstruction Based on Higher-Order Statistics

Deep Subspace Encoders for Nonlinear System Identification

Reconstruction of Noise-Driven Nonlinear Dynamic Networks with Some Hidden Nodes

The Audio Signal De-Noising Based on the Arima Model and Kalman Filter

Data-based prediction and causality inference of nonlinear dynamics

Reconstruction of Nonlinear Flows from Noisy Time Series

Local projective method and it's application in the analysis of nonlinear time series

An United Algorithm for State Space Reconstruction

Research on the Phase Space Reconstruction Method of Chaotic Time Series

State estimation and simultaneous unknown input and measurement noise reconstruction