Abstract:Modern technological advances have expanded the scope of applications requiring analysis of large-scale datastreams that comprise multiple indefinitely long time series. There is an acute need for statistical methodologies that perform online inference and continuously revise the model to reflect the current status of the underlying process. In this manuscript, we propose a dynamic statistical inference framework--named dynamic tracking and screening (DTS)--that is not only able to provide accurate estimates of the underlying parameters in a dynamic statistical model, but also capable of rapidly identifying irregular individual streams whose behavioral patterns deviate from the majority. Concretely, by fully exploiting the sequential feature of datastreams, we develop a robust estimation approach under a framework of varying coefficient model. The procedure naturally accommodates unequally-spaced design points and updates the coefficient estimates as new data arrive without the need to store historical data. A data-driven choice of an optimal smoothing parameter is accordingly proposed. Furthermore, we suggest a new multiple testing procedure tailored to the streaming environment. The resulting DTS scheme is able to adapt time-varying structures appropriately, track changes in the underlying models, and hence maintain high accuracy in detecting time periods during which individual streams exhibit irregular behavior. Moreover, we derive rigorous statistical guarantees of the procedure and investigate its finite-sample performance through simulation studies. We demonstrate the proposed methods through a mobile health example to estimate the timings when subjects' sleep and physical activities have unusual influence upon their mood.

Dynamic Penalized Splines for Streaming Data

Statistica Sinica Preprint No : SS-2020-0167 Title Dynamic Penalized Splines for Streaming Data

Adaptive Penalized Splines for Data Smoothing

Estimating Functions and Derivatives Via Adaptive Penalized Splines.

Fast Bivariate Penalized Splines: the Sandwich Smoother

Online Structural Change-Point Detection of High-dimensional Streaming Data via Dynamic Sparse Subspace Learning

Fast Piecewise Polynomial Fitting of Time-Series Data for Streaming Computing

Inference on High-dimensional Single-index Models with Streaming Data

Point Prediction for Streaming Data

Solving Euler equations via two-stage nonparametric penalized splines

Dynamic statistical inference in massive datastreams

Penalized spline estimation of principal components for sparse functional data: rates of convergence

On Knot Placement for Penalized Spline Regression

P-splines with derivative based penalties and tensor product smoothing of unevenly distributed data

Naive Penalized Spline Estimators of Derivatives Achieve Optimal Rates of Convergence

Prediction of dynamical time series using kernel based regression and smooth splines

Sparse and Efficient Estimation for Partial Spline Models with Increasing Dimension

A Trainable Approach to Zero-delay Smoothing Spline Interpolation

Smoothing splines for discontinuous signals

Piecewise Linear Approximation of Streaming Time Series Data with Max-Error Guarantees

Scalable inference in functional linear regression with streaming data