Abstract:Modern technological advances have expanded the scope of applications requiring analysis of large-scale datastreams that comprise multiple indefinitely long time series. There is an acute need for statistical methodologies that perform online inference and continuously revise the model to reflect the current status of the underlying process. In this manuscript, we propose a dynamic statistical inference framework--named dynamic tracking and screening (DTS)--that is not only able to provide accurate estimates of the underlying parameters in a dynamic statistical model, but also capable of rapidly identifying irregular individual streams whose behavioral patterns deviate from the majority. Concretely, by fully exploiting the sequential feature of datastreams, we develop a robust estimation approach under a framework of varying coefficient model. The procedure naturally accommodates unequally-spaced design points and updates the coefficient estimates as new data arrive without the need to store historical data. A data-driven choice of an optimal smoothing parameter is accordingly proposed. Furthermore, we suggest a new multiple testing procedure tailored to the streaming environment. The resulting DTS scheme is able to adapt time-varying structures appropriately, track changes in the underlying models, and hence maintain high accuracy in detecting time periods during which individual streams exhibit irregular behavior. Moreover, we derive rigorous statistical guarantees of the procedure and investigate its finite-sample performance through simulation studies. We demonstrate the proposed methods through a mobile health example to estimate the timings when subjects' sleep and physical activities have unusual influence upon their mood.

Transfer estimation of evolving class priors in data stream classification

New algorithm for online classification over data streams based on max-frequency patterns

Discovering an Evolutionary Classifier over a High-speed Nonstatic Stream

Non-stationary data sequence classification using online class priors estimation

Online Boosting Adaptive Learning under Concept Drift for Multistream Classification

Anticipative Bayesian classification for data streams with verification latency

On Demand Classification of Data Streams

A Framework for On-Demand Classification of Evolving Data Streams

A Low-Granularity Classifier for Data Streams with Concept Drifts and Biased Class Distribution

Online learning for streaming data classification in nonstationary environments

Clustering-based Active Learning Classification towards Data Stream

Distribution Inference from Early-Stage Stationary Data Streams by Transfer Learning

Online Active Learning for Drifting Data Streams

Feature Selection in the Data Stream Based on Incremental Markov Boundary Learning

Imbalanced Data Stream Classification using Dynamic Ensemble Selection

Dynamic statistical inference in massive datastreams

Prototype-Based Learning On Concept-Drifting Data Streams

Adaptive regularized ensemble for evolving data stream classification

Intensive Class Imbalance Learning in Drifting Data Streams

Handling New Class in Online Label Shift

An Ensemble Classifier Algorithm for Mining Data Streams Based on Concept Drift