Abstract:Detecting abrupt changes in real-time data streams from scientific simulations presents a challenging task, demanding the deployment of accurate and efficient algorithms. Identifying change points in live data stream involves continuous scrutiny of incoming observations for deviations in their statistical characteristics, particularly in high-volume data scenarios. Maintaining a balance between sudden change detection and minimizing false alarms is vital. Many existing algorithms for this purpose rely on known probability distributions, limiting their feasibility. In this study, we introduce the Kernel-based Cumulative Sum (KCUSUM) algorithm, a non-parametric extension of the traditional Cumulative Sum (CUSUM) method, which has gained prominence for its efficacy in online change point detection under less restrictive conditions. KCUSUM splits itself by comparing incoming samples directly with reference samples and computes a statistic grounded in the Maximum Mean Discrepancy (MMD) non-parametric framework. This approach extends KCUSUM's pertinence to scenarios where only reference samples are available, such as atomic trajectories of proteins in vacuum, facilitating the detection of deviations from the reference sample without prior knowledge of the data's underlying distribution. Furthermore, by harnessing MMD's inherent random-walk structure, we can theoretically analyze KCUSUM's performance across various use cases, including metrics like expected delay and mean runtime to false alarms. Finally, we discuss real-world use cases from scientific simulations such as NWChem CODAR and protein folding data, demonstrating KCUSUM's practical effectiveness in online change point detection.

Kernel-Based Multivariate Nonparametric CUSUM Multi-Chart for Detection of Abrupt Changes

Change Point Detection for Nonparametric Regression under Strongly Mixing Process

CUSUM multi-chart based on nonparametric likelihood approach for detecting unknown abrupt changes and its application for network data

Detection and Diagnosis of Unknown Abrupt Changes Using CUSUM Multi-Chart Schemes

Nonparametric Adaptive CUSUM Chart for Detecting Arbitrary Distributional Changes

CUSUM Multi-Chart for Detecting Unknown Abrupt Changes under Finite Measure Space for Network Observation Sequences

Multivariate Cusum Control Charts Based on data depth For Preliminary Analysis

Asymptotic Optimized CUSUM and EWMA Multi-Charts for Jointly Detecting and Diagnosing Unknown Change

Online Kernel CUSUM for Change-Point Detection

Adaptive Nonparametric Cusum Scheme For Detecting Unknown Shifts In Location

Data-adaptive symmetric CUSUM for sequential change detection

A New Nonparametric Monitoring of Data Streams for Changes in Location and Scale Via Cucconi Statistic

Strong convergence rate of estimators of change point and its application

A wavelet‐based nonparametric CUSUM control chart for autocorrelated processes with applications to network surveillance

Multi-Chart Detection Procedure for Bayesian Quickest Change-Point Detection with Unknown Post-Change Parameters

Detection of Changes in a Random Financial Sequence with a Stable Distribution

A binomial CUSUM chart for detecting large shifts in fraction nonconforming

An Evaluation of Real-time Adaptive Sampling Change Point Detection Algorithm using KCUSUM

Kernel Change Point Detection Based on Convergent Cross Mapping

Multi-chart Schemes for Detecting a Range of Variance Changes

Nonparametric monitoring of multivariate data via KNN learning