Abstract:Detecting abrupt changes in real-time data streams from scientific simulations presents a challenging task, demanding the deployment of accurate and efficient algorithms. Identifying change points in live data stream involves continuous scrutiny of incoming observations for deviations in their statistical characteristics, particularly in high-volume data scenarios. Maintaining a balance between sudden change detection and minimizing false alarms is vital. Many existing algorithms for this purpose rely on known probability distributions, limiting their feasibility. In this study, we introduce the Kernel-based Cumulative Sum (KCUSUM) algorithm, a non-parametric extension of the traditional Cumulative Sum (CUSUM) method, which has gained prominence for its efficacy in online change point detection under less restrictive conditions. KCUSUM splits itself by comparing incoming samples directly with reference samples and computes a statistic grounded in the Maximum Mean Discrepancy (MMD) non-parametric framework. This approach extends KCUSUM's pertinence to scenarios where only reference samples are available, such as atomic trajectories of proteins in vacuum, facilitating the detection of deviations from the reference sample without prior knowledge of the data's underlying distribution. Furthermore, by harnessing MMD's inherent random-walk structure, we can theoretically analyze KCUSUM's performance across various use cases, including metrics like expected delay and mean runtime to false alarms. Finally, we discuss real-world use cases from scientific simulations such as NWChem CODAR and protein folding data, demonstrating KCUSUM's practical effectiveness in online change point detection.

Cumulative sum estimation for change-points in the mean and variance of independent observations and applications

Change Point Detection for Nonparametric Regression under Strongly Mixing Process

Strong convergence rate of estimators of change point and its application

Strong Consistence of Estimator for the Change Point in Mean

An Estimate of a Change Point in Variance of Measurement Errors and Its Convergence Rate

MIMO EWMA-CUSUM Condition-Based Statistical Process Control in Manufacturing Processes.

Inference on the change point estimator of variance in measurement error models *

Adaptive CUSUM procedures with Markovian mean estimation

The efficiency of CUSUM schemes for monitoring the multivariate coefficient of variation in short runs process

NONPARAMETRIC STATISTICAL INFERENCE FOR DISTRIBUTION CHANGE POINT MODEL

An Evaluation of Real-time Adaptive Sampling Change Point Detection Algorithm using KCUSUM

CUSUM Procedures for Health Care Surveillance.

Design and Implementation of Two Cusum Schemes for Simultaneously Monitoring the Process Mean and Variance with Unknown Parameters

A New Cumulative Sum Quality Control Scheme for Monitoring the Process Mean

A Variance Change Point Estimation Method Based on Intelligent Ensemble Model for Quality Fluctuation Analysis

Convergence of the CUSUM estimation for a mean shift in linear processes with random coefficients

A Self-Normalization Test for a Change-Point in the Shape Parameter of a Gamma Distributed Sequence

Common Change-Point Estimation and Changed Panel Isolation after Sequential Detection in an Exponential Family

A Comparison of Detection Probability of CUSUM Procedures under Increasing Population Sizes

Online Kernel CUSUM for Change-Point Detection

CUSUM multi-chart based on nonparametric likelihood approach for detecting unknown abrupt changes and its application for network data