Validity and efficiency of the conformal CUSUM procedure

Vladimir Vovk,Ilia Nouretdinov,Alex Gammerman

2024-12-05

Abstract:In this paper we study the validity and efficiency of a conformal version of the CUSUM procedure for change detection both experimentally and theoretically.

Statistics Theory,Machine Learning

What problem does this paper attempt to address?

Change-point Detection for the Link Function in a Single-Index Model

Qing Yang,Yi Zhang

DOI: https://doi.org/10.1016/j.spl.2022.109468

IF: 0.718

2022-01-01

Statistics & Probability Letters

Abstract:This article investigates the test size and power of a weighted-residual-based cumulative-sum (CUSUM) statistic for detecting the change of the link function in a single-index model. The asymptotic distributions of the CUSUM statistic are derived under the null hypothesis (when there is no change point) and the local alternative hypothesis (when there is a change with the size of order root n), and the importance of the weight function is analyzed further. Numerical performance of the test statistic is investigated using simulated data and is well satisfactory. In particular, as an extension, a single-index heterogeneous autoregressive model is built for the analysis of the realized volatilities of the S&P 500 index from 2016 to 2017, and 5 change points are detected by the proposed detection method.
Change Point Detection for Nonparametric Regression under Strongly Mixing Process

Yang Qing,Li Yu-Ning,Zhang Yi

DOI: https://doi.org/10.1007/s00362-020-01196-y

2020-01-01

Statistical Papers

Abstract:In this article, we consider the estimation of the structural change point in the nonparametric model with dependent observations. We introduce a maximum-CUSUM-estimation procedure, where the CUSUM statistic is constructed based on the sum-of-squares aggregation of the difference of the two Nadaraya-Watson estimates using the observations before and after a specific time point. Under some mild conditions, we prove that the statistic tends to zero almost surely if there is no change, and is larger than a threshold asymptotically almost surely otherwise, which helps us to obtain a threshold-detection strategy. Furthermore, we demonstrate the strong consistency of the change point estimator. In the simulation, we discuss the selection of the bandwidth and the threshold used in the estimation, and show the robustness of our method in the long-memory scenario. We implement our method to the data of Nasdaq 100 index and find that the relation between the realized volatility and the return exhibits several structural changes in 2007–2009.
Online Kernel CUSUM for Change-Point Detection

Song Wei,Yao Xie

2023-11-09

Abstract:We present a computationally efficient online kernel Cumulative Sum (CUSUM) method for change-point detection that utilizes the maximum over a set of kernel statistics to account for the unknown change-point location. Our approach exhibits increased sensitivity to small changes compared to existing kernel-based change-point detection methods, including Scan-B statistic, corresponding to a non-parametric Shewhart chart-type procedure. We provide accurate analytic approximations for two key performance metrics: the Average Run Length (ARL) and Expected Detection Delay (EDD), which enable us to establish an optimal window length to be on the order of the logarithm of ARL to ensure minimal power loss relative to an oracle procedure with infinite memory. Moreover, we introduce a recursive calculation procedure for detection statistics to ensure constant computational and memory complexity, which is essential for online implementation. Through extensive experiments on both simulated and real data, we demonstrate the competitive performance of our method and validate our theoretical results.

Methodology,Statistics Theory,Machine Learning
Optimality of Non-Restarting CUSUM charts

F. Din-Houn Lau,Axel Gandy

DOI: https://doi.org/10.48550/arXiv.1205.1937

2012-05-09

Abstract:We show optimality, in a well-defined sense, using cumulative sum (CUSUM) charts for detecting changes in distributions. We consider a setting with multiple changes between two known distributions. This result advocates the use of non-restarting CUSUM charts with an upper boundary. Typically, after signalling, a CUSUM chart is restarted by setting it to some value below the threshold. A non-restarting CUSUM chart is not reset after signalling; thus is able to signal continuously. Imposing an upper boundary prevents the CUSUM chart rising too high, which facilitates detection in our setting. We discuss, via simulations, how the choice of the upper boundary changes the signals made by the non-restarting CUSUM charts.

Methodology
A series expansion formula of the scale matrix with applications in CUSUM analysis

Jevgenijs Ivanovs,Kazutoshi Yamazaki

DOI: https://doi.org/10.1016/j.spa.2024.104300

IF: 1.43

2024-01-15

Stochastic Processes and their Applications

Abstract:We introduce a new Lévy fluctuation theoretic method to analyze the cumulative sum (CUSUM) procedure in sequential change-point detection. When observations are phase-type distributed and the post-change distribution is given by exponential tilting of its pre-change distribution, the first passage analysis of the CUSUM statistic is reduced to that of a certain Markov additive process. We develop a novel series expansion formula of the scale matrix for Markov additive processes of finite activity, and apply it to derive exact expressions of the average run length, average detection delay, and false alarm probability under the CUSUM procedure.

statistics & probability
Parametric and nonparametric versions of adaptive CUSUM charts for monitoring the location of individual measurements

Zameer Abbas,Nasir Abbas,Hafiz Zafar Nazir,Muhammad Riaz

DOI: https://doi.org/10.1080/00949655.2024.2347419

IF: 1.225

2024-05-07

Journal of Statistical Computation and Simulation

Abstract:Control charts are customarily developed under the assumption of normal quality characteristics to be monitored. However, in many real dataset applications, the normality assumption is not easy to hold. The in-control (IC) robustness of the charting schemes has significant importance for the valid out-of-control (OOC) performance. This article intends to investigate the IC robustness of the unbiased-function-based adaptive cumulative sum (ACUSUM) chart and nonparametric ACUSUM (NPACUSUM) chart against the non-normal process distributions including symmetrical, skewed, and contaminated normal distributions. The OOC run length profiles of the ACUSUM and the proposed NPACUSUM charts for the individual measurements against the non-normal distributions are also a part of this study. The run length profiles of the proposed charting schemes have been computed using the Monte Carlo simulation method. The artificial datasets have been taken from some symmetric and skewed distributions to implement the proposals. An electrical engineering dataset has also been taken for the implementation of the proposal on a real dataset.

statistics & probability,computer science, interdisciplinary applications
Data-adaptive symmetric CUSUM for sequential change detection

Nauman Ahad,Mark A. Davenport,Yao Xie

DOI: https://doi.org/10.1080/07474946.2023.2272908

2024-01-12

Sequential Analysis

Abstract:Detecting change points sequentially in a streaming setting, especially when both the mean and the variance of the signal can change, is often a challenging task. A key difficulty in this context often involves setting an appropriate detection threshold, which for many standard change statistics may need to be tuned depending on the prechange and postchange distributions. This presents a challenge in a sequential change detection setting when a signal switches between multiple distributions. Unfortunately, change point detection schemes that use the log-likelihood ratio, such as cumulative sum (CUSUM) and the generalized log-likelihood ratio (GLR), are quick to react to changes but are not symmetric when both the mean and the variance of the signal change. This makes it difficult to set a single threshold to detect multiple change points sequentially in a streaming setting. We propose a modified version of CUSUM that we call data-adaptive symmetric CUSUM (DAS-CUSUM). The DAS-CUSUM procedure is symmetric for changes between distributions, making it suitable to set a single threshold to detect multiple change points sequentially in a streaming setting. We provide results that relate the expected detection delay and average run length for our proposed procedure when both prechange and postchange distributions are normally distributed. Experiments on simulated and real-world data show the utility of DAS-CUSUM.

statistics & probability
Consistent nonparametric change point detection combining CUSUM and marked empirical processes

Maria Mohr,Natalie Neumeyer

DOI: https://doi.org/10.48550/arXiv.1901.08491

2019-01-25

Abstract:A weakly dependent time series regression model with multivariate covariates and univariate observations is considered, for which we develop a procedure to detect whether the nonparametric conditional mean function is stable in time against change point alternatives. Our proposal is based on a modified CUSUM type test procedure, which uses a sequential marked empirical process of residuals. We show weak convergence of the considered process to a centered Gaussian process under the null hypothesis of no change in the mean function and a stationarity assumption. This requires some sophisticated arguments for sequential empirical processes of weakly dependent variables. As a consequence we obtain convergence of Kolmogorov-Smirnov and Cramér-von Mises type test statistics. The proposed procedure acquires a very simple limiting distribution and nice consistency properties, features from which related tests are lacking. We moreover suggest a bootstrap version of the procedure and discuss its applicability in the case of unstable variances.

Statistics Theory
Testing for changes in the mean or variance of long memory processes

Yun Xia Li,Jian Jun Xu,Li Xin Zhang

DOI: https://doi.org/10.1007/s10114-010-7193-9

2010-01-01

Abstract:In this paper, we study the asymptotic CUSUM tests for detecting changes in the mean or variance of a moving-average process with long memory. When there is no change over [0, T ], the asymptotic distribution of the test statistic is derived, which allows us to find asymptotic critical values. When there is a change, the behavior of the test statistic is discussed. Conditions for the consistency of these tests are also discussed. Based on the asymptotic results, simulation studies of testing for changes in the mean show that the CUSUM test proposed performs well.
Adaptive CUSUM procedures with Markovian mean estimation

Lianjie Shu,Wei Jiang,Zhang Wu

DOI: https://doi.org/10.1016/j.csda.2008.02.024

IF: 2.035

2008-01-01

Computational Statistics & Data Analysis

Abstract:This paper proposes using a Markovian-type mean estimating procedure in the conventional cumulative sum (CUSUM) control scheme to update its reference value in an adaptive way. This generalizes a class of Markovian adaptive CUSUM (ACUSUM) schemes to achieve the aim of providing an overall good performance over a range of future expected but unknown mean shifts. A two-dimensional Markov chain model is developed to analyze the run length performance of the new scheme. A comparison of run length performance of the proposed ACUSUM scheme and other control charts is shown favorable to the former.
Detection and Diagnosis of Unknown Abrupt Changes Using CUSUM Multi-Chart Schemes

Dong Han,Fugee Tsung

DOI: https://doi.org/10.1080/07474940701404765

2007-01-01

Sequential Analysis

Abstract:Abstract A cumulative sum (CUSUM) multi-chart scheme that consists of multiple CUSUM control charts is studied for detecting and diagnosing an unknown abrupt change in a stochastic system on the basis of sequential observations. We prove that the CUSUM multi-chart not only has a high diagnostic capability but also possesses a better detection performance than individual CUSUM charts when the in-control average run length is large. We also present an optimal design of the CUSUM multi-chart and two illustrative examples involving the normal and exponential distributions. Moreover, numerical comparisons of the average run lengths are made via Monte Carlo simulation among the CUSUM, generalized likelihood ratio, exponentially weighted moving average (EWMA), multi-chart, and CUSUM multi-chart. The numerical results indicate that the CUSUM multi-chart has the best performance on the whole among the five schemes in detecting the unknown mean shift.
An CUSUM Test with Observation-Adjusted Control Limits in Change Detection

Fuquan Tang,Dong Han

2023-01-01

Abstract: In this paper, we not only propose an new optimal sequential test of sum of logarithmic likelihood ratio (SLR) but also present the CUSUM sequential test (control chart, stopping time) with the observation-adjusted control limits (CUSUM-OAL) for monitoring quickly and adaptively the change in distribution of a sequential observations. Two limiting relationships between the optimal test and a series of the CUSUM-OAL tests are established. Moreover, we give the estimation of the in-control and the out-of-control average run lengths (ARLs) of the CUSUM-OAL test. The theoretical results are illustrated by numerical simulations in detecting mean shifts of the observations sequence.
Asymptotic Optimized CUSUM and EWMA Multi-Charts for Jointly Detecting and Diagnosing Unknown Change

Gideon Mensah Engmann,Dong Han

DOI: https://doi.org/10.1080/00949655.2021.1966005

IF: 1.225

2022-01-01

Journal of Statistical Computation and Simulation

Abstract:This article not only shows that the CUSUM multi-chart which consists of several CUSUM charts, has the asymptotic optimal performance in jointly detecting and diagnosing the unknown change in a sequence of i.i.d. observations but also provides a design method of optimizing the CUSUM and EWMA multi-charts. The numerical comparisons illustrate that the optimized CUSUM multi-chart has better performance in jointly detecting and diagnosing the mean and variance shifts in i.i.d. normal observations than that of the optimized EWMA multi-chart. A real example for engineering surveillance using the electric power generation data was used to demonstrate the practicality of the schemes.
An Evaluation of Real-time Adaptive Sampling Change Point Detection Algorithm using KCUSUM

Vijayalakshmi Saravanan,Perry Siehien,Shinjae Yoo,Hubertus Van Dam,Thomas Flynn,Christopher Kelly,Khaled Z Ibrahim

2024-04-05

Abstract:Detecting abrupt changes in real-time data streams from scientific simulations presents a challenging task, demanding the deployment of accurate and efficient algorithms. Identifying change points in live data stream involves continuous scrutiny of incoming observations for deviations in their statistical characteristics, particularly in high-volume data scenarios. Maintaining a balance between sudden change detection and minimizing false alarms is vital. Many existing algorithms for this purpose rely on known probability distributions, limiting their feasibility. In this study, we introduce the Kernel-based Cumulative Sum (KCUSUM) algorithm, a non-parametric extension of the traditional Cumulative Sum (CUSUM) method, which has gained prominence for its efficacy in online change point detection under less restrictive conditions. KCUSUM splits itself by comparing incoming samples directly with reference samples and computes a statistic grounded in the Maximum Mean Discrepancy (MMD) non-parametric framework. This approach extends KCUSUM's pertinence to scenarios where only reference samples are available, such as atomic trajectories of proteins in vacuum, facilitating the detection of deviations from the reference sample without prior knowledge of the data's underlying distribution. Furthermore, by harnessing MMD's inherent random-walk structure, we can theoretically analyze KCUSUM's performance across various use cases, including metrics like expected delay and mean runtime to false alarms. Finally, we discuss real-world use cases from scientific simulations such as NWChem CODAR and protein folding data, demonstrating KCUSUM's practical effectiveness in online change point detection.

Machine Learning
Multi-Scale CUSUM Tests for Time Dependent Spherical Random Fields

Alessia Caponera,Domenico Marinucci,Anna Vidotto

2024-07-31

Abstract:This paper investigates the asymptotic behavior of structural break tests in the harmonic domain for time dependent spherical random fields. In particular, we prove a functional central limit theorem result for the fluctuations over time of the sample spherical harmonic coefficients, under the null of isotropy and stationarity; furthermore, we prove consistency of the corresponding CUSUM test, under a broad range of alternatives, including deterministic trend, abrupt change, and a nontrivial power alternative. Our results are then applied to NCEP data on global temperature: our estimates suggest that Climate Change does not simply affect global average temperatures, but also the nature of spatial fluctuations at different scales.

Statistics Theory,Methodology
A Self-Normalization Test for a Change-Point in the Shape Parameter of a Gamma Distributed Sequence

Tan Changchun,Dong Cuiling,Miao Baiqi,Wu Yuehua

DOI: https://doi.org/10.1016/j.jkss.2012.12.001

2012-01-01

Journal of the Korean Statistical Society

Abstract:In this paper, a parametric change-point problem encountered in analyzing a gamma distributed sequence is considered. We propose a self-normalization based CUSUM type test statistic to detect the presence of a change-point, and obtain its limiting null distribution. The CUSUM-based procedure for detecting the location of this change-point is also given. At the same time, simulation results are provided, which show that our procedures are effective.
A Comparison of Detection Probability of CUSUM Procedures under Increasing Population Sizes

Honghao Zhao,Lianjie Shu,Wei Jiang,Kwok-Leung Tsui

DOI: https://doi.org/10.1109/iCBEB.2012.22

2012-01-01

Abstract:Detecting increases of incidence rate of an adverse health event is critical to health surveillance. Motivated by successful applications in industry quality control and productivity improvement, various cumulative sum (CUSUM) procedures have been developed to monitor rate changes of health events when population size changes over time. Instead of using average run length (ARL) as the performance criteria, this paper provides a thorough statistical comparison of CUSUM-type procedures in the health care context based on probability of alarm (PA) evaluation metrics. We show that different methods may favor different parameter settings depending on the corresponding designs.
Non-Restarting CUSUM charts and Control of the False Discovery Rate

Axel Gandy,F. Din-Houn Lau

DOI: https://doi.org/10.1093/biomet/ass066

2012-04-19

Abstract:Cumulative sum (CUSUM) charts are typically used to detect changes in a stream of observations e.g. shifts in the mean. Usually, after signalling, the chart is restarted by setting it to some value below the signalling threshold. We propose a non-restarting CUSUM chart which is able to detect periods during which the stream is out of control. Further, we advocate an upper boundary to prevent the CUSUM chart rising too high, which helps detecting a change back into control. We present a novel algorithm to control the false discovery rate (FDR) pointwise in time when considering CUSUM charts based on multiple streams of data. We prove that the FDR is controlled under two definitions of a false discovery simultaneously. Simulations reveal the difference in FDR control when using these two definitions and other desirable definitions of a false discovery.

Methodology
BACKWARD CUSUM FOR TESTING AND MONITORING STRUCTURAL CHANGE WITH AN APPLICATION TO COVID-19 PANDEMIC DATA

Sven Otto,Jörg Breitung

DOI: https://doi.org/10.1017/s0266466622000159

IF: 1.968

2022-04-12

Econometric Theory

Abstract:It is well known that the conventional cumulative sum (CUSUM) test suffers from low power and large detection delay. In order to improve the power of the test, we propose two alternative statistics. The backward CUSUM detector considers the recursive residuals in reverse chronological order, whereas the stacked backward CUSUM detector sequentially cumulates a triangular array of backwardly cumulated residuals. A multivariate invariance principle for partial sums of recursive residuals is given, and the limiting distributions of the test statistics are derived under local alternatives. In the retrospective context, the local power of the tests is shown to be substantially higher than that of the conventional CUSUM test if a break occurs in the middle or at the end of the sample. When applied to monitoring schemes, the detection delay of the stacked backward CUSUM is found to be much shorter than that of the conventional monitoring CUSUM procedure. Furthermore, we propose an estimator of the break date based on the backward CUSUM detector and show that in monitoring exercises this estimator tends to outperform the usual maximum likelihood estimator. Finally, an application of the methodology to COVID-19 data is presented.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications,statistics & probability
CUSUM Procedures for Health Care Surveillance.

Wei Jiang,Lianjie Shu,Honghao Zhao,Kwok-Leung Tsui

DOI: https://doi.org/10.1002/qre.1444

2013-01-01

Quality and Reliability Engineering International

Abstract:Detecting increases of incidence rate of an adverse health event is critical to health surveillance. Motivated by successful applications in industry quality control and productivity improvement, various cumulative sum (CUSUM) procedures have been developed to monitor rate changes of health events when population size changes over time. Average run length, which is commonly used in quality control, may be inappropriate in some situations when comparing control chart performance in health surveillance applications. This paper provides a thorough statistical comparison of CUSUM-type procedures in the health care context based on different evaluation metrics. We show that different measures may favor different surveillance methods depending on the corresponding design criteria. We thus recommend a probabilistic measure as the criterion for design and evaluation of CUSUM control charts in health care surveillance. Copyright (c) 2012 John Wiley & Sons, Ltd.

Validity and efficiency of the conformal CUSUM procedure

Change-point Detection for the Link Function in a Single-Index Model

Change Point Detection for Nonparametric Regression under Strongly Mixing Process

Online Kernel CUSUM for Change-Point Detection

Optimality of Non-Restarting CUSUM charts

A series expansion formula of the scale matrix with applications in CUSUM analysis

Parametric and nonparametric versions of adaptive CUSUM charts for monitoring the location of individual measurements

Data-adaptive symmetric CUSUM for sequential change detection

Consistent nonparametric change point detection combining CUSUM and marked empirical processes

Testing for changes in the mean or variance of long memory processes

Adaptive CUSUM procedures with Markovian mean estimation

Detection and Diagnosis of Unknown Abrupt Changes Using CUSUM Multi-Chart Schemes

An CUSUM Test with Observation-Adjusted Control Limits in Change Detection

Asymptotic Optimized CUSUM and EWMA Multi-Charts for Jointly Detecting and Diagnosing Unknown Change

An Evaluation of Real-time Adaptive Sampling Change Point Detection Algorithm using KCUSUM

Multi-Scale CUSUM Tests for Time Dependent Spherical Random Fields

A Self-Normalization Test for a Change-Point in the Shape Parameter of a Gamma Distributed Sequence

A Comparison of Detection Probability of CUSUM Procedures under Increasing Population Sizes

Non-Restarting CUSUM charts and Control of the False Discovery Rate

BACKWARD CUSUM FOR TESTING AND MONITORING STRUCTURAL CHANGE WITH AN APPLICATION TO COVID-19 PANDEMIC DATA

CUSUM Procedures for Health Care Surveillance.