Limit Theorems in Change-Point Analysis

Lajos Horváth,M. Csorgo

1997-12-29

Abstract:The Likelihood Approach. Nonparametric Methods. Linear Models. Dependent Observations. Appendix. References. Indexes.

Mathematics

What problem does this paper attempt to address?

Limit Theorems in Change-Point Problems with Multivariate Long-Range Dependent Observations

Lihong Wang

DOI: https://doi.org/10.1524/stnd.21.3.283.23432

2003-01-01

Statistics & Decisions

Abstract:In this paper we investigate the asymptotic properties of the test statistics for detecting change-points in the mean of a set of multivariate long-range dependent observations. The limit theorems of weighted test statistics and weighted Lp-functionals of tests are developed. The limiting processes of these statistics are structurally different from those encountered in the independent or weakly dependent case.
Change Point Detection for Nonparametric Regression under Strongly Mixing Process

Yang Qing,Li Yu-Ning,Zhang Yi

DOI: https://doi.org/10.1007/s00362-020-01196-y

2020-01-01

Statistical Papers

Abstract:In this article, we consider the estimation of the structural change point in the nonparametric model with dependent observations. We introduce a maximum-CUSUM-estimation procedure, where the CUSUM statistic is constructed based on the sum-of-squares aggregation of the difference of the two Nadaraya-Watson estimates using the observations before and after a specific time point. Under some mild conditions, we prove that the statistic tends to zero almost surely if there is no change, and is larger than a threshold asymptotically almost surely otherwise, which helps us to obtain a threshold-detection strategy. Furthermore, we demonstrate the strong consistency of the change point estimator. In the simulation, we discuss the selection of the bandwidth and the threshold used in the estimation, and show the robustness of our method in the long-memory scenario. We implement our method to the data of Nasdaq 100 index and find that the relation between the realized volatility and the return exhibits several structural changes in 2007–2009.
Change-point Detection for the Link Function in a Single-Index Model

Qing Yang,Yi Zhang

DOI: https://doi.org/10.1016/j.spl.2022.109468

IF: 0.718

2022-01-01

Statistics & Probability Letters

Abstract:This article investigates the test size and power of a weighted-residual-based cumulative-sum (CUSUM) statistic for detecting the change of the link function in a single-index model. The asymptotic distributions of the CUSUM statistic are derived under the null hypothesis (when there is no change point) and the local alternative hypothesis (when there is a change with the size of order root n), and the importance of the weight function is analyzed further. Numerical performance of the test statistic is investigated using simulated data and is well satisfactory. In particular, as an extension, a single-index heterogeneous autoregressive model is built for the analysis of the realized volatilities of the S&P 500 index from 2016 to 2017, and 5 change points are detected by the proposed detection method.
Limit Theorems of Power Variation for Time-Changed Stable Levy Processes

ZHANG Shibin,LIN Zhengyan

2013-01-01

Chinese Annals of Mathematics

Abstract:This paper is concerned with the asymptotic behavior of the realized power variation for time-changed α-stable Levy processes.The authors prove a law of large numbers,which is the uniform convergence in probability of the realized power variation after normalization.The authors also exhibit the central limit theorems of the realized power variation in all the orders except α/2.
Likelihood Procedure for Testing Change Point Hypothesis for Multivariate Gaussian Model

JIE CHEN,A. K. GUPTA

DOI: https://doi.org/10.1515/rose.1995.3.3.235

1995-01-01

Random Operators and Stochastic Equations

Abstract:Article Likelihood procedure for testing change point hypothesis for multivariate Gaussian model was published on January 1, 1995 in the journal Random Operators and Stochastic Equations (volume 3, issue 3).
On estimating the change point in generalized linear models

Hongling Zhou,Kung-Yee Liang

DOI: https://doi.org/10.1214/193940307000000239

2008-05-16

Abstract:Statistical models incorporating change points are common in practice, especially in the area of biomedicine. This approach is appealing in that a specific parameter is introduced to account for the abrupt change in the response variable relating to a particular independent variable of interest. The statistical challenge one encounters is that the likelihood function is not differentiable with respect to this change point parameter. Consequently, the conventional asymptotic properties for the maximum likelihood estimators fail to hold in this situation. In this paper, we propose an estimating procedure for estimating the change point along with other regression coefficients under the generalized linear model framework. We show that the proposed estimators enjoy the conventional asymptotic properties including consistency and normality. Simulation work we conducted suggests that it performs well for the situations considered. We applied the proposed method to a case-control study aimed to examine the relationship between the risk of myocardial infarction and alcohol intake.

Statistics Theory
On Change Point Detection and Estimation

J Chen,AK Gupta

DOI: https://doi.org/10.1081/sac-100105085

2001-01-01

Abstract:Click to increase image sizeClick to decrease image sizeKeywords: Change pointBayes solutionLikelihood-ratio procedureInformation criterionModel selectionCUSUMWavelet transformation Acknowledgments
Retrospective change-point detection and estimation in multivariate linear models

Boris Brodsky,Boris Darkhovsky

DOI: https://doi.org/10.48550/arXiv.1110.5731

2011-10-26

Statistics Theory

Abstract:In this paper the problem of retrospective change-point detection and estimation in multivariate linear models is considered. The lower bounds for the error of change-point estimation are proved in different cases (one change-point: deterministic and stochastic predictors, multiple change-points). A new method for retrospective change-point detection and estimation is proposed and its main performance characteristics (type 1 and type 2 errors, the error of estimation) are studied for dependent observations in situations of deterministic and stochastic predictors and unknown change-points. We prove that this method is asymptotically optimal by the order of convergence of change-point estimates to their true values as the sample size tends to infinity. Results of a simulation study of the main performance characteristics of proposed method in comparison with other well known methods of retrospective change-point detection and estimation are presented.
Linking Frequentist and Bayesian Change-Point Methods

David Ardia,Arnaud Dufays,Carlos Ordás Criado

DOI: https://doi.org/10.1080/07350015.2023.2293166

2024-01-11

Journal of Business and Economic Statistics

Abstract:We show that the two-stage minimum description length (MDL) criterion widely used to estimate linear change-point (CP) models corresponds to the marginal likelihood of a Bayesian model with a specific class of prior distributions. This allows results from the frequentist and Bayesian paradigms to be bridged together. Thanks to this link, one can rely on the consistency of the number and locations of the estimated CPs and the computational efficiency of frequentist methods, and obtain a probability of observing a CP at a given time, compute model posterior probabilities, and select or combine CP methods via Bayesian posteriors. Furthermore, we adapt several CP methods to take advantage of the MDL probabilistic representation. Based on simulated data, we show that the adapted CP methods can improve structural break detection compared to state-of-the-art approaches. Finally, we empirically illustrate the usefulness of combining CP detection methods when dealing with long time series and forecasting.

statistics & probability,social sciences, mathematical methods,economics
Limit Theorems for Dependent Bernoulli Variables with Statistical Inference

Yang Zhang,Lixin Zhang

DOI: https://doi.org/10.1080/03610926.2015.1021015

2017-01-01

Abstract:We consider a class of dependent Bernoulli variables where the conditional success probability is a linear combination of the last few trials and the original success probability. We obtain its limit theorems including the strong law of large numbers, weak invariance principle, and law of the iterated logarithm. We also derive some statistical inference results which make the model applicable. Simulation results are exhibited as well to show that with small sample size the convergence rate is satisfying and the proposed estimators behave well.
Empirical Likelihood for Change Point Detection in Autoregressive Models

Ramadha D. Piyadi Gamage,Wei Ning

DOI: https://doi.org/10.48550/arXiv.1711.09533

2017-11-27

Abstract:Change point analysis has become an important research topic in many fields of applications. Several research work has been carried out to detect changes and its locations in time series data. In this paper, a nonparametric method based on the empirical likelihood is proposed to detect the structural changes of the parameters in autoregressive (AR) models . Under certain conditions, the asymptotic null distribution of the empirical likelihood ratio test statistic is proved to be the extreme value distribution. Further, the consistency of the test statistic has been proved. Simulations have been carried out to show that the power of the proposed test statistic is significant. The proposed method is applied to real world data set to further illustrate the testing procedure.

Methodology
Estimator of a Change Point in Single Index Models

BaiSuo Jin,CuiLing Dong,ChangChun Tan,BaiQi Miao

DOI: https://doi.org/10.1007/s11425-014-4820-4

2014-01-01

Science China Mathematics

Abstract:This paper considers the problem of change point in single index models. In order to obtain asymptotically valid confidence intervals for the estimation of the change point, the convergence rate and asymptotic distribution of the change point estimate is studied. Some simulation results are presented which show that the numerical performance of our estimator is satisfactory.
Epidemic change-point detection in general integer-valued time series

Mamadou Lamine Diop,William Kengne

DOI: https://doi.org/10.1080/02664763.2023.2179567

2023-02-20

Abstract:In this paper, we consider the structural change in a class of discrete valued time series, where the true conditional distribution of the observations is assumed to be unknown. The conditional mean of the process depends on a parameter θ∗ which may change over time. We provide sufficient conditions for the consistency and the asymptotic normality of the Poisson quasi-maximum likelihood estimator (QMLE) of the model. We consider an epidemic change-point detection and propose a test statistic based on the QMLE of the parameter. Under the null hypothesis of a constant parameter (no change), the test statistic converges to a distribution obtained from increments of a Browninan bridge. The test statistic diverges to infinity under the epidemic alternative, which establishes that the proposed procedure is consistent in power. The effectiveness of the proposed procedure is illustrated by simulated and real data examples.
NONPARAMETRIC STATISTICAL INFERENCE FOR DISTRIBUTION CHANGE POINT MODEL

谭智平,缪柏其

DOI: https://doi.org/10.3321/j.issn:1000-8134.2001.05.010

2001-01-01

Abstract:Let X be independent observations that come from a stochastic process and are taken on equal-paced t values, where have common continuous distribution F, and have another common continuous distribution F*. τ refers to the change point of this process. Some nonparametric procedures to detect the change point τ are proposed by means of CUSUM and Brownian sheet. Asymptotically strongly consistent estimators of τ are given and the hypothesis test and interval estimation are also discussed.
Sequential Change Detection Using Adaptive Likelihood Ratio Statistics Jionghua

Huairui Guo,Xuejun Zhu

2005-01-01

Abstract:This paper is to study how to conduct the sequential change point detection only known the possible region of fault magnitudes but unknown the exact fault magnitude, which is a common situation in reality in process change detection problem. It is well known that sequential change detection using log likelihood ratio statistics has the following optimal properties in error probabilities when compared with conventional control chart methods. If the parameter after change is known, by using log likelihood ratio testing, the Type I and Type II error will not be greater than 1/A and B for the given upper detection boundary logA and lower detection boundary logB. However, when the parameters are unknown, these optimal properties will no longer hold when a generalized likelihood ratio statistic is used. In this paper, we propose an adaptive likelihood ratio testing method for the case when some prior information about the parameters is known. We show that, under the process in control, the Type I error will not exceed 1/A, while if the process is out of control, the Type II error will not exceed the boundary of B. The expectation of detection delay is also given.
Change-Point Estimation In Long Memory Nonparametric Models With Applications

Lihong Wang

DOI: https://doi.org/10.1080/03610910701723583

2008-01-01

Communications in Statistics - Simulation and Computation

Abstract:We consider the estimation of a change point or discontinuity in a regression function for random design model with long memory errors. We provide several change-point estimators and investigate the consistency of the estimators. Using the fractional ARIMA process as an example of long memory process, we report a small Monte Carlo experiment to compare the performance of the estimators in finite samples. We finish by applying the method to a climatological data example.
Testing for Change Points in Partially Linear Models

Li-wen Zhang,Zhong-yi Zhu

DOI: https://doi.org/10.1007/s10255-015-0518-9

2015-01-01

Acta Mathematicae Applicatae Sinica English Series

Abstract:In this paper we provide a method to test the existence of the change points in the nonparametric regression function of partially linear models with conditional heteroscedastic variance. We propose the test statistic and establish its asymptotic properties under some regular conditions. Some simulation studies are given to investigate the performance of the proposed method in finite samples. Finally, the proposed method is applied to a real data for illustration.
CHANGE-POINT DETECTION WITH RANK STATISTICS IN LONG-MEMORY TIME-SERIES MODELS

Lihong Wang

DOI: https://doi.org/10.1111/j.1467-842X.2008.00515.x

2008-01-01

Australian & New Zealand Journal of Statistics

Abstract:Wilcoxon-type rank statistics are considered for testing a long-memory time-series model with a common distribution against the alternatives involving a change in the distribution at an unknown time point. The asymptotic properties of the test statistics and the change-point estimators are studied. Finite-sample behaviours are investigated in a small Monte Carlo simulation study. Data examples from hydrology and telecommunications illustrate the method.
A Semiparametric Change-Point Regression Model for Longitudinal Observations

Haipeng Xing,Zhiliang Ying

DOI: https://doi.org/10.1080/01621459.2012.712425

IF: 4.369

2012-01-01

Journal of the American Statistical Association

Abstract:Many longitudinal studies involve relating an outcome process to a set of possibly time-varying covariates, giving rise to the usual regression models for longitudinal data. When the purpose of the study is to investigate the covariate effects when experimental environment undergoes abrupt changes or to locate the periods with different levels of covariate effects, a simple and easy-to-interpret approach is to introduce change-points in regression coefficients. In this connection, we propose a semiparametric change-point regression model, in which the error process (stochastic component) is nonparametric and the baseline mean function (functional part) is completely unspecified, the observation times are allowed to be subject specific, and the number, locations, and magnitudes of change-points are unknown and need to be estimated We further develop an estimation procedure that combines the recent advance in semiparametric analysis based on counting process argument and multiple change-points inference and discuss its large sample properties, including consistency and asymptotic normality, under suitable regularity conditions. Simulation results show that the proposed methods work well under a variety of scenarios. An application to a real dataset is also given.
Change-Point Detection in Functional First-Order Auto-Regressive Models

Algimantas Birbilas,Alfredas Račkauskas

DOI: https://doi.org/10.3390/math12121889

IF: 2.4

2024-06-19

Mathematics

Abstract:A sample of continuous random functions with auto-regressive structures and possible change-point of the means are considered. We present test statistics for the change-point based on a functional of partial sums. To study their asymptotic behavior, we prove functional limit theorems for polygonal line processes in the space of continuous functions. For some situations, we use a block bootstrap procedure to construct the critical region and provide applications. We also study the finite sample behavior via simulations. Eventually, we apply the statistics to a telecommunications data sample.

mathematics

Limit Theorems in Change-Point Analysis

Limit Theorems in Change-Point Problems with Multivariate Long-Range Dependent Observations

Change Point Detection for Nonparametric Regression under Strongly Mixing Process

Change-point Detection for the Link Function in a Single-Index Model

Limit Theorems of Power Variation for Time-Changed Stable Levy Processes

Likelihood Procedure for Testing Change Point Hypothesis for Multivariate Gaussian Model

On estimating the change point in generalized linear models

On Change Point Detection and Estimation

Retrospective change-point detection and estimation in multivariate linear models

Linking Frequentist and Bayesian Change-Point Methods

Limit Theorems for Dependent Bernoulli Variables with Statistical Inference

Empirical Likelihood for Change Point Detection in Autoregressive Models

Estimator of a Change Point in Single Index Models

Epidemic change-point detection in general integer-valued time series

NONPARAMETRIC STATISTICAL INFERENCE FOR DISTRIBUTION CHANGE POINT MODEL

Sequential Change Detection Using Adaptive Likelihood Ratio Statistics Jionghua

Change-Point Estimation In Long Memory Nonparametric Models With Applications

Testing for Change Points in Partially Linear Models

CHANGE-POINT DETECTION WITH RANK STATISTICS IN LONG-MEMORY TIME-SERIES MODELS

A Semiparametric Change-Point Regression Model for Longitudinal Observations

Change-Point Detection in Functional First-Order Auto-Regressive Models