Testing for A Change Point in Linear Regression Models

J Chen

DOI: https://doi.org/10.1080/03610929808832238

1998-01-01

Abstract:In this paper, the Schwarz Information Criterion (SIC) is proposed to locate a change point in the simple linear regression model, as well as in the multiple linear regression model. The method is then applied to a financial data set, and a change point is successfully detected.

What problem does this paper attempt to address?

Change-point Detection for the Link Function in a Single-Index Model

Qing Yang,Yi Zhang

DOI: https://doi.org/10.1016/j.spl.2022.109468

IF: 0.718

2022-01-01

Statistics & Probability Letters

Abstract:This article investigates the test size and power of a weighted-residual-based cumulative-sum (CUSUM) statistic for detecting the change of the link function in a single-index model. The asymptotic distributions of the CUSUM statistic are derived under the null hypothesis (when there is no change point) and the local alternative hypothesis (when there is a change with the size of order root n), and the importance of the weight function is analyzed further. Numerical performance of the test statistic is investigated using simulated data and is well satisfactory. In particular, as an extension, a single-index heterogeneous autoregressive model is built for the analysis of the realized volatilities of the S&P 500 index from 2016 to 2017, and 5 change points are detected by the proposed detection method.
Change Point Detection for Nonparametric Regression under Strongly Mixing Process

Yang Qing,Li Yu-Ning,Zhang Yi

DOI: https://doi.org/10.1007/s00362-020-01196-y

2020-01-01

Statistical Papers

Abstract:In this article, we consider the estimation of the structural change point in the nonparametric model with dependent observations. We introduce a maximum-CUSUM-estimation procedure, where the CUSUM statistic is constructed based on the sum-of-squares aggregation of the difference of the two Nadaraya-Watson estimates using the observations before and after a specific time point. Under some mild conditions, we prove that the statistic tends to zero almost surely if there is no change, and is larger than a threshold asymptotically almost surely otherwise, which helps us to obtain a threshold-detection strategy. Furthermore, we demonstrate the strong consistency of the change point estimator. In the simulation, we discuss the selection of the bandwidth and the threshold used in the estimation, and show the robustness of our method in the long-memory scenario. We implement our method to the data of Nasdaq 100 index and find that the relation between the realized volatility and the return exhibits several structural changes in 2007–2009.
Detecting Change Points in Polynomial Regression Models with an Application to Cable Data Sets

Yin-cai Tang,He-liang Fei

DOI: https://doi.org/10.1007/s10255-004-0191-x

2004-01-01

Acta Mathematicae Applicatae Sinica

Abstract:In this paper, the Schwarz Information Criterion (SIC) is used to detect the change points in polynomial regression models. Switching quadratic regression models with same amount of model deviation and switching polynomial regression models with different amount of model deviation for different segments of regression are considered. The number of separate regimes and their corresponding regression orders are assume to be known. The method is then applied to cable data sets and the change points are successfully detected.
Modified Information Criterion for Linear Regression Change-Point Model with Its Applications

Doaa Basalamah,Khamis K. Said,Wei Ning,Yubin Tian

DOI: https://doi.org/10.1080/03610918.2018.1554109

2019-01-01

Abstract:The linear regression model with normal distribution errors in detecting change in the regression parameters beta 0 and beta 1 has been studied. We propose a testing procedure based on a modified information criterion (MIC) to locate change points, such procedure is the modified version of the Schwartz information criterion (SIC). The asymptotic distribution of the test statistic based on MIC is shown to be chi-square distribution with freedom three. The simulations have been conducted under different changes among parameters of interest with various sample sizes n to investigate the performance of the proposed test. The power comparisons between MIC and SIC have been given. Such procedure applied on a NASA data to illustrate the detecting process.
Detecting Changes in Linear Regression Models with Skew Normal Errors

Khamis K. Said,Wei Ning,Yubin Tian

DOI: https://doi.org/10.1515/rose-2018-0001

2018-01-01

Random Operators and Stochastic Equations

Abstract:In this article, we discuss a linear regression change-point model with skew normal errors. We propose a testing procedure, based on a modified version of the Schwarz information criterion, which is named the modified information criterion (MIC) to locate change points in such a linear regression model. Due to the difficulty of derivation of the asymptotic null distribution of the associated test statistic analytically, the empirical critical values at different significance levels are approximated through simulations. Simulations have also been conducted under different changes among parameters of interest with various sample sizes to investigate the performance of the proposed test. Such a procedure has been applied on a NASA data to illustrate the detecting process.
Information Approach for the Change-Point Detection in the Skew Normal Distribution and Its Applications

Grace Ngunkeng,Wei Ning

DOI: https://doi.org/10.1080/07474946.2014.961845

2014-10-02

Sequential Analysis

Abstract:The skew normal distribution is an extension of the normal distribution allowing for the presence of skewness. Such a distribution can model skewed data in many applied fields such as finance, economics and medical research. The skew distribution family has been studied extensively since it was introduced by Azzalini (1985) for the first time. However, few works have been done on the change-point problem for this distribution family. In this article, we will propose an information approach method based on the Schwarz information criterion (SIC) to detect changes in the parameters of a skew normal distribution. Performance of the proposed test is investigated through simulations under different changes among parameters and various sample sizes. We successfully apply the method to two Latin American emerging market data sets to detect multiple changes.
Testing and Locating Variance Changepoints with Application to Stock Prices

J Chen,AK Gupta

DOI: https://doi.org/10.2307/2965722

IF: 4.369

1997-01-01

Journal of the American Statistical Association

Abstract:This article explores testing and locating multiple variance changepoints in a sequence of independent Gaussian random variables (assuming known and common mean). This type of problem is very common in applied economics and finance. A binary procedure combined with the Schwarz information criterion (SIC) is used to search all of the possible variance changepoints existing in the sequence. The simulated power of the proposed procedure is compared to that of the CUSUM procedure used by Inclán and Tiao to cope with variance changepoints. The SIC and unbiased SIC for this problem are derived. To obtain the percentage points of the SIC criterion, the asymptotic null distribution of a function of the SIC is obtained, and then the approximate percentage points of the SIC are tabulated. Finally, the results are applied to the weekly stock prices. The unknown but common mean case is also outlined at the end.
Modified Information Criterion for Testing Changes in Skew Normal Model

Khamis K. Said,Wei Ning,Yubin Tian

DOI: https://doi.org/10.1214/17-bjps388

2019-01-01

Brazilian Journal of Probability and Statistics

Abstract:In this paper, we study the change point problem for the skew normal distribution model from the view of model selection problem. The detection procedure based on the modified information criterion (MIC) for change problem is proposed. Such a procedure has advantage in detecting the changes in early and late stage of a data comparing to the one based on the traditional Schwarz information criterion which is well known as Bayesian information criterion (BIC) by considering the complexity of the models. Due to the difficulty in deriving the analytic asymptotic distribution of the test statistic based on the MIC procedure, the bootstrap simulation is provided to obtain the critical values at the different significance levels. Simulations are conducted to illustrate the comparisons of performance between MIC, BIC and likelihood ratio test (LRT). Such an approach is applied on two stock market data sets to indicate the detection procedure.
Testing for Change Points in Partially Linear Models

Li-wen Zhang,Zhong-yi Zhu

DOI: https://doi.org/10.1007/s10255-015-0518-9

2015-01-01

Acta Mathematicae Applicatae Sinica English Series

Abstract:In this paper we provide a method to test the existence of the change points in the nonparametric regression function of partially linear models with conditional heteroscedastic variance. We propose the test statistic and establish its asymptotic properties under some regular conditions. Some simulation studies are given to investigate the performance of the proposed method in finite samples. Finally, the proposed method is applied to a real data for illustration.
Statistical Inference of Covariance Change Points in Gaussian Model

J Chen,AK Gupta

DOI: https://doi.org/10.1080/0233188032000158817

IF: 2.346

2004-01-01

Statistics

Abstract:In this paper, we study the testing and estimation of multiple covariance change points for a sequence of m-dimensional (m > 1) Gaussian random vectors by using the Schwarz information criterion (SIC). The unbiased SIC is also obtained. The asymptotic null distribution of the test statistic is derived. The result is applied to a simulated bivariate normal vector sequence (m = 2), and changes are successfully detected.
Testing for Change Points in Time Series

Xiaofeng Shao,Xianyang Zhang

DOI: https://doi.org/10.1198/jasa.2010.tm10103

IF: 4.369

2010-01-01

Journal of the American Statistical Association

Abstract:This article considers the CUSUM-based (cumulative sum) test for a change point in a time series. In the case of testing for a mean shift, the traditional Kolmogorov–Smirnov test statistic involves a consistent long-run variance estimator, which is needed to make the limiting null distribution free of nuisance parameters. The commonly used lag-window type long-run variance estimator requires to choose a bandwidth parameter and its selection is a difficult task in practice. The bandwidth that is a fixed function of the sample size (e.g., n1/3, where n is sample size) is not adaptive to the magnitude of the dependence in the series, whereas the data-dependent bandwidth could lead to nonmonotonic power as shown in previous studies. In this article, we propose a self-normalization (SN) based Kolmogorov–Smirnov test, where the formation of the self-normalizer takes the change point alternative into account. The resulting test statistic is asymptotically distribution free and its power is monotonic. Furthermore, we extend the SN-based test to test for a change in other parameters associated with a time series, such as marginal median, autocorrelation at lag one, and spectrum at certain frequency bands. The use of the SN idea thus allows a unified treatment and offers a new perspective to the large literature of change point detection in the time series setting. Monte Carlo simulations are conducted to compare the finite sample performance of the new SN-based test with the traditional Kolmogorov–Smirnov test. Illustrations using real data examples are presented.
Testing for Change Points Due to A Covariate Threshold in Quantile Regression

Liwen Zhang,Huixia Judy Wang,Zhongyi Zhu

DOI: https://doi.org/10.5705/ss.2012.322

IF: 1.4

2014-01-01

Statistica Sinica

Abstract:We develop a new procedure for testing change points due to a covariate threshold in regression quantiles. The proposed test is based on the CUSUM of the subgradient of the quantile objective function and requires fitting the model only under the null hypothesis. The critical values can be obtained by simulating the Gaussian process that characterizes the limiting distribution of the test statistic. The proposed method can be used to detect change points at a single quantile level or across multiple quantiles, and can accommodate both homoscedastic and heteroscedastic errors. Simulation study suggests that the proposed method has higher computational efficiency and comparable power with the existing likelihood-ratio-based method in the finite samples. The performance of the proposed method is further illustrated by the analysis of a blood pressure and body mass index data set.
Modified information Approach for Detecting Change Points in Piecewise Linear Failure Rate Function

Xia Cai,Yubin Tian,Wei Ning

DOI: https://doi.org/10.1016/j.spl.2017.02.005

IF: 0.718

2017-01-01

Statistics & Probability Letters

Abstract:The procedure based on the modified information criterion is proposed to detect the change points in the piecewise linear failure rate function. Consistency of the test is established and the asymptotic null distribution of the test statistic is also derived as the standard chi-square distribution. The performance of the test statistic is studied through the simulations. The proposed method is applied to a real example to illustrate the detecting procedure.
A Novel Approach for Fast Detection of Multiple Change Points in Linear Models

Xiaoping Shi,Yuehua Wu,Baisuo Jin

DOI: https://doi.org/10.48550/arXiv.1101.4185

2011-01-21

Methodology

Abstract:A change point problem occurs in many statistical applications. If there exist change points in a model, it is harmful to make a statistical analysis without any consideration of the existence of the change points and the results derived from such an analysis may be misleading. There are rich literatures on change point detection. Although many methods have been proposed for detecting multiple change points, using these methods to find multiple change points in a large sample seems not feasible. In this article, a connection between multiple change point detection and variable selection through a proper segmentation of data sequence is established, and a novel approach is proposed to tackle multiple change point detection problem via the following two key steps: (1) apply the recent advances in consistent variable selection methods such as SCAD, adaptive LASSO and MCP to detect change points; (2) employ a refine procedure to improve the accuracy of change point estimation. Five algorithms are hence proposed, which can detect change points with much less time and more accuracy compared to those in literature. In addition, an optimal segmentation algorithm based on residual sum of squares is given. Our simulation study shows that the proposed algorithms are computationally efficient with improved change point estimation accuracy. The new approach is readily generalized to detect multiple change points in other models such as generalized linear models and nonparametric models.
Testing for Smooth Structural Changes in Time Series Models via Nonparametric Regression

Bin Chen,Yongmiao Hong

DOI: https://doi.org/10.3982/ECTA7990

IF: 6.1

2012-01-01

Econometrica

Abstract:Checking parameter stability of econometric models is a long-standing problem. Almost all existing structural change tests in econometrics are designed to detect abrupt breaks. Little attention has been paid to smooth structural changes, which may be more realistic in economics. We propose a consistent test for smooth structural changes as well as abrupt structural breaks with known or unknown change points. The idea is to estimate smooth time-varying parameters by local smoothing and compare the fitted values of the restricted constant parameter model and the unrestricted time-varying parameter model. The test is asymptotically pivotal and does not require prior information about the alternative. A simulation study highlights the merits of the proposed test relative to a variety of popular tests for structural changes. In an application, we strongly reject the stability of univariate and multivariate stock return prediction models in the postwar and post-oil-shocks periods.
Empirical Likelihood Ratio Test for the Change-Point Problem

Changliang Zou,Yukun Liu,Peng Qin,Zhaojun Wang

DOI: https://doi.org/10.1016/j.spl.2006.08.003

IF: 0.718

2006-01-01

Statistics & Probability Letters

Abstract:A nonparametric method based on the empirical likelihood is proposed to detect the change-point in the coefficient of linear regression models. The empirical likelihood ratio test statistic is proved to have the same asymptotic null distribution as that with classical parametric likelihood. Under some mild conditions, the maximum empirical likelihood change-point estimator is also shown to be consistent. The simulation results show the sensitivity and robustness of the proposed approach. The method is applied to some real datasets to illustrate the effectiveness.
Semiparametric Test for Multiple Change-Points Based on Empirical Likelihood

Shuxia Zhang,Gejun Bao,Boping Tian,Yijun Li

DOI: https://doi.org/10.1080/03610926.2015.1066815

2016-01-01

Abstract:In the dynamic financial market, the change of financial asset prices is always described as a certain random events which result in abrupt changes. The random time when the event occurs is called a change point. As the event happens, in order to mitigate property damage the government should increase the macro-control ability. As a result, we need to find a valid statistical model for change point problem to solve it effectively. This paper proposes a semiparametric model for detecting the change points. According to the research of empirical studies and hypothesis testingwe acquire themaximum likelihood estimators of change points. We use the loglikelihood ratio to test the multiple change points. We obtain some asymptotic results. The estimated change point is more efficient than the non parametric one through simulation experiments. Real data application illustrates the usage of the model.
Robust Inference for Change Points in High Dimension

Feiyu Jiang,Runmin Wang,Xiaofeng Shao

DOI: https://doi.org/10.1016/j.jmva.2022.105114

IF: 1.387

2023-01-01

Journal of Multivariate Analysis

Abstract:This paper proposes a new test for a change point in the mean of high-dimensional data based on the spatial sign and self-normalization. The test is easy to implement with no tuning parameters, robust to heavy-tailedness and theoretically justified with both fixed-n and sequential asymptotics under both null and alternatives, where n is the sample size. We demonstrate that the fixed-n asymptotics provide a better approximation to the finite sample distribution and thus should be preferred in both testing and testing-based estimation. To estimate the number and locations when multiple change-points are present, we propose to combine the p-value under the fixed-n asymptotics with the seeded binary segmentation (SBS) algorithm. Through numerical experiments, we show that the spatial sign based procedures are robust with respect to the heavy-tailedness and strong coordinate-wise dependence, whereas their non-robust counterparts proposed in Wang et al. (2022)[28] appear to under-perform. A real data example is also provided to illustrate the robustness and broad applicability of the proposed test and its corresponding estimation algorithm.
Estimator of a Change Point in Single Index Models

BaiSuo Jin,CuiLing Dong,ChangChun Tan,BaiQi Miao

DOI: https://doi.org/10.1007/s11425-014-4820-4

2014-01-01

Science China Mathematics

Abstract:This paper considers the problem of change point in single index models. In order to obtain asymptotically valid confidence intervals for the estimation of the change point, the convergence rate and asymptotic distribution of the change point estimate is studied. Some simulation results are presented which show that the numerical performance of our estimator is satisfactory.
NONPARAMETRIC STATISTICAL INFERENCE FOR DISTRIBUTION CHANGE POINT MODEL

谭智平,缪柏其

DOI: https://doi.org/10.3321/j.issn:1000-8134.2001.05.010

2001-01-01

Abstract:Let X be independent observations that come from a stochastic process and are taken on equal-paced t values, where have common continuous distribution F, and have another common continuous distribution F*. τ refers to the change point of this process. Some nonparametric procedures to detect the change point τ are proposed by means of CUSUM and Brownian sheet. Asymptotically strongly consistent estimators of τ are given and the hypothesis test and interval estimation are also discussed.

Testing for A Change Point in Linear Regression Models

Change-point Detection for the Link Function in a Single-Index Model

Change Point Detection for Nonparametric Regression under Strongly Mixing Process

Detecting Change Points in Polynomial Regression Models with an Application to Cable Data Sets

Modified Information Criterion for Linear Regression Change-Point Model with Its Applications

Detecting Changes in Linear Regression Models with Skew Normal Errors

Information Approach for the Change-Point Detection in the Skew Normal Distribution and Its Applications

Testing and Locating Variance Changepoints with Application to Stock Prices

Modified Information Criterion for Testing Changes in Skew Normal Model

Testing for Change Points in Partially Linear Models

Statistical Inference of Covariance Change Points in Gaussian Model

Testing for Change Points in Time Series

Testing for Change Points Due to A Covariate Threshold in Quantile Regression

Modified information Approach for Detecting Change Points in Piecewise Linear Failure Rate Function

A Novel Approach for Fast Detection of Multiple Change Points in Linear Models

Testing for Smooth Structural Changes in Time Series Models via Nonparametric Regression

Empirical Likelihood Ratio Test for the Change-Point Problem

Semiparametric Test for Multiple Change-Points Based on Empirical Likelihood

Robust Inference for Change Points in High Dimension

Estimator of a Change Point in Single Index Models

NONPARAMETRIC STATISTICAL INFERENCE FOR DISTRIBUTION CHANGE POINT MODEL