Likelihood Procedure for Testing Change Point Hypothesis for Multivariate Gaussian Model

JIE CHEN,A. K. GUPTA

DOI: https://doi.org/10.1515/rose.1995.3.3.235

1995-01-01

Random Operators and Stochastic Equations

Abstract:Article Likelihood procedure for testing change point hypothesis for multivariate Gaussian model was published on January 1, 1995 in the journal Random Operators and Stochastic Equations (volume 3, issue 3).

What problem does this paper attempt to address?

Change-point Detection for the Link Function in a Single-Index Model

Qing Yang,Yi Zhang

DOI: https://doi.org/10.1016/j.spl.2022.109468

IF: 0.718

2022-01-01

Statistics & Probability Letters

Abstract:This article investigates the test size and power of a weighted-residual-based cumulative-sum (CUSUM) statistic for detecting the change of the link function in a single-index model. The asymptotic distributions of the CUSUM statistic are derived under the null hypothesis (when there is no change point) and the local alternative hypothesis (when there is a change with the size of order root n), and the importance of the weight function is analyzed further. Numerical performance of the test statistic is investigated using simulated data and is well satisfactory. In particular, as an extension, a single-index heterogeneous autoregressive model is built for the analysis of the realized volatilities of the S&P 500 index from 2016 to 2017, and 5 change points are detected by the proposed detection method.
Change Point Detection for Nonparametric Regression under Strongly Mixing Process

Yang Qing,Li Yu-Ning,Zhang Yi

DOI: https://doi.org/10.1007/s00362-020-01196-y

2020-01-01

Statistical Papers

Abstract:In this article, we consider the estimation of the structural change point in the nonparametric model with dependent observations. We introduce a maximum-CUSUM-estimation procedure, where the CUSUM statistic is constructed based on the sum-of-squares aggregation of the difference of the two Nadaraya-Watson estimates using the observations before and after a specific time point. Under some mild conditions, we prove that the statistic tends to zero almost surely if there is no change, and is larger than a threshold asymptotically almost surely otherwise, which helps us to obtain a threshold-detection strategy. Furthermore, we demonstrate the strong consistency of the change point estimator. In the simulation, we discuss the selection of the bandwidth and the threshold used in the estimation, and show the robustness of our method in the long-memory scenario. We implement our method to the data of Nasdaq 100 index and find that the relation between the realized volatility and the return exhibits several structural changes in 2007–2009.
Empirical Likelihood Ratio Test for the Change-Point Problem

Changliang Zou,Yukun Liu,Peng Qin,Zhaojun Wang

DOI: https://doi.org/10.1016/j.spl.2006.08.003

IF: 0.718

2006-01-01

Statistics & Probability Letters

Abstract:A nonparametric method based on the empirical likelihood is proposed to detect the change-point in the coefficient of linear regression models. The empirical likelihood ratio test statistic is proved to have the same asymptotic null distribution as that with classical parametric likelihood. Under some mild conditions, the maximum empirical likelihood change-point estimator is also shown to be consistent. The simulation results show the sensitivity and robustness of the proposed approach. The method is applied to some real datasets to illustrate the effectiveness.
Testing for Change Points in Partially Linear Models

Li-wen Zhang,Zhong-yi Zhu

DOI: https://doi.org/10.1007/s10255-015-0518-9

2015-01-01

Acta Mathematicae Applicatae Sinica English Series

Abstract:In this paper we provide a method to test the existence of the change points in the nonparametric regression function of partially linear models with conditional heteroscedastic variance. We propose the test statistic and establish its asymptotic properties under some regular conditions. Some simulation studies are given to investigate the performance of the proposed method in finite samples. Finally, the proposed method is applied to a real data for illustration.
Statistical Inference of Covariance Change Points in Gaussian Model

J Chen,AK Gupta

DOI: https://doi.org/10.1080/0233188032000158817

IF: 2.346

2004-01-01

Statistics

Abstract:In this paper, we study the testing and estimation of multiple covariance change points for a sequence of m-dimensional (m > 1) Gaussian random vectors by using the Schwarz information criterion (SIC). The unbiased SIC is also obtained. The asymptotic null distribution of the test statistic is derived. The result is applied to a simulated bivariate normal vector sequence (m = 2), and changes are successfully detected.
Change Point Detection in Length-Biased Lognormal Distribution

Mei Li,Suthakaran Ratnasingam,Yubin Tian,Wei Ning

DOI: https://doi.org/10.1080/03610918.2024.2386561

2024-01-01

Communications in Statistics - Simulation and Computation

Abstract:In this paper, we develop two procedures for identifying the dynamic trends in the parameters of length-biased lognormal distribution based on likelihood ratio and modified information criterion. These methods mainly consider the test of the existence of the change point and provide the maximum likelihood estimation of the change point when the change point exists. In addition, the asymptotic distribution of test statistic based on likelihood ratio is derived as an extreme value distribution, while the asymptotic distribution of test statistic based on modified information criterion is derived as a chi-square distribution. And the consistency of parameter estimation is proved. Simulations are conducted to study the performance of the proposed method in terms of power, coverage probabilities and average sizes of confidence sets. The proposed methods are applied to a real data to illustrate the detecting procedures.
Empirical Likelihood for Change Point Detection in Autoregressive Models

Ramadha D. Piyadi Gamage,Wei Ning

DOI: https://doi.org/10.48550/arXiv.1711.09533

2017-11-27

Abstract:Change point analysis has become an important research topic in many fields of applications. Several research work has been carried out to detect changes and its locations in time series data. In this paper, a nonparametric method based on the empirical likelihood is proposed to detect the structural changes of the parameters in autoregressive (AR) models . Under certain conditions, the asymptotic null distribution of the empirical likelihood ratio test statistic is proved to be the extreme value distribution. Further, the consistency of the test statistic has been proved. Simulations have been carried out to show that the power of the proposed test statistic is significant. The proposed method is applied to real world data set to further illustrate the testing procedure.

Methodology
On Detection of Change Points Using Mean Vectors

Miao Baiqi,Zhao Lincheng,P. R. Krishnaiah

DOI: https://doi.org/10.1007/bf02032914

1993-01-01

Acta Mathematicae Applicatae Sinica

Abstract:In this paper,the authors consider the problem of change points within the framework of model selection and propose a procedure for estimating the locations of change points when the number of change points is known.The strong consistency of this procedure is also established. The problem of detecting change points is discussed within the framework of the simultaneous test procedure.The case where the number of change points is unknown will be discussed in another paper.
Testing and Locating Variance Changepoints with Application to Stock Prices

J Chen,AK Gupta

DOI: https://doi.org/10.2307/2965722

IF: 4.369

1997-01-01

Journal of the American Statistical Association

Abstract:This article explores testing and locating multiple variance changepoints in a sequence of independent Gaussian random variables (assuming known and common mean). This type of problem is very common in applied economics and finance. A binary procedure combined with the Schwarz information criterion (SIC) is used to search all of the possible variance changepoints existing in the sequence. The simulated power of the proposed procedure is compared to that of the CUSUM procedure used by Inclán and Tiao to cope with variance changepoints. The SIC and unbiased SIC for this problem are derived. To obtain the percentage points of the SIC criterion, the asymptotic null distribution of a function of the SIC is obtained, and then the approximate percentage points of the SIC are tabulated. Finally, the results are applied to the weekly stock prices. The unknown but common mean case is also outlined at the end.
Hypothesis Testing in Gaussian Graphical Models: Novel Goodness-of-Fit Tests and Conditional Randomization Tests

Xiaotong Lin,Fangqiao Tian,Dongming Huang

DOI: https://doi.org/10.48550/arXiv.2312.01815

2023-12-04

Abstract:We introduce novel hypothesis testing methods for Gaussian graphical models, whose foundation is an innovative algorithm that generates exchangeable copies from these models. We utilize the exchangeable copies to formulate a goodness-of-fit test, which is valid in both low and high-dimensional settings and flexible in choosing the test statistic. This test exhibits superior power performance, especially in scenarios where the true precision matrix violates the null hypothesis with many small entries. Furthermore, we adapt the sampling algorithm for constructing a new conditional randomization test for the conditional independence between a response $Y$ and a vector of covariates $X$ given some other variables $Z$. Thanks to the model-X framework, this test does not require any modeling assumption about $Y$ and can utilize test statistics from advanced models. It also relaxes the assumptions of conditional randomization tests by allowing the number of unknown parameters of the distribution of $X$ to be much larger than the sample size. For both of our testing procedures, we propose several test statistics and conduct comprehensive simulation studies to demonstrate their superior performance in controlling the Type-I error and achieving high power. The usefulness of our methods is further demonstrated through three real-world applications.

Methodology
A Self-Normalization Test for a Change-Point in the Shape Parameter of a Gamma Distributed Sequence

Tan Changchun,Dong Cuiling,Miao Baiqi,Wu Yuehua

DOI: https://doi.org/10.1016/j.jkss.2012.12.001

2012-01-01

Journal of the Korean Statistical Society

Abstract:In this paper, a parametric change-point problem encountered in analyzing a gamma distributed sequence is considered. We propose a self-normalization based CUSUM type test statistic to detect the presence of a change-point, and obtain its limiting null distribution. The CUSUM-based procedure for detecting the location of this change-point is also given. At the same time, simulation results are provided, which show that our procedures are effective.
A general procedure for change-point detection in multivariate time series

Mamadou Lamine Diop,William Kengne

DOI: https://doi.org/10.1007/s11749-022-00824-z

2022-07-22

Test

Abstract:We consider the change-point detection in a general class of time series models, including multivariate continuous and integer- valued time series. We propose a Wald-type statistic based on the estimator performed by a general contrast function, which can be constructed from the likelihood, a quasi-likelihood, a least squares method, etc. Sufficient conditions are provided to ensure that the test statistic convergences to a well-known distribution under the null hypothesis (of no change) and diverges to infinity under the alternative, which establishes the consistency of the procedure. Some examples of models are detailed to illustrate the scope of application of the proposed change-point detection tool. The procedure is applied to simulated and real data examples for numerical illustration.

statistics & probability
Semiparametric Test for Multiple Change-Points Based on Empirical Likelihood

Shuxia Zhang,Gejun Bao,Boping Tian,Yijun Li

DOI: https://doi.org/10.1080/03610926.2015.1066815

2016-01-01

Abstract:In the dynamic financial market, the change of financial asset prices is always described as a certain random events which result in abrupt changes. The random time when the event occurs is called a change point. As the event happens, in order to mitigate property damage the government should increase the macro-control ability. As a result, we need to find a valid statistical model for change point problem to solve it effectively. This paper proposes a semiparametric model for detecting the change points. According to the research of empirical studies and hypothesis testingwe acquire themaximum likelihood estimators of change points. We use the loglikelihood ratio to test the multiple change points. We obtain some asymptotic results. The estimated change point is more efficient than the non parametric one through simulation experiments. Real data application illustrates the usage of the model.
Limit Theorems in Change-Point Analysis

Lajos Horváth,M. Csorgo

1997-12-29

Abstract:The Likelihood Approach. Nonparametric Methods. Linear Models. Dependent Observations. Appendix. References. Indexes.

Mathematics
A Change-Point Approach to Estimating the Proportion of False Null Hypotheses in Multiple Testing

Anica Kostic,Piotr Fryzlewicz

DOI: https://doi.org/10.48550/arXiv.2309.10017

2024-05-06

Abstract:For estimating the proportion of false null hypotheses in multiple testing, a family of estimators by Storey (2002) is widely used in the applied and statistical literature, with many methods suggested for selecting the parameter $\lambda$. Inspired by change-point concepts, our new approach to the latter problem first approximates the $p$-value plot with a piecewise linear function with a single change-point and then selects the $p$-value at the change-point location as $\lambda$. Simulations show that our method has among the smallest RMSE across various settings, and we extend it to address the estimation in cases of superuniform $p$-values. We provide asymptotic theory for our estimator, relying on the theory of quantile processes. Additionally, we propose an application in the change-point literature and illustrate it using high-dimensional CNV data.

Methodology
Robust Inference for Change Points in High Dimension

Feiyu Jiang,Runmin Wang,Xiaofeng Shao

DOI: https://doi.org/10.1016/j.jmva.2022.105114

IF: 1.387

2023-01-01

Journal of Multivariate Analysis

Abstract:This paper proposes a new test for a change point in the mean of high-dimensional data based on the spatial sign and self-normalization. The test is easy to implement with no tuning parameters, robust to heavy-tailedness and theoretically justified with both fixed-n and sequential asymptotics under both null and alternatives, where n is the sample size. We demonstrate that the fixed-n asymptotics provide a better approximation to the finite sample distribution and thus should be preferred in both testing and testing-based estimation. To estimate the number and locations when multiple change-points are present, we propose to combine the p-value under the fixed-n asymptotics with the seeded binary segmentation (SBS) algorithm. Through numerical experiments, we show that the spatial sign based procedures are robust with respect to the heavy-tailedness and strong coordinate-wise dependence, whereas their non-robust counterparts proposed in Wang et al. (2022)[28] appear to under-perform. A real data example is also provided to illustrate the robustness and broad applicability of the proposed test and its corresponding estimation algorithm.
Testing for the change of the mean-reverting parameter of an autoregressive model with stationary Gaussian noise

Alexandre Brouste,Chunhao Cai,Marius Soltane,Longmin Wang

DOI: https://doi.org/10.1007/s11203-020-09217-1

2020-06-09

Statistical Inference for Stochastic Processes

Abstract:The likelihood ratio test for a change in the mean-reverting parameter of a first order autoregressive model with stationary Gaussian noise is considered. The test statistic converges in distribution to the Gumbel extreme value distribution under the null hypothesis of no change-point for a large class of covariance structures including long-memory processes as the fractional Gaussian noise.
Limit Theorems in Change-Point Problems with Multivariate Long-Range Dependent Observations

Lihong Wang

DOI: https://doi.org/10.1524/stnd.21.3.283.23432

2003-01-01

Statistics & Decisions

Abstract:In this paper we investigate the asymptotic properties of the test statistics for detecting change-points in the mean of a set of multivariate long-range dependent observations. The limit theorems of weighted test statistics and weighted Lp-functionals of tests are developed. The limiting processes of these statistics are structurally different from those encountered in the independent or weakly dependent case.
Detecting Change Points of Covariance Matrices in High Dimensions

Nina Dörnemann,Holger Dette

2024-09-24

Abstract:Testing for change points in sequences of high-dimensional covariance matrices is an important and equally challenging problem in statistical methodology with applications in various fields. Motivated by the observation that even in cases where the ratio between dimension and sample size is as small as $0.05$, tests based on a fixed-dimension asymptotics do not keep their preassigned level, we propose to derive critical values of test statistics using an asymptotic regime where the dimension diverges at the same rate as the sample size. This paper introduces a novel and well-founded statistical methodology for detecting change points in a sequence of high-dimensional covariance matrices. Our approach utilizes a min-type statistic based on a sequential process of likelihood ratio statistics. This is used to construct a test for the hypothesis of the existence of a change point with a corresponding estimator for its location. We provide theoretical guarantees for these inference tools by thoroughly analyzing the asymptotic properties of the sequential process of likelihood ratio statistics in the case where the dimension and sample size converge with the same rate to infinity. In particular, we prove weak convergence towards a Gaussian process under the null hypothesis of no change. To identify the challenging dependency structure between consecutive test statistics, we employ tools from random matrix theory and stochastic processes. Moreover, we show that the new test attains power under a class of alternatives reflecting changes in the bulk of the spectrum, and we prove consistency of the estimator for the change-point location.

Statistics Theory,Probability
A change-point problem for $m$-dependent multivariate random field

Vitalii Makogin,Duc Nguyen

2024-06-27

Abstract:In this paper, we consider a change-point problem for a centered, stationary and $m$-dependent multivariate random field. Under the distribution free assumption, a change-point test using CUSUM statistic is proposed to detect anomalies within a multidimensional random field, controlling the false positive rate as well as the Family-Wise Error in the multiple hypotheses testing context.

Statistics Theory,Probability

Likelihood Procedure for Testing Change Point Hypothesis for Multivariate Gaussian Model

Change-point Detection for the Link Function in a Single-Index Model

Change Point Detection for Nonparametric Regression under Strongly Mixing Process

Empirical Likelihood Ratio Test for the Change-Point Problem

Testing for Change Points in Partially Linear Models

Statistical Inference of Covariance Change Points in Gaussian Model

Change Point Detection in Length-Biased Lognormal Distribution

Empirical Likelihood for Change Point Detection in Autoregressive Models

On Detection of Change Points Using Mean Vectors

Testing and Locating Variance Changepoints with Application to Stock Prices

Hypothesis Testing in Gaussian Graphical Models: Novel Goodness-of-Fit Tests and Conditional Randomization Tests

A Self-Normalization Test for a Change-Point in the Shape Parameter of a Gamma Distributed Sequence

A general procedure for change-point detection in multivariate time series

Semiparametric Test for Multiple Change-Points Based on Empirical Likelihood

Limit Theorems in Change-Point Analysis

A Change-Point Approach to Estimating the Proportion of False Null Hypotheses in Multiple Testing

Robust Inference for Change Points in High Dimension

Testing for the change of the mean-reverting parameter of an autoregressive model with stationary Gaussian noise

Limit Theorems in Change-Point Problems with Multivariate Long-Range Dependent Observations

Detecting Change Points of Covariance Matrices in High Dimensions

A change-point problem for $m$-dependent multivariate random field