Abstract:We study the change point detection problem for high-dimensional linear regression models. The existing literature mainly focused on the change point estimation with stringent sub-Gaussian assumptions on the errors. In practice, however, there is no prior knowledge about the existence of a change point or the tail structures of errors. To address these issues, in this paper, we propose a novel tail-adaptive approach for simultaneous change point testing and estimation. The method is built on a new loss function which is a weighted combination between the composite quantile and least squared losses, allowing us to borrow information of the possible change points from both the conditional mean and quantiles. For the change point testing, based on the adjusted $L_2$-norm aggregation of a weighted score CUSUM process, we propose a family of individual testing statistics with different weights to account for the unknown tail structures. Combining the individual tests, a tail-adaptive test is further constructed that is powerful for sparse alternatives of regression coefficients' changes under various tail structures. For the change point estimation, a family of argmax-based individual estimators is proposed once a change point is detected. In theory, for both individual and tail-adaptive tests, the bootstrap procedures are proposed to approximate their limiting null distributions. Under some mild conditions, we justify the validity of the new tests in terms of size and power under the high-dimensional setup. The corresponding change point estimators are shown to be rate optimal up to a logarithm factor. Moreover, combined with the wild binary segmentation technique, a new algorithm is proposed to detect multiple change points in a tail-adaptive manner. Extensive numerical results are conducted to illustrate the appealing performance of the proposed method.

Likelihood Scores for Sparse Signal and Change-Point Detection

Change Point Detection for Nonparametric Regression under Strongly Mixing Process

Optimal Sequential Detection by Sparsity Likelihood

A Composite Likelihood-Based Approach for Change-Point Detection in Spatio-Temporal Processes

Detecting weak changes in dynamic events over networks

Change Point Detection with Neural Online Density-Ratio Estimator

A Novel Detection Scheme with Multiple Observations for Sparse Signal Based on Likelihood Ratio Test with Sparse Estimation

Empirical Likelihood Ratio Test for the Change-Point Problem

Unknown And Arbitrary Sparse Signal Detection Against Background Noise

Higher-criticism for sparse multi-sensor change-point detection

Change Point Detection via Synthetic Signals

Multiple change point detection for high-dimensional data

Change Point Detection for High-dimensional Linear Models: A General Tail-adaptive Approach

Subspace Change-Point Detection: A New Model and Solution.

Optimal Change Point Detection and Localization in Sparse Dynamic Networks

Robust Inference for Change Points in High Dimension

Online Change-Point Detection: a Weighted Sum Approach with Constraint and Application to Dynamic Network Observation

Performance of Unknown and Arbitrary Sparse Signal Detection Using Convex Programming Method with Compressive Measurements.

Change Point Detection in Length-Biased Lognormal Distribution

Distributed Detection of Sparse Stochastic Signals Via Fusion of 1-Bit Local Likelihood Ratios

Detection and inference of changes in high-dimensional linear regression with non-sparse structures