Abstract:We study the change point detection problem for high-dimensional linear regression models. The existing literature mainly focused on the change point estimation with stringent sub-Gaussian assumptions on the errors. In practice, however, there is no prior knowledge about the existence of a change point or the tail structures of errors. To address these issues, in this paper, we propose a novel tail-adaptive approach for simultaneous change point testing and estimation. The method is built on a new loss function which is a weighted combination between the composite quantile and least squared losses, allowing us to borrow information of the possible change points from both the conditional mean and quantiles. For the change point testing, based on the adjusted $L_2$-norm aggregation of a weighted score CUSUM process, we propose a family of individual testing statistics with different weights to account for the unknown tail structures. Combining the individual tests, a tail-adaptive test is further constructed that is powerful for sparse alternatives of regression coefficients' changes under various tail structures. For the change point estimation, a family of argmax-based individual estimators is proposed once a change point is detected. In theory, for both individual and tail-adaptive tests, the bootstrap procedures are proposed to approximate their limiting null distributions. Under some mild conditions, we justify the validity of the new tests in terms of size and power under the high-dimensional setup. The corresponding change point estimators are shown to be rate optimal up to a logarithm factor. Moreover, combined with the wild binary segmentation technique, a new algorithm is proposed to detect multiple change points in a tail-adaptive manner. Extensive numerical results are conducted to illustrate the appealing performance of the proposed method.

Score-Based Change Detection for Gradient-Based Learning Machines

Yongmiao Hong, Oliver Linton, Jiajing Sun, and Meiting Zhu’s Contribution to the Discussion of ‘the Discussion Meeting on Probabilistic and Statistical Aspects of Machine Learning’

Monitoring Machine Learning Models: Online Detection of Relevant Deviations

Change Point Detection with Neural Online Density-Ratio Estimator

Automatic Change-Point Detection in Time Series via Deep Learning

Online Change-Point Detection of Linear Regression Models

Change Point Detection for High-dimensional Linear Models: A General Tail-adaptive Approach

Score-based change point detection via tracking the best of infinitely many experts

A Learning Algorithm for Change Impact Prediction

Assessing the Influence of Sensor-Induced Noise on Machine-Learning-Based Changeover Detection in CNC Machines

Leveraging change point detection to discover natural experiments in data

A Change Dynamic Model for the Online Detection of Gradual Change

Adaptive Bernstein change detector for high-dimensional data streams

Learning Sinkhorn divergences for supervised change point detection

Sequential Changepoint Detection in Neural Networks with Checkpoints

Change Acceleration and Detection

Look Before You Leap! Designing a Human-Centered AI System for Change Risk Assessment

Differential Equation-Based Prediction Model for Early Change Detection in Transient Running Status.

Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Control

Large Deviation Analysis of Score-Based Hypothesis Testing