Abstract:We consider here the identification of change-points on large-scale data streams. The objective is to find the most efficient way of combining information across data stream so that detection is possible under the smallest detectable change magnitude. The challenge comes from the sparsity of change-points when only a small fraction of data streams undergo change at any point in time. The most successful approach to the sparsity issue so far has been the application of hard thresholding such that only local scores from data streams exhibiting significant changes are considered and added. However the identification of an optimal threshold is a difficult one. In particular it is unlikely that the same threshold is optimal for different levels of sparsity. We propose here a sparse likelihood score for identifying a sparse signal. The score is a likelihood ratio for testing between the null hypothesis of no change against an alternative hypothesis in which the change-points or signals are barely detectable. By the Neyman-Pearson Lemma this score has maximum detection power at the given alternative. The outcome is that we have a scoring of data streams that is successful in detecting at the boundary of the detectable region of signals and change-points. The likelihood score can be seen as a soft thresholding approach to sparse signal and change-point detection in which local scores that indicate small changes are down-weighted much more than local scores indicating large changes. We are able to show second-order optimality of the sparsity likelihood score in the sense of achieving successful detection at the minimum detectable order of change magnitude as well as at the minimum detection asymptotic constant with respect this order of change.

Unknown And Arbitrary Sparse Signal Detection Against Background Noise

Performance of Unknown and Arbitrary Sparse Signal Detection Using Convex Programming Method with Compressive Measurements.

A Novel Detection Scheme with Multiple Observations for Sparse Signal Based on Likelihood Ratio Test with Sparse Estimation

Detection of unknown and arbitrary sparse signals against noise

Physics Based Sparsity Level Determination for Acoustic Scattered Far-Field Prediction.

Asymptotic Performance of Sparse Signal Detection Using Convex Programming Method

Block Sparse Recovery Via Mixed L 2 / L 1 Minimization

Detection of Sparse Signals in Sensor Networks Via Locally Most Powerful Tests

Asymptotically Optimal Estimation Algorithm for the Sparse Signal with Arbitrary Distributions.

Distributed Sparse Recursive Least-Squares over Networks

Measurement design for detecting sparse signals

Compressive Detection of Stochastic Sparse Signals with Unknown Sparsity Degree.

Power Spectral Density Estimation of Radiated Noise with Sparse Spectral Fitting

I T ] 8 S ep 2 01 3 Sparse Recovery with Coherent Tight Frames via Analysis Dantzig Selector and Analysis LASSO ∗

Bayesian Generalised Likelihood Ratio Tests for Distributed Target Detection in Interference and Noise

On Spectrum Sensing of OFDM Signals at Low SNR: New Detectors and Asymptotic Performance.

Distributed detection of sparse signals in radar networks via locally most powerful test

Likelihood Scores for Sparse Signal and Change-Point Detection

Detection with Target-Incurring Orthogonal Subspace Interference

Signal detection with noisy reference for passive sensing.

Distributed Quantized Detection of Sparse Signals Under Byzantine Attacks