Abstract:The detection problem in statistical signal processing can be succinctly formulated: given $m$ (possibly) signal bearing, $n$-dimensional signal-plus-noise snapshot vectors (samples) and $N$ statistically independent $n$-dimensional noise-only snapshot vectors, can one reliably infer the presence of a signal? This problem arises in the context of applications as diverse as radar, sonar, wireless communications, bioinformatics, and machine learning and is the critical first step in the subsequent signal parameter estimation phase. The signal detection problem can be naturally posed in terms of the sample generalized eigenvalues. The sample generalized eigenvalues correspond to the eigenvalues of the matrix formed by “whitening” the signal-plus-noise sample covariance matrix with the noise-only sample covariance matrix. In this paper, we prove a fundamental asymptotic limit of sample generalized eigenvalue-based detection of signals in arbitrarily colored noise when there are relatively few signal bearing and noise-only samples. Specifically, we show why when the (eigen) signal-to-noise ratio (SNR) is below a critical value, that is a simple function of $n$, $m$, and $N$, then reliable signal detection, in an asymptotic sense, is not possible. If, however, the eigen-SNR is above this critical value then a simple, new random matrix theory-based algorithm, which we present here, will reliably detect the signal even at SNRs close to the critical value. Numerical simulations highlight the accuracy of our analytical prediction, permit us to extend our heuristic definition of the effective number of identifiable signals in colored noise and display the dramatic improvement in performance relative to the classical estimator by Zhao et al. We discuss implications of our result for the detection of weak and/or closely spaced signals in sensor array processing, abrupt change detection in sensor networks, and clustering methodologies in machine learning.

An Improved Approach for Detection of the Number of Coherent Signals in Colored Noise

A New Method for Recognition of Independent Noise Sources of Complex System under Strong Noisy Environment

Study of Noise Enhancing Sense Based on Psychophysical Method

Identifying the Number of Factors Using a White Noise Test

Analysis of the performance and sensitivity of eigendecomposition-based detectors

Simple Approach to Determining Parameters of Noncommensurate Sampling for Optimal Pseudo-Noise Code Phase Delay Discrimination

Enhanced RMT estimator for signal number estimation in the presence of colored noise

Source number estimation of coexisting uncorrelated and coherent sources

Fundamental Limit of Sample Generalized Eigenvalue Based Detection of Signals in Noise Using Relatively Few Signal-Bearing and Noise-Only Samples

Source Enumeration Utilizing Adaptive Diagonal Loading and Linear Shrinkage Coefficients

Model-Aided Deep Neural Network for Source Number Detection

Extension of the Local Subspace Method to Enhancement of Speech with Colored Noise

DOA Estimation of Uncorrelated and Coherent Mixed Signals in Colored Noise

Fast Detection of the Number of Signals Based on Ritz Values: A Noise-Power-Aided Approach

Detection of a Signal in Colored Noise: A Random Matrix Theory Based Analysis

Sample eigenvalue based detection of high dimensional signals in white noise using relatively few samples

A Novel Approach of Noise Statistics Estimate Using H ∞ Filter in Target Tracking.

Weighted Hard Combination For Cooperative Spectrum Sensing Under Noise Uncertainty

Strong tracking filtering of nonlinear systems with colored noise

Learning Based Signal Detection for MIMO Systems with Unknown Noise Statistics

Detection of Signals in Colored Noise: Leading Eigenvalue Test for Non-central $F$-matrices