Abstract:The detection problem in statistical signal processing can be succinctly formulated: given $m$ (possibly) signal bearing, $n$-dimensional signal-plus-noise snapshot vectors (samples) and $N$ statistically independent $n$-dimensional noise-only snapshot vectors, can one reliably infer the presence of a signal? This problem arises in the context of applications as diverse as radar, sonar, wireless communications, bioinformatics, and machine learning and is the critical first step in the subsequent signal parameter estimation phase. The signal detection problem can be naturally posed in terms of the sample generalized eigenvalues. The sample generalized eigenvalues correspond to the eigenvalues of the matrix formed by “whitening” the signal-plus-noise sample covariance matrix with the noise-only sample covariance matrix. In this paper, we prove a fundamental asymptotic limit of sample generalized eigenvalue-based detection of signals in arbitrarily colored noise when there are relatively few signal bearing and noise-only samples. Specifically, we show why when the (eigen) signal-to-noise ratio (SNR) is below a critical value, that is a simple function of $n$, $m$, and $N$, then reliable signal detection, in an asymptotic sense, is not possible. If, however, the eigen-SNR is above this critical value then a simple, new random matrix theory-based algorithm, which we present here, will reliably detect the signal even at SNRs close to the critical value. Numerical simulations highlight the accuracy of our analytical prediction, permit us to extend our heuristic definition of the effective number of identifiable signals in colored noise and display the dramatic improvement in performance relative to the classical estimator by Zhao et al. We discuss implications of our result for the detection of weak and/or closely spaced signals in sensor array processing, abrupt change detection in sensor networks, and clustering methodologies in machine learning.

Source Enumeration with Random Matrix Theory in the Low SNR Regime

A robust source number estimation method based on few snapshots

Source Enumeration using the Distribution of Angles: A Robust and Parameter-Free Approach

Source Enumeration Utilizing Adaptive Diagonal Loading and Linear Shrinkage Coefficients

Doa Estimation By Covariance Matrix Sparse Reconstruction Of Coprime Array

Statistically Robust Estimation of Source Bearing Via Minimizing the Bhattacharyya Distance.

A Bayesian Framework of Non-Synchronous Measurements at Coprime Positions for Sound Source Localization with High Resolution

Source number estimation of coexisting uncorrelated and coherent sources

A High Resolution Bearing Estimation Method Based on Sparse Reconstruction

Source Enumeration via RMT Estimator Based on Linear Shrinkage Estimation of Noise Eigenvalues Using Relatively Few Samples

A Novel Source Number Estimator with Improved Degrees of Freedom

A Novel Source Enumeration Method Based on Sparse Representation

Source Estimation Using Coprime Array: A Sparse Reconstruction Perspective

Fundamental Limit of Sample Generalized Eigenvalue Based Detection of Signals in Noise Using Relatively Few Signal-Bearing and Noise-Only Samples

Real-time Estimation of Source DOAs Using Random Sparse Linear Array

Array Failure Diagnosis Using Sparse Excitation Source Reconstruction: Reliability Against Position of Near Field Observations

One-Bit Recursive Least-Squares Algorithm with Application to Distributed Target Localization

Model-Aided Deep Neural Network for Source Number Detection

Estimation of Sources Number and DOA by Pseudo-Covariance Matrix Constructed from Single Snapshot

Localization of Mixed Far-Field and Near-Field Incoherently Distributed Sources Using Two-Stage RARE Estimator

A Novel Direction-of-Arrival Estimation Algorithm Without Knowing the Source Number