Abstract:Across many disciplines from neuroscience and genomics to machine learning, atmospheric science and finance, the problems of denoising large data matrices to recover signals obscured by noise, and of estimating the structure of these signals, are of fundamental importance. A key to solving these problems lies in understanding how the singular value structure of a signal is deformed by noise. This question has been thoroughly studied in the well-known spiked matrix model, in which data matrices originate from low-rank signals perturbed by additive noise, in an asymptotic limit where the size of these matrices tends to infinity but the signal rank remains finite. We first show, strikingly, that the singular value structure of large finite matrices (of size $\sim 1000$) with even moderate-rank signals, as low as $10$, is not accurately predicted by the finite-rank theory, thereby limiting the application of this theory to real data. To address these deficiencies, we analytically compute how the singular values and vectors of an arbitrary high-rank signal matrix are deformed by additive noise. We next study an asymptotic limit corresponding to an $\textit{extensive}$ spike model, in which the rank of the hidden signal is proportional to the size of the data matrix, while both tend to infinity. We map out the phase diagram of the singular value structure of the extensive spike model as a joint function of signal strength and rank. We further exploit these analytics to derive optimal rotationally invariant denoisers to recover hidden $\textit{high}$-rank signals from data, as well as optimal invariant estimators of the signal covariance structure. Overall, our results provide fundamental theory governing how high-dimensional signals are deformed by additive noise, together with practical formulas for optimal denoising and covariance estimation.

To spike or not to spike: the whims of the Wonham filter in the strong noise regime

High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models

Filtering for Stochastic Systems Driven by Poisson Processes

Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise

Convergence Analysis of Ensemble Filters for Linear Stochastic Systems with Poisson-Sampled Observations

Finite-time energy-to-peak filtering for Markov jump repeated scalar non-linear systems with packet dropouts

Emergence of spike correlations in periodically forced excitable systems

Dynamical mean-field theory of spiking neuron ensembles: response to a single spike with independent noises

Weak Detection in the Spiked Wigner Model with General Rank

Shifting Spike Times or Adding and Deleting Spikes—How Different Types of Noise Shape Signal Transmission in Neural Populations

Filtering Theory for a Weakly Coloured Noise Process

Goodness-of-Fit Tests and Nonparametric Adaptive Estimation for Spike Train Analysis

Singular Vectors of Sums of Rectangular Random Matrices and Optimal Estimators of High-Rank Signals: The Extensive Spike Model

Spectral Properties of Elementwise-Transformed Spiked Matrices

Impact of Poisson Synaptic Inputs with a Changing Rate on Weak-Signal Processing

Behavior of solutions to the 1D focusing stochastic nonlinear Schrödinger equation with spatially correlated noise

Stochastic Resonance of Ensemble Neurons for Transient Spike Trains: A Wavelet Analysis

From Stochastic Zakharov System to Multiplicative Stochastic Nonlinear Schr{ö}dinger Equation

The space-clamped Hodgkin-Huxley system with random synaptic input: inhibition of spiking by weak noise and analysis with moment equations

The Slow Dynamics of Two-Spike Solutions for the Gray--Scott and Gierer--Meinhardt Systems: Competition and Oscillatory Instabilities

The adaptive interpolation method for proving replica formulas. Applications to the Curie–Weiss and Wigner spike models