Abstract:Given a sequence of $d \times d$ symmetric matrices $\{\mathbf{W}_i\}_{i=1}^n$, and a margin $\Delta > 0$, we investigate whether it is possible to find signs $(\epsilon_1, \dots, \epsilon_n) \in \{\pm 1\}^n$ such that the operator norm of the signed sum satisfies $\|\sum_{i=1}^n \epsilon_i \mathbf{W}_i\|_\mathrm{op} \leq \Delta$. Kunisky and Zhang (2023) recently introduced a random version of this problem, where the matrices $\{\mathbf{W}_i\}_{i=1}^n$ are drawn from the Gaussian orthogonal ensemble. This model can be seen as a random variant of the celebrated Matrix Spencer conjecture and as a matrix-valued analog of the symmetric binary perceptron in statistical physics. In this work, we establish a satisfiability transition in this problem as $n, d \to \infty$ with $n / d^2 \to \tau > 0$. Our contributions are twofold. First, we prove that the expected number of solutions with margin $\Delta=\kappa \sqrt{n}$ has a sharp threshold at a critical $\tau_1(\kappa)$: for $\tau < \tau_1(\kappa)$ the problem is typically unsatisfiable, while for $\tau > \tau_1(\kappa)$ the average number of solutions becomes exponentially large. Second, combining a second-moment method with recent results from Altschuler (2023) on margin concentration in perceptron-type problems, we identify a second threshold $\tau_2(\kappa)$, such that for $\tau>\tau_2(\kappa)$ the problem admits solutions with high probability. In particular, we establish for the first time that a system of $n = \Theta(d^2)$ Gaussian random matrices can be balanced so that the spectrum of the resulting matrix macroscopically shrinks compared to the typical semicircle law. Our proofs rely on deriving concentration inequalities and large deviation properties for the law of correlated Gaussian matrices under spectral norm constraints, extending results in the literature and offering insights of independent interest.

The singularity probability of a random symmetric matrix is exponentially small

The least singular value of a random symmetric matrix

Tight Asymptotic of Probability of singularity of n x n Random Matrix with Uniform Distributed \pm 1 Entries

Small ball probability for multiple singular values of symmetric random matrices

On the singularity probability of random circulant Bernoulli matrices

A Note on the Convergence Rate of the Spectral Distributions of Large Random Matrices

A Conjecture on C-matrices of Cluster Algebras

Behavior of the minimum singular value of a random Vandermonde matrix

The smallest singular value for rectangular random matrices with Lévy entries

The smallest singular value of inhomogenous random rectangular matrices

Singularity degree of structured random matrices

Average-case matrix discrepancy: satisfiability bounds

Exponential Erdős-Szekeres theorem for matrices

Bad Science Matrices

The Numerical Rank of A Matrix and Its Applications

The sparse parity matrix

A note on the singularity probability of random directed $d$-regular graphs

The smallest singular value of large random rectangular Toeplitz and circulant matrices

A simple proof for the almost sure convergence of the largest singular value of a product of Gaussian matrices

The rank of sparse symmetric matrices over arbitrary fields