Abstract:Given a sequence of $d \times d$ symmetric matrices $\{\mathbf{W}_i\}_{i=1}^n$, and a margin $\Delta > 0$, we investigate whether it is possible to find signs $(\epsilon_1, \dots, \epsilon_n) \in \{\pm 1\}^n$ such that the operator norm of the signed sum satisfies $\|\sum_{i=1}^n \epsilon_i \mathbf{W}_i\|_\mathrm{op} \leq \Delta$. Kunisky and Zhang (2023) recently introduced a random version of this problem, where the matrices $\{\mathbf{W}_i\}_{i=1}^n$ are drawn from the Gaussian orthogonal ensemble. This model can be seen as a random variant of the celebrated Matrix Spencer conjecture and as a matrix-valued analog of the symmetric binary perceptron in statistical physics. In this work, we establish a satisfiability transition in this problem as $n, d \to \infty$ with $n / d^2 \to \tau > 0$. Our contributions are twofold. First, we prove that the expected number of solutions with margin $\Delta=\kappa \sqrt{n}$ has a sharp threshold at a critical $\tau_1(\kappa)$: for $\tau < \tau_1(\kappa)$ the problem is typically unsatisfiable, while for $\tau > \tau_1(\kappa)$ the average number of solutions becomes exponentially large. Second, combining a second-moment method with recent results from Altschuler (2023) on margin concentration in perceptron-type problems, we identify a second threshold $\tau_2(\kappa)$, such that for $\tau>\tau_2(\kappa)$ the problem admits solutions with high probability. In particular, we establish for the first time that a system of $n = \Theta(d^2)$ Gaussian random matrices can be balanced so that the spectrum of the resulting matrix macroscopically shrinks compared to the typical semicircle law. Our proofs rely on deriving concentration inequalities and large deviation properties for the law of correlated Gaussian matrices under spectral norm constraints, extending results in the literature and offering insights of independent interest.

Concentration of the mixed discriminant of well-conditioned matrices

Efficient Certificates of Anti-Concentration Beyond Gaussians

Projective convergence of columns for inhomogeneous products of matrices with nonnegative entries

Concentration Inequalities for Sums of Markov Dependent Random Matrices

Computational Complexity of Normalizing Constants for the Product of Determinantal Point Processes

Deriving Matrix Concentration Inequalities from Kernel Couplings

Average-case matrix discrepancy: satisfiability bounds

A characterization of the mixed discriminant

A Note on Preconditioners for Nonsymmetric Matrices

From Poincaré Inequalities to Nonlinear Matrix Concentration

On the sparsity of non-diagonalisable integer matrices and matrices with a given discriminant

Concentration of a high dimensional sub-gaussian vector

Doubly stochastic and combined matrices

Positive Semidefinite Supermartingales and Randomized Matrix Concentration Inequalities

Reduction Theorems for Optimal Unambiguous State Discrimination of Density Matrices

A concentration inequality and a local law for the sum of two random matrices

Efficient Algorithms for Solving Condition Number-Constrained Matrix Minimization Problems

Two nondeterministic positive definiteness tests for unidiagonal integral matrices

Preconditioned Diagonally Dominant Property For Linear Systems With H-Matrices

Quantum Discriminant Analysis for Dimensionality Reduction and Classification

Confusion Matrix Stability Bounds for Multiclass Classification