Abstract:Inference problems with conjectured statistical-computational gaps are ubiquitous throughout modern statistics, computer science and statistical physics. While there has been success evidencing these gaps from the failure of restricted classes of algorithms, progress towards a more traditional reduction-based approach to computational complexity in statistical inference has been limited. Existing reductions have largely been limited to inference problems with similar structure -- primarily mapping among problems representable as a sparse submatrix signal plus a noise matrix, which are similar to the common hardness assumption of planted clique. The insight in this work is that a slight generalization of the planted clique conjecture -- secret leakage planted clique -- gives rise to a variety of new average-case reduction techniques, yielding a web of reductions among problems with very different structure. Using variants of the planted clique conjecture for specific forms of secret leakage planted clique, we deduce tight statistical-computational tradeoffs for a diverse range of problems including robust sparse mean estimation, mixtures of sparse linear regressions, robust sparse linear regression, tensor PCA, variants of dense $k$-block stochastic block models, negatively correlated sparse PCA, semirandom planted dense subgraph, detection in hidden partition models and a universality principle for learning sparse mixtures. In particular, a $k$-partite hypergraph variant of the planted clique conjecture is sufficient to establish all of our computational lower bounds. Our techniques also reveal novel connections to combinatorial designs and to random matrix theory. This work gives the first evidence that an expanded set of hardness assumptions, such as for secret leakage planted clique, may be a key first step towards a more complete theory of reductions among statistical problems.

On the Cryptanalysis via Approximation of Cryptographic Primitives Relying on the Planted Clique Conjecture

Approximate Evaluation of Quantitative Second Order Queries

Detection-Recovery and Detection-Refutation Gaps via Reductions from Planted Clique

Almost Optimal Time Lower Bound for Approximating Parameterized Clique, CSP, and More, under ETH

The Ehrenfeucht-Fraïssé Method and the Planted Clique Conjecture

Approximation algorithms for noncommutative CSPs

Hardness Amplification via Group Theory

Logspace Reducibility From Secret Leakage Planted Clique

Reducibility and Statistical-Computational Gaps from Secret Leakage

Minimizing CNOT-count in Quantum Circuit of the Extended Shor’s Algorithm for ECDLP

Cryptanalysis of some Nonabelian Group-Based Key Exchange Protocols

Classifying Approximation Algorithms: Understanding the APX Complexity Class

Lossy Cryptography from Code-Based Assumptions

Is Planted Coloring Easier than Planted Clique?

Pliability and Approximating Max-CSPs

Fixed-Parameter and Approximation Algorithms: A New Look

On Basing One-way Permutations on NP-hard Problems under Quantum Reductions

An in-principle super-polynomial quantum advantage for approximating combinatorial optimization problems via computational learning theory

Private and Robust Distributed Nonconvex Optimization via Polynomial Approximation

On Lower Bounds of Approximating Parameterized K-Clique