Abstract:The problem of identifying a planted assignment given a random $k$-satisfiability ($k$-SAT) formula consistent with the assignment exhibits a large algorithmic gap: while the planted solution becomes unique and can be identified given a formula with $O(n\log n)$ clauses, there are distributions over clauses for which the best-known efficient algorithms require $n^{k/2}$ clauses. We propose and study a unified model for planted $k$-SAT, which captures well-known special cases. An instance is described by a planted assignment $\sigma$ and a distribution on clauses with $k$ literals. We define its distribution complexity as the largest $r$ for which the distribution is not $r$-wise independent ($1 \le r \le k$ for any distribution with a planted assignment). Our main result is an unconditional lower bound, tight up to logarithmic factors, for statistical (query) algorithms [M. Kearns, J. ACM, 45 (1998), pp. 983--1006; V. Feldman, E. Grigorescu, L. Reyzin, S. S. Vempala, and Y. Xiao, J. ACM, 64 (2017), pp. 8:1--8:37], matching known upper bounds, which, as we show, can be implemented using a statistical algorithm. Since known approaches for problems over distributions have statistical analogues (spectral, Markov Chain Monte Carlo, gradient-based, convex optimization, etc.), this lower bound provides a rigorous explanation of the observed algorithmic gap. The proof introduces a new general technique for the analysis of statistical query algorithms. It also points to a geometric paring phenomenon in the space of all planted assignments. We describe consequences of our lower bounds to Feige's refutation hypothesis [U. Feige, Proceedings of the ACM Symposium on Theory of Computing, 2002, pp. 534--543] and to lower bounds on general convex programs that solve planted $k$-SAT. Our bounds also extend to other planted $k$-CSP models and, in particular, provide concrete evidence for the security of Goldreich's one-way function and the associated pseudorandom generator when used with a sufficiently hard predicate [O. Goldreich, preprint, ia.cr/2000/063, 2000].

Proof of the Satisfiability Conjecture for Large K

Going after the k-SAT threshold

The asymptotic k-SAT threshold

Satisfiability Threshold for Random Regular Nae-Sat

Counting random $k$-SAT near the satisfiability threshold

The number of solutions for random regular NAE-SAT

One-step replica symmetry breaking of random regular NAE-SAT I

The Algorithmic Phase Transition of Random $k$-SAT for Low Degree Polynomials

The Satisfiability Threshold for a Seemingly Intractable Random Constraint Satisfaction Problem

On the satisfiability of random $3$-SAT formulas with $k$-wise independent clauses

Properties of the satisfiability threshold of the strictly d-regular random (3,2s)-SAT problem

On the Complexity of Random Satisfiability Problems with Planted Solutions

Strongly refuting random CSPs below the spectral threshold

Upper bounds on the $2$-colorability threshold of random $d$-regular $k$-uniform hypergraphs for $k\geq 3$

Local geometry of NAE-SAT solutions in the condensation regime

Some Results on Random Mixed SAT Problems

Linear Phase Transition in Random Linear Constraint Satisfaction Problem

The $k$-XORSAT Threshold Revisited

Bose-Einstein Condensation in Satisfiability Problems

On the Satisfaction Probabilities of $k$-CNF Formulas

A SAT Solver and Computer Algebra Attack on the Minimum Kochen-Specker Problem