Abstract:The problem of identifying a planted assignment given a random $k$-satisfiability ($k$-SAT) formula consistent with the assignment exhibits a large algorithmic gap: while the planted solution becomes unique and can be identified given a formula with $O(n\log n)$ clauses, there are distributions over clauses for which the best-known efficient algorithms require $n^{k/2}$ clauses. We propose and study a unified model for planted $k$-SAT, which captures well-known special cases. An instance is described by a planted assignment $\sigma$ and a distribution on clauses with $k$ literals. We define its distribution complexity as the largest $r$ for which the distribution is not $r$-wise independent ($1 \le r \le k$ for any distribution with a planted assignment). Our main result is an unconditional lower bound, tight up to logarithmic factors, for statistical (query) algorithms [M. Kearns, J. ACM, 45 (1998), pp. 983--1006; V. Feldman, E. Grigorescu, L. Reyzin, S. S. Vempala, and Y. Xiao, J. ACM, 64 (2017), pp. 8:1--8:37], matching known upper bounds, which, as we show, can be implemented using a statistical algorithm. Since known approaches for problems over distributions have statistical analogues (spectral, Markov Chain Monte Carlo, gradient-based, convex optimization, etc.), this lower bound provides a rigorous explanation of the observed algorithmic gap. The proof introduces a new general technique for the analysis of statistical query algorithms. It also points to a geometric paring phenomenon in the space of all planted assignments. We describe consequences of our lower bounds to Feige's refutation hypothesis [U. Feige, Proceedings of the ACM Symposium on Theory of Computing, 2002, pp. 534--543] and to lower bounds on general convex programs that solve planted $k$-SAT. Our bounds also extend to other planted $k$-CSP models and, in particular, provide concrete evidence for the security of Goldreich's one-way function and the associated pseudorandom generator when used with a sufficiently hard predicate [O. Goldreich, preprint, ia.cr/2000/063, 2000].

Analytical And Belief-Propagation Studies Of Random Constraint Satisfaction Problems With Growing Domains

A Message-Passing Approach to Random Constraint Satisfaction Problems with Growing Domains

Solution space structure of random constraint satisfaction problems with growing domains

A belief-propagation algorithm based on variable entropy for constraint satisfaction problems

The solution space structure of planted constraint satisfaction problems with growing domains

Balanced Random Constraint Satisfaction: Phase Transition and Hardness.

From one solution of a 3-satisfiability formula to a solution cluster: Frozen variables and entropy

Consistency and Random Constraint Satisfaction Models

The Underlying Interactive Chain Structure In The Solution Space Of Constraint Satisfaction Problems

Fractional Edge Cover Number of Model RB.

Counting Solutions of Constraint Satisfiability Problems:Exact Phase Transitions and Approximate Algorithm

Variable-Centered Consistency in Model RB

Biased landscapes for random Constraint Satisfaction Problems

Conditional Random Fields, Planted Constraint Satisfaction, and Entropy Concentration

The number of solutions for random regular NAE-SAT

Threshold behaviors of a random constraint satisfaction problem with exact phase transitions

A residual-based message passing algorithm for constraint satisfaction problems

On the Complexity of Random Satisfiability Problems with Planted Solutions

Widely distributed clusters of the constraint satisfaction problem model d-k-CSP

A new look at survey propagation and its generalizations

On the random satisfiable process