PPZ For More Than Two Truth Values - An Algorithm for Constraint Satisfaction Problems

Dominik Scheder

IF: 4.755

2010-01-01

Clinical Orthopaedics and Related Research

Abstract:We analyze the so-called ppz algorithm for (d,k)-CSP problems for general values of d (number of values a variable can take) and k (number of literals per constraint). To analyze its success probability, we prove a correlation inequality for submodular functions.

What problem does this paper attempt to address?

The Ppsz Algorithm For Constraint Satisfaction Problems On More Than Two Colors

Timon Hertli,Isabelle Hurbain,Sebastian Millius,Robin A. Moser,Dominik Scheder,May Szedlák

DOI: https://doi.org/10.1007/978-3-319-44953-1_27

2016-01-01

Abstract:The PPSZ algorithm (Paturi et al., FOCS 1998) is the fastest known algorithm for k-SAT. We show how to extend the algorithm and its analysis to (d, k)-Clause Satisfaction Problems where each variable ranges over d different values. Given an input instance with a unique satisfying assignment, the resulting algorithm is the fastest known algorithm for ( d, k)-CSP except when ( d, k) is ( 3, 2) or ( 4, 2). For the general case of multiple satisfying assignments, our algorithm is the fastest known for all k >= 4.
Impatient PPSZ - a Faster Algorithm for CSP

Shibo Li,Dominik Scheder

DOI: https://doi.org/10.4230/lipics.isaac.2021.33

2021-01-01

Abstract:PPSZ is the fastest known algorithm for (d,k)-CSP problems, for most values of d and k. It goes through the variables in random order and sets each variable randomly to one of the d colors, excluding those colors that can be ruled out by looking at few constraints at a time. We propose and analyze a modification of PPSZ: whenever all but 2 colors can be ruled out for some variable, immediately set that variable randomly to one of the remaining colors. We show that our new"impatient PPSZ"outperforms PPSZ exponentially for all k and all d>= 3 on formulas with a unique satisfying assignment.
PPSZ for K ≥ 5: More is Better.

Dominik Scheder

DOI: https://doi.org/10.1145/3349613

2019-01-01

ACM Transactions on Computation Theory

Abstract:We show that for k ≥ 5, the PPSZ algorithm for k -SAT runs exponentially faster if there is an exponential number of satisfying assignments. More precisely, we show that for every k ≥ 5, there is a strictly increasing function f : [0,1] → R with f (0) = 0 that has the following property. If F is a k -CNF formula over n variables and |sat(F)| = 2 δ n solutions, then PPSZ finds a satisfying assignment with probability at least 2 − c k n − o ( n ) + f (δ) n . Here, 2 − c k n − o ( n ) is the success probability proved by Paturi et al. [11] for k -CNF formulas with a unique satisfying assignment. Our proof rests on a combinatorial lemma: given a set S ⊆ { 0,1} n , we can partition { 0,1} n into subcubes such that each subcube B contains exactly one element of S . Such a partition B induces a distribution on itself, via Pr [ B ] = |B| / 2 n for each B ∈ B . We are interested in partitions that induce a distribution of high entropy. We show that, in a certain sense, the worst case (min S : |S| = s max B H ( B )) is achieved if S is a Hamming ball. This lemma implies that every set S of exponential size allows a partition of linear entropy. This in turn leads to an exponential improvement of the success probability of PPSZ.
Tighter Hard Instances for PPSZ.

Pavel Pudlák,Dominik Scheder,Navid Talebanfard

DOI: https://doi.org/10.4230/lipics.icalp.2017.85

2017-01-01

Abstract:We construct uniquely satisfiable k-CNF formulas that are hard for the algorithm PPSZ. Firstly, we construct graph-instances on which "weak PPSZ" has savings of at most (2 + ϵ) / k; the saving of an algorithm on an input formula with n variables is the largest γ such that the algorithm succeeds (i.e. finds a satisfying assignment) with probability at least 2^ - (1 - γ) n. Since PPSZ (both weak and strong) is known to have savings of at least π^2 + o(1)/6k, this is optimal up to the constant factor. In particular, for k=3, our upper bound is 2^0.333… n, which is fairly close to the lower bound 2^0.386… n of Hertli [SIAM J. Comput.'14]. We also construct instances based on linear systems over 𝔽_2 for which strong PPSZ has savings of at most O(log(k)/k). This is only a log(k) factor away from the optimal bound. Our constructions improve previous savings upper bound of O(log^2(k)/k) due to Chen et al. [SODA'13].
From K-Sat to K-Csp: Two Generalized Algorithms

Liang Li,Xin Li,Tian Liu,Ke Xu

2008-01-01

Abstract:Constraint satisfaction problems (CSPs) models many important intractable NP-hard problems such as propositional satisfiability problem (SAT). Algorithms with non-trivial upper bounds on running time for restricted SAT with bounded clause length k (k-SAT) can be classified into three styles: DPLL-like, PPSZ-like and Local Search, with local search algorithms having already been generalized to CSP with bounded constraint arity k (k-CSP). We generalize a DPLL-like algorithm in its simplest form and a PPSZ-like algorithm from k-SAT to k-CSP. As far as we know, this is the first attempt to use PPSZ-like strategy to solve k-CSP, and before little work has been focused on the DPLL-like or PPSZ-like strategies for k-CSP.
PPSZ for General k-SAT and CSP—Making Hertli's Analysis Simpler and 3-SAT Faster

Dominik Scheder,John Steinberger

DOI: https://doi.org/10.1007/s00037-024-00259-y

2024-11-04

Computational Complexity

Abstract:The currently fastest known algorithm for k -SAT is PPSZ, named after its inventors (Paturi et al. in J ACM 52(3):337-364, 2005. http://dx.doi.org/10.1145/1066100.1066101). Analyzing its running time is much easier for input formulas with a unique satisfying assignment. In this paper, we achieve three goals. First, we simplify the analysis of Hertli (in 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science-FOCS 2011, Los Alamitos, 2011) for input formulas with multiple satisfying assignments. Second, we show a "lifting result": if you improve PPSZ for k -CNF formulas with a unique satisfying assignment, you will immediately get a (weaker) improvement for general k -CNF formulas. In combination this with results by Hansen et al. (in Charikar and Cohen (ed) Proceedings of the 51st Annual ACM SIGACT Symposium on Theory of Computing, 2019) and Scheder (in 62nd IEEE Annual Symposium on Foundations of Computer Science, 2021), who all prove improved time bounds for Unique- k -SAT, this gives improved bounds for general k -SAT. We also generalize our results to the domain of Constraint Satisfaction Problems, i.e., satisfiability with more than two truth values.

computer science, theory & methods,mathematics
PPSZ for General K-Sat and CSP—Making Hertli’s Analysis Simpler and 3-SAT Faster

Dominik Scheder,John Steinberger

DOI: https://doi.org/10.1007/s00037-024-00259-y

2024-01-01

Computational Complexity

Abstract:The currently fastest known algorithm for k-SAT is PPSZ, named after its inventors (Paturi et al. in J ACM 52(3):337-364, 2005. http://dx.doi.org/10.1145/1066100.1066101 ). Analyzing its running time is much easier for input formulas with a unique satisfying assignment. In this paper, we achieve three goals. First, we simplify the analysis of Hertli (in 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science-FOCS 2011, Los Alamitos, 2011) for input formulas with multiple satisfying assignments. Second, we show a “lifting result”: if you improve PPSZ for k-CNF formulas with a unique satisfying assignment, you will immediately get a (weaker) improvement for general k-CNF formulas. In combination this with results by Hansen et al. (in Charikar and Cohen (ed) Proceedings of the 51st Annual ACM SIGACT Symposium on Theory of Computing, 2019) and Scheder (in 62nd IEEE Annual Symposium on Foundations of Computer Science, 2021), who all prove improved time bounds for Unique-k-SAT, this gives improved bounds for general k-SAT. We also generalize our results to the domain of Constraint Satisfaction Problems, i.e., satisfiability with more than two truth values.
On the geometry of $k$-SAT solutions: what more can PPZ and Schöning's algorithms do?

Per Austrin,Ioana O. Bercea,Mayank Goswami,Nutan Limaye,Adarsh Srinivasan

2024-07-28

Abstract:Given a $k$-CNF formula and an integer $s$, we study algorithms that obtain $s$ solutions to the formula that are maximally dispersed. For $s=2$, the problem of computing the diameter of a $k$-CNF formula was initiated by Creszenzi and Rossi, who showed strong hardness results even for $k=2$. Assuming SETH, the current best upper bound [Angelsmark and Thapper '04] goes to $4^n$ as $k \rightarrow \infty$. As our first result, we give exact algorithms for using the Fast Fourier Transform and clique-finding that run in $O^*(2^{(s-1)n})$ and $O^*(s^2 |\Omega_{F}|^{\omega \lceil s/3 \rceil})$ respectively, where $|\Omega_{F}|$ is the size of the solution space of the formula $F$ and $\omega$ is the matrix multiplication exponent. As our main result, we re-analyze the popular PPZ (Paturi, Pudlak, Zane '97) and Schöning's ('02) algorithms (which find one solution in time $O^*(2^{\varepsilon_{k}n})$ for $\varepsilon_{k} \approx 1-\Theta(1/k)$), and show that in the same time, they can be used to approximate the diameter as well as the dispersion ($s>2$) problems. While we need to modify Schöning's original algorithm, we show that the PPZ algorithm, without any modification, samples solutions in a geometric sense. We believe that this property may be of independent interest. Finally, we present algorithms to output approximately diverse, approximately optimal solutions to NP-complete optimization problems running in time $\text{poly}(s)O^*(2^{\varepsilon n})$ with $\varepsilon<1$ for several problems such as Minimum Hitting Set and Feedback Vertex Set. For these problems, all existing exact methods for finding optimal diverse solutions have a runtime with at least an exponential dependence on the number of solutions $s$. Our methods find bi-approximations with polynomial dependence on $s$.

Computational Complexity,Data Structures and Algorithms
Exponential Lower Bounds for the PPSZ K-Sat Algorithm

Shiteng Chen,Dominik Scheder,Navid Talebanfard,Bangsheng Tang

DOI: https://doi.org/10.1137/1.9781611973105.91

2013-01-01

Abstract:In 1998, Paturi, Pudlák, Saks, and Zane presented PPSZ, an elegant randomized algorithm for k-SAT. Fourteen years on, this algorithm is still the fastest known worst-case algorithm. They proved that its expected running time on k-CNF formulas with n variables is at most 2(1−εk)n, where εk ε Ω(1/k). So far, no exponential lower bounds at all have been known.In this paper, we construct hard instances for PPSZ. That is, we construct satisfiable k-CNF formulas over n variables on which the expected running time is at least 2(1--εk)n, for εk ε O(log2k/k).
The CSP Dichotomy, the Axiom of Choice, and Cyclic Polymorphisms

Tamás Kátay,László Márton Tóth,Zoltán Vidnyánszky

2024-10-29

Abstract:We study Constraint Satisfaction Problems (CSPs) in an infinite context. We show that the dichotomy between easy and hard problems -- established already in the finite case -- presents itself as the strength of the corresponding De Bruijin-Erdős-type compactness theorem over ZF. More precisely, if $\mathcal{D}$ is a structure, let $K_\mathcal{D}$ stand for the following statement: for every structure $\mathcal{X}$ if every finite substructure of $\mathcal{X}$ admits a solution to $\mathcal{D}$, then so does $\mathcal{X}$. We prove that if $\mathcal{D}$ admits no cyclic polymorphism, and thus it is NP-complete by the CSP Dichotomy Theorem, then $K_\mathcal{D}$ is equivalent to the Boolean Prime Ideal Theorem (BPI) over ZF. Conversely, we also show that if $\mathcal{D}$ admits a cyclic polymorphism, and thus it is in P, then $K_\mathcal{D}$ is strictly weaker than BPI.

Logic,Computational Complexity
PPSZ for General K-Sat: Making Hertli's Analysis Simpler and 3-SAT Faster

Dominik Scheder,John P. Steinberger

DOI: https://doi.org/10.5555/3135595.3135604

2017-01-01

Abstract:In this paper, we achieve three goals. First, we simplify Hertli's 2011 analysis [1] for input formulas with multiple satisfying assignments. Second, we show a translation result: if you improve PPSZ for k-CNF formulas with a unique satisfying assignment, you will immediately get a (weaker) improvement for general k-CNF formulas.Combining this with a result by Hertli from 2014 [2], in which he gives an algorithm for Unique-3-SAT slightly beating PPSZ, we obtain an algorithm beating PPSZ for general 3-SAT, thus obtaining the so far best known worst-case bounds for 3-SAT.
SDPs and Robust Satisfiability of Promise CSP

Joshua Brakensiek,Venkatesan Guruswami,Sai Sandeep

DOI: https://doi.org/10.48550/arXiv.2211.08373

2023-06-08

Abstract:For a constraint satisfaction problem (CSP), a robust satisfaction algorithm is one that outputs an assignment satisfying most of the constraints on instances that are near-satisfiable. It is known that the CSPs that admit efficient robust satisfaction algorithms are precisely those of bounded width, i.e., CSPs whose satisfiability can be checked by a simple local consistency algorithm (eg., 2-SAT or Horn-SAT in the Boolean case). While the exact satisfiability of a bounded width CSP can be checked by combinatorial algorithms, the robust algorithm is based on rounding a canonical Semidefinite programming(SDP) relaxation. In this work, we initiate the study of robust satisfaction algorithms for promise CSPs, which are a vast generalization of CSPs that have received much attention recently. The motivation is to extend the theory beyond CSPs, as well as to better understand the power of SDPs. We present robust SDP rounding algorithms under some general conditions, namely the existence of particular high-dimensional Boolean symmetries known as majority or alternating threshold polymorphisms. On the hardness front, we prove that the lack of such polymorphisms makes the PCSP hard for all pairs of symmetric Boolean predicates. Our method involves a novel method to argue SDP gaps via the absence of certain colorings of the sphere, with connections to sphere Ramsey theory. We conjecture that PCSPs with robust satisfaction algorithms are precisely those for which the feasibility of the canonical SDP implies (exact) satisfiability. We also give a precise algebraic condition, known as a minion characterization, of which PCSPs have the latter property.

Data Structures and Algorithms,Discrete Mathematics,Logic in Computer Science
Sandwiches for Promise Constraint Satisfaction

Guofeng Deng,Ezzeddine El Sai,Trevor Manders,Peter Mayr,Poramate Nakkirt,Athena Sparks

DOI: https://doi.org/10.48550/arXiv.2003.07487

2020-03-17

Abstract:Promise Constraint Satisfaction Problems (PCSP) were proposed recently by Brakensiek and Guruswami <a class="link-https" data-arxiv-id="1704.01937" href="https://arxiv.org/abs/1704.01937">arXiv:1704.01937</a> as a framework to study approximations for Constraint Satisfaction Problems (CSP). Informally a PCSP asks to distinguish between whether a given instance of a CSP has a solution or not even a specified relaxation can be satisfied. All currently known tractable PCSPs can be reduced in a natural way to tractable CSPs. Barto <a class="link-https" data-arxiv-id="1909.04878" href="https://arxiv.org/abs/1909.04878">arXiv:1909.04878</a> presented an example of a PCSP over Boolean structures for which this reduction requires solving a CSP over an infinite structure. We give a first example of a PCSP over Boolean structures which reduces to a tractable CSP over a structure of size $3$ but not smaller. Further we investigate properties of PCSPs that reduce to systems of linear equations or to CSPs over structures with semilattice or majority polymorphism.

Computational Complexity
Satisfiability of Almost Disjoint CNF Formulas

Dominik Scheder

DOI: https://doi.org/10.48550/arxiv.0807.1282

2008-01-01

Abstract:We call a CNF formula linear if any two clauses have at most one variable in common. Let m(k) be the largest integer m such that any linear k-CNF formula with <= m clauses is satisfiable. We show that 4^k / (4e^2k^3) <= m(k) < ln(2) k^4 4^k. More generally, a (k,d)-CSP is a constraint satisfaction problem in conjunctive normal form where each variable can take on one of d values, and each constraint contains k variables and forbids exacty one of the d^k possible assignments to these variables. Call a (k,d)-CSP l-disjoint if no two distinct constraints have l or more variables in common. Let m_l(k,d) denote the largest integer m such that any l-disjoint (k,d)-CSP with at most m constraints is satisfiable. We show that 1/k (d^k/(ed^(l-1)k))^(1+1/(l-1))<= m_l(k,d) < c (k^2/l ln(d) d^k)^(1+1/(l-1)). for some constant c. This means for constant l, upper and lower bound differ only in a polynomial factor in d and k.
Super Strong ETH is True for PPSZ with Small Resolution Width

Dominik Scheder,Navid Talebanfard

DOI: https://doi.org/10.4230/lipics.ccc.2020.3

2020-01-01

Abstract:We construct k -CNFs with m variables on which the strong version of PPSZ k -SAT algorithm, which uses resolution of width bounded by O ([MATH HERE]), has success probability at most 2 -(1-(1+∈)2/ k ) m for every ∈ > 0. Previously such a bound was known only for the weak PPSZ algorithm which exhaustively searches through small subformulas of the CNF to see if any of them forces the value of a given variable, and for strong PPSZ the best known previous upper bound was 2 -(1- O (log( k )/ k )) m (Pudlák et al., ICALP 2017).
PPSZ for General k-SAT - Making Hertli's Analysis Simpler and 3-SAT Faster.

Dominik Scheder,John P. Steinberger

DOI: https://doi.org/10.4230/LIPIcs.CCC.2017.9

2017-01-01

Abstract:The currently fastest known algorithm for k-SAT is PPSZ named after its inventors Paturi, Pudlak, Saks, and Zane [7]. Analyzing its running time is much easier for input formulas with a unique satisfying assignment. In this paper, we achieve three goals. First, we simplify Hertli's 2011 analysis [1] for input formulas with multiple satisfying assignments. Second, we show a "translation result": if you improve PPSZ for k-CNF formulas with a unique satisfying assignment, you will immediately get a (weaker) improvement for general k-CNF formulas. Combining this with a result by Hertli from 2014 [2], in which he gives an algorithm for Unique-3-SAT slightly beating PPSZ, we obtain an algorithm beating PPSZ for general 3-SAT, thus obtaining the so far best known worst-case bounds for 3-SAT.
Solution Dominance over Constraint Satisfaction Problems

Tias Guns,Peter J. Stuckey,Guido Tack

DOI: https://doi.org/10.48550/arXiv.1812.09207

2018-12-21

Abstract:Constraint Satisfaction Problems (CSPs) typically have many solutions that satisfy all constraints. Often though, some solutions are preferred over others, that is, some solutions dominate other solutions. We present solution dominance as a formal framework to reason about such settings. We define Constraint Dominance Problems (CDPs) as CSPs with a dominance relation, that is, a preorder over the solutions of the CSP. This framework captures many well-known variants of constraint satisfaction, including optimization, multi-objective optimization, Max-CSP, minimal models, minimum correction subsets as well as optimization over CP-nets and arbitrary dominance relations. We extend MiniZinc, a declarative language for modeling CSPs, to CDPs by introducing dominance nogoods; these can be derived from dominance relations in a principled way. A generic method for solving arbitrary CDPs incrementally calls a CSP solver and is compatible with any existing solver that supports MiniZinc. This encourages experimenting with different solution dominance relations for a problem, as well as comparing different solvers without having to modify their implementations.

Artificial Intelligence
PPSZ is better than you think

Dominik Scheder

DOI: https://doi.org/10.46298/theoretics.24.5

2024-03-12

Abstract:PPSZ, for long time the fastest known algorithm for $k$-SAT, works by going through the variables of the input formula in random order; each variable is then set randomly to $0$ or $1$, unless the correct value can be inferred by an efficiently implementable rule (like small-width resolution; or being implied by a small set of clauses). We show that PPSZ performs exponentially better than previously known, for all $k \geq 3$. For Unique-$3$-SAT we bound its running time by $O(1.306973^{n})$, which is somewhat better than the algorithm of Hansen, Kaplan, Zamir, and Zwick, which runs in time $O(1.306995^n)$. Before that, the best known upper bound for Unique-$3$-SAT was $O(1.3070319^n)$. All improvements are achieved without changing the original PPSZ. The core idea is to pretend that PPSZ does not process the variables in uniformly random order, but according to a carefully designed distribution. We write "pretend" since this can be done without any actual change to the algorithm.

Data Structures and Algorithms
An invitation to the promise constraint satisfaction problem

Andrei Krokhin,Jakub Opršal

DOI: https://doi.org/10.1145/3559736.3559740

2022-08-29

Abstract:The study of the complexity of the constraint satisfaction problem (CSP), centred around the Feder-Vardi Dichotomy Conjecture, has been very prominent in the last two decades. After a long concerted effort and many partial results, the Dichotomy Conjecture has been proved in 2017 independently by Bulatov and Zhuk. At about the same time, a vast generalisation of CSP, called promise CSP, has started to gain prominence. In this survey, we explain the importance of promise CSP and highlight many new very interesting features that the study of promise CSP has brought to light. The complexity classification quest for the promise CSP is wide open, and we argue that, despite the promise CSP being more general, this quest is rather more accessible to a wide range of researchers than the dichotomy-led study of the CSP has been.

Computational Complexity,Logic in Computer Science,Logic
Efficient Algorithms and New Characterizations for CSP Sparsification

Sanjeev Khanna,Aaron L. Putterman,Madhu Sudan

2024-11-06

Abstract:CSP sparsification, introduced by Kogan and Krauthgamer (ITCS 2015), considers the following question: how much can an instance of a constraint satisfaction problem be sparsified (by retaining a reweighted subset of the constraints) while still roughly capturing the weight of constraints satisfied by {\em every} assignment. CSP sparsification captures as a special case several well-studied problems including graph cut-sparsification, hypergraph cut-sparsification, hypergraph XOR-sparsification, and corresponds to a general class of hypergraph sparsification problems where an arbitrary $0/1$-valued {\em splitting function} is used to define the notion of cutting a hyperedge (see, for instance, Veldt-Benson-Kleinberg SIAM Review 2022). The main question here is to understand, for a given constraint predicate $P:\Sigma^r \to \{0,1\}$ (where variables are assigned values in $\Sigma$), the smallest constant $c$ such that $\widetilde{O}(n^c)$ sized sparsifiers exist for every instance of a constraint satisfaction problem over $P$. A recent work of Khanna, Putterman and Sudan (SODA 2024) [KPS24] showed {\em existence} of near-linear size sparsifiers for new classes of CSPs. In this work (1) we significantly extend the class of CSPs for which nearly linear-size sparsifications can be shown to exist while also extending the scope to settings with non-linear-sized sparsifications; (2) we give a polynomial-time algorithm to extract such sparsifications for all the problems we study including the first efficient sparsification algorithms for the problems studied in [KPS24].

Data Structures and Algorithms

PPZ For More Than Two Truth Values - An Algorithm for Constraint Satisfaction Problems

The Ppsz Algorithm For Constraint Satisfaction Problems On More Than Two Colors

Impatient PPSZ - a Faster Algorithm for CSP

PPSZ for K ≥ 5: More is Better.

Tighter Hard Instances for PPSZ.

From K-Sat to K-Csp: Two Generalized Algorithms

PPSZ for General k-SAT and CSP—Making Hertli's Analysis Simpler and 3-SAT Faster

PPSZ for General K-Sat and CSP—Making Hertli’s Analysis Simpler and 3-SAT Faster

On the geometry of $k$-SAT solutions: what more can PPZ and Schöning's algorithms do?

Exponential Lower Bounds for the PPSZ K-Sat Algorithm

The CSP Dichotomy, the Axiom of Choice, and Cyclic Polymorphisms

PPSZ for General K-Sat: Making Hertli's Analysis Simpler and 3-SAT Faster

SDPs and Robust Satisfiability of Promise CSP

Sandwiches for Promise Constraint Satisfaction

Satisfiability of Almost Disjoint CNF Formulas

Super Strong ETH is True for PPSZ with Small Resolution Width

PPSZ for General k-SAT - Making Hertli's Analysis Simpler and 3-SAT Faster.

Solution Dominance over Constraint Satisfaction Problems

PPSZ is better than you think

An invitation to the promise constraint satisfaction problem

Efficient Algorithms and New Characterizations for CSP Sparsification