Constraint satisfaction problem and universal algebra

Libor Barto

DOI: https://doi.org/10.1145/2677161.2677165

2014-10-14

ACM SIGLOG News

Abstract:This column gives a brief survey of current research on the complexity of the constraint satisfaction problem (CSP) over fixed constraint languages.

What problem does this paper attempt to address?

Proof complexity of universal algebra in a CSP dichotomy proof

Azza Gaysin

2024-03-11

Abstract:The constraint satisfaction problem (CSP) can be formulated as a homomorphism problem between relational structures: given a structure $\mathcal{A}$, for any structure $\mathcal{X}$, whether there exists a homomorphism from $\mathcal{X}$ to $\mathcal{A}$. For years, it has been conjectured that all problems of this type are divided into polynomial-time and NP-complete problems, and the conjecture was proved in 2017 separately by Zhuk (2017) and Bulatov (2017). Zhuk's algorithm solves tractable CSPs in polynomial time. The algorithm is partly based on universal algebra theorems: informally, they state that after reducing some domain of an instance to its strong subuniverses, a satisfiable instance maintains a solution.

Logic
Algebraic Global Gadgetry for Surjective Constraint Satisfaction

Hubie Chen

2024-04-23

Abstract:The constraint satisfaction problem (CSP) on a finite relational structure B is to decide, given a set of constraints on variables where the relations come from B, whether or not there is a assignment to the variables satisfying all of the constraints; the surjective CSP is the variant where one decides the existence of a surjective satisfying assignment onto the universe of B.

Computational Complexity
Time Complexity of Constraint Satisfaction via Universal Algebra

Peter Jonsson,Victor Lagerkvist,Biman Roy

DOI: https://doi.org/10.48550/arXiv.1706.05902

2017-06-19

Abstract:The exponential-time hypothesis (ETH) states that 3-SAT is not solvable in subexponential time, i.e. not solvable in O(c^n) time for arbitrary c > 1, where n denotes the number of variables. Problems like k-SAT can be viewed as special cases of the constraint satisfaction problem (CSP), which is the problem of determining whether a set of constraints is satisfiable. In this paper we study thef worst-case time complexity of NP-complete CSPs. Our main interest is in the CSP problem parameterized by a constraint language Gamma (CSP(Gamma)), and how the choice of Gamma affects the time complexity. It is believed that CSP(Gamma) is either tractable or NP-complete, and the algebraic CSP dichotomy conjecture gives a sharp delineation of these two classes based on algebraic properties of constraint languages. Under this conjecture and the ETH, we first rule out the existence of subexponential algorithms for finite-domain NP-complete CSP(Gamma) problems. This result also extends to certain infinite-domain CSPs and structurally restricted CSP(Gamma) problems. We then begin a study of the complexity of NP-complete CSPs where one is allowed to arbitrarily restrict the values of individual variables, which is a very well-studied subclass of CSPs. For such CSPs with finite domain D, we identify a relation SD such that (1) CSP({SD}) is NP-complete and (2) if CSP(Gamma) over D is NP-complete and solvable in O(c^n) time, then CSP({SD}) is solvable in O(c^n) time, too. Hence, the time complexity of CSP({SD}) is a lower bound for all CSPs of this particular kind. We also prove that the complexity of CSP({SD}) is decreasing when |D| increases, unless the ETH is false. This implies, for instance, that for every c>1 there exists a finite-domain Gamma such that CSP(Gamma) is NP-complete and solvable in O(c^n) time.

Computational Complexity
Constraint Satisfaction Tractability from Semi-lattice Operations on Infinite Sets

Manuel Bodirsky,Dugald Macpherson,Johan Thapper

DOI: https://doi.org/10.48550/arXiv.1111.6616

2011-11-29

Abstract:A famous result by Jeavons, Cohen, and Gyssens shows that every constraint satisfaction problem (CSP) where the constraints are preserved by a semi-lattice operation can be solved in polynomial time. This is one of the basic facts for the so-called universal-algebraic approach to a systematic theory of tractability and hardness in finite domain constraint satisfaction. Not surprisingly, the theorem of Jeavons et al. fails for arbitrary infinite domain CSPs. Many CSPs of practical interest, though, and in particular those CSPs that are motivated by qualitative reasoning calculi from Artificial Intelligence, can be formulated with constraint languages that are rather well-behaved from a model-theoretic point of view. In particular, the automorphism group of these constraint languages tends to be large in the sense that the number of orbits of n-subsets of the automorphism group is bounded by some function in n. In this paper we present a generalization of the theorem by Jeavons et al. to infinite domain CSPs where the number of orbits of n-subsets grows sub-exponentially in n, and prove that preservation under a semi-lattice operation for such CSPs implies polynomial-time tractability. Unlike the result of Jeavons et al., this includes many CSPs that cannot be solved by Datalog.

Computational Complexity,Discrete Mathematics,Logic
CSPs with Few Alien Constraints

Peter Jonsson,Victor Lagerkvist,George Osipov

2024-08-27

Abstract:The constraint satisfaction problem asks to decide if a set of constraints over a relational structure $\mathcal{A}$ is satisfiable (CSP$(\mathcal{A})$). We consider CSP$(\mathcal{A} \cup \mathcal{B})$ where $\mathcal{A}$ is a structure and $\mathcal{B}$ is an alien structure, and analyse its (parameterized) complexity when at most $k$ alien constraints are allowed. We establish connections and obtain transferable complexity results to several well-studied problems that previously escaped classification attempts. Our novel approach, utilizing logical and algebraic methods, yields an FPT versus pNP dichotomy for arbitrary finite structures and sharper dichotomies for Boolean structures and first-order reducts of $(\mathbb{N},=)$ (equality CSPs), together with many partial results for general $\omega$-categorical structures.

Computational Complexity,Artificial Intelligence
Fine-Grained Time Complexity of Constraint Satisfaction Problems

Peter Jonsson,Victor Lagerkvist,Biman Roy

DOI: https://doi.org/10.1145/3434387

2021-03-01

ACM Transactions on Computation Theory

Abstract:We study the constraint satisfaction problem (CSP) parameterized by a constraint language Γ (CSPΓ) and how the choice of Γ affects its worst-case time complexity. Under the exponential-time hypothesis (ETH), we rule out the existence of subexponential algorithms for finite-domain NP-complete CSPΓ problems. This extends to certain infinite-domain CSPs and structurally restricted problems. For CSPs with finite domain D and where all unary relations are available, we identify a relation S D such that the time complexity of the NP-complete problem CSP({ S D }) is a lower bound for all NP-complete CSPs of this kind. We also prove that the time complexity of CSP({ S D }) strictly decreases when |D| increases (unless the ETH is false) and provide stronger complexity results in the special case when |D|=3.
Constraint Satisfaction Problems around Skolem Arithmetic

Christian Glasser,Peter Jonsson,Barnaby Martin

DOI: https://doi.org/10.48550/arXiv.1504.04181

2015-04-16

Abstract:We study interactions between Skolem Arithmetic and certain classes of Constraint Satisfaction Problems (CSPs). We revisit results of Glass er et al. in the context of CSPs and settle the major open question from that paper, finding a certain satisfaction problem on circuits to be decidable. This we prove using the decidability of Skolem Arithmetic. We continue by studying first-order expansions of Skolem Arithmetic without constants, (N;*), where * indicates multiplication, as CSPs. We find already here a rich landscape of problems with non-trivial instances that are in P as well as those that are NP-complete.

Computational Complexity,Logic in Computer Science
Logic Column 17: A Rendezvous of Logic, Complexity, and Algebra

Hubie Chen

DOI: https://doi.org/10.48550/arXiv.cs/0611018

2006-11-03

Logic in Computer Science

Abstract:This article surveys recent advances in applying algebraic techniques to constraint satisfaction problems.
Separation of congruence intervals and implications

Andrei A. Bulatov

2023-10-06

Abstract:The Constraint Satisfaction Problem (CSP) has been intensively studied in many areas of computer science and mathematics. The approach to the CSP based on tools from universal algebra turned out to be the most successful one to study the complexity and algorithms for this problem. Several techniques have been developed over two decades. One of them is through associating edge-colored graphs with algebras and studying how the properties of algebras are related with the structure of the associated graphs. This approach has been introduced in our previous two papers (A.Bulatov, Local structure of idempotent algebras I,II. <a class="link-https" data-arxiv-id="2006.09599" href="https://arxiv.org/abs/2006.09599">arXiv:2006.09599</a>, <a class="link-https" data-arxiv-id="2006.10239" href="https://arxiv.org/abs/2006.10239">arXiv:2006.10239</a>, 2020). In this paper we further advance it by introducing new structural properties of finite idempotent algebras omitting type 1 such as separation congruences, collapsing polynomials, and their implications for the structure of subdirect products of finite algebras. This paper also provides the algebraic background for our proof of Feder-Vardi Dichotomy Conjecture (A. Bulatov, A Dichotomy Theorem for Nonuniform CSPs. FOCS 2017: 319-330).

Logic
A Unifying Framework for Structural Properties of CSPs: Definitions, Complexity, Tractability

Lucas Bordeaux,Marco Cadoli,Toni Mancini

DOI: https://doi.org/10.1613/jair.2538

2014-01-15

Abstract:Literature on Constraint Satisfaction exhibits the definition of several structural properties that can be possessed by CSPs, like (in)consistency, substitutability or interchangeability. Current tools for constraint solving typically detect such properties efficiently by means of incomplete yet effective algorithms, and use them to reduce the search space and boost search. In this paper, we provide a unifying framework encompassing most of the properties known so far, both in CSP and other fields literature, and shed light on the semantical relationships among them. This gives a unified and comprehensive view of the topic, allows new, unknown, properties to emerge, and clarifies the computational complexity of the various detection problems. In particular, among the others, two new concepts, fixability and removability emerge, that come out to be the ideal characterisations of values that may be safely assigned or removed from a variables domain, while preserving problem satisfiability. These two notions subsume a large number of known properties, including inconsistency, substitutability and others. Because of the computational intractability of all the property-detection problems, by following the CSP approach we then determine a number of relaxations which provide sufficient conditions for their tractability. In particular, we exploit forms of language restrictions and local reasoning.

Artificial Intelligence,Logic in Computer Science
Semantic Width and the Fixed-Parameter Tractability of Constraint Satisfaction Problems

Hubie Chen,Georg Gottlob,Matthias Lanzinger,Reinhard Pichler

DOI: https://doi.org/10.24963/ijcai.2020/239

2020-07-28

Abstract:Constraint satisfaction problems (CSPs) are an important formal framework for the uniform treatment of various prominent AI tasks, e.g., coloring or scheduling problems. Solving CSPs is, in general, known to be NP-complete and fixed-parameter intractable when parameterized by their constraint scopes. We give a characterization of those classes of CSPs for which the problem becomes fixed-parameter tractable. Our characterization significantly increases the utility of the CSP framework by making it possible to decide the fixed-parameter tractability of problems via their CSP formulations. We further extend our characterization to the evaluation of unions of conjunctive queries, a fundamental problem in databases. Furthermore, we provide some new insight on the frontier of PTIME solvability of CSPs. In particular, we observe that bounded fractional hypertree width is more general than bounded hypertree width only for classes that exhibit a certain type of exponential growth. The presented work resolves a long-standing open problem and yields powerful new tools for complexity research in AI and database theory.

Computational Complexity,Databases
Streaming and Sketching Complexity of CSPs: A survey

Madhu Sudan

DOI: https://doi.org/10.48550/arXiv.2205.02744

2022-05-06

Abstract:In this survey we describe progress over the last decade or so in understanding the complexity of solving constraint satisfaction problems (CSPs) approximately in the streaming and sketching models of computation. After surveying some of the results we give some sketches of the proofs and in particular try to explain why there is a tight dichotomy result for sketching algorithms working in subpolynomial space regime.

Computational Complexity,Data Structures and Algorithms
An invitation to the promise constraint satisfaction problem

Andrei Krokhin,Jakub Opršal

DOI: https://doi.org/10.1145/3559736.3559740

2022-08-29

Abstract:The study of the complexity of the constraint satisfaction problem (CSP), centred around the Feder-Vardi Dichotomy Conjecture, has been very prominent in the last two decades. After a long concerted effort and many partial results, the Dichotomy Conjecture has been proved in 2017 independently by Bulatov and Zhuk. At about the same time, a vast generalisation of CSP, called promise CSP, has started to gain prominence. In this survey, we explain the importance of promise CSP and highlight many new very interesting features that the study of promise CSP has brought to light. The complexity classification quest for the promise CSP is wide open, and we argue that, despite the promise CSP being more general, this quest is rather more accessible to a wide range of researchers than the dichotomy-led study of the CSP has been.

Computational Complexity,Logic in Computer Science,Logic
Meditations on Quantified Constraint Satisfaction

Hubie Chen

DOI: https://doi.org/10.48550/arXiv.1201.6306

2012-01-31

Abstract:The quantified constraint satisfaction problem (QCSP) is the problem of deciding, given a structure and a first-order prenex sentence whose quantifier-free part is the conjunction of atoms, whether or not the sentence holds on the structure. One obtains a family of problems by defining, for each structure B, the problem QCSP(B) to be the QCSP where the structure is fixed to be B. In this article, we offer a viewpoint on the research program of understanding the complexity of the problems QCSP(B) on finite structures. In particular, we propose and discuss a group of conjectures; throughout, we attempt to place the conjectures in relation to existing results and to emphasize open issues and potential research directions.

Logic in Computer Science,Computational Complexity
The complexity of global cardinality constraints

Andrei Bulatov,Daniel Marx

DOI: https://doi.org/10.2168/lmcs-6(4:4)2010

2010-10-27

Logical Methods in Computer Science

Abstract:<p>In a constraint satisfaction problem (CSP) the goal is to find an assignmentof a given set of variables subject to specified constraints. A globalcardinality constraint is an additional requirement that prescribes how manyvariables must be assigned a certain value. We study the complexity of theproblem CCSP(G), the constraint satisfaction problem with global cardinalityconstraints that allows only relations from the set G. The main result of thispaper characterizes sets G that give rise to problems solvable in polynomialtime, and states that the remaining such problems are NP-complete.</p>

computer science, theory & methods,logic
Satisfiability of commutative vs. non-commutative CSPs

Andrei A. Bulatov,Stanislav Živný

2024-07-04

Abstract:The Mermin-Peres magic square is a celebrated example of a system of Boolean linear equations that is not (classically) satisfiable but is satisfiable via linear operators on a Hilbert space of dimension four. A natural question is then, for what kind of problems such a phenomenon occurs? Atserias, Kolaitis, and Severini answered this question for all Boolean Constraint Satisfaction Problems (CSPs): For 0-Valid-SAT, 1-Valid-SAT, 2-SAT, Horn-SAT, and Dual Horn-SAT, classical satisfiability and operator satisfiability is the same and thus there is no gap; for all other Boolean CSPs, these notions differ as there are gaps, i.e., there are unsatisfiable instances that are satisfiable via operators on Hilbert spaces. We generalize their result to CSPs on arbitrary finite domains and give an almost complete classification: First, we show that NP-hard CSPs admit a separation between classical satisfiability and satisfiability via operators on finite- and infinite-dimensional Hilbert spaces. Second, we show that tractable CSPs of bounded width have no satisfiability gaps of any kind. Finally, we show that tractable CSPs of unbounded width can simulate, in a satisfiability-gap-preserving fashion, linear equations over an Abelian group of prime order $p$; for such CSPs, we obtain a separation of classical satisfiability and satisfiability via operators on infinite-dimensional Hilbert spaces. Furthermore, if $p=2$, such CSPs also have gaps separating classical satisfiability and satisfiability via operators on finite- and infinite-dimensional Hilbert spaces.

Computational Complexity,Logic in Computer Science,Quantum Physics
Lifting Structural Tractability to CSP with Global Constraints

Evgenij Thorstensen

DOI: https://doi.org/10.48550/arXiv.1307.1790

2013-07-06

Abstract:A wide range of problems can be modelled as constraint satisfaction problems (CSPs), that is, a set of constraints that must be satisfied simultaneously. Constraints can either be represented extensionally, by explicitly listing allowed combinations of values, or implicitly, by special-purpose algorithms provided by a solver. Such implicitly represented constraints, known as global constraints, are widely used; indeed, they are one of the key reasons for the success of constraint programming in solving real-world problems. In recent years, a variety of restrictions on the structure of CSP instances that yield tractable classes have been identified. However, many such restrictions fail to guarantee tractability for CSPs with global constraints. In this paper, we investigate the properties of extensionally represented constraints that these restrictions exploit to achieve tractability, and show that there are large classes of global constraints that also possess these properties. This allows us to lift these restrictions to the global case, and identify new tractable classes of CSPs with global constraints.

Artificial Intelligence
Counting the Number of Solutions to Constraints

Jian Zhang,Cunjing Ge,Feifei Ma

DOI: https://doi.org/10.48550/arxiv.2012.14366

2020-01-01

Abstract: Compared with constraint satisfaction problems, counting problems have received less attention. In this paper, we survey research works on the problems of counting the number of solutions to constraints. The constraints may take various forms, including, formulas in the propositional logic, linear inequalities over the reals or integers, Boolean combination of linear constraints. We describe some techniques and tools for solving the counting problems, as well as some applications (e.g., applications to automated reasoning, program analysis, formal verification and information security).
Structural Decompositions for Problems with Global Constraints

Evgenij Thorstensen

DOI: https://doi.org/10.1007/s10601-015-9181-2

2015-02-09

Abstract:A wide range of problems can be modelled as constraint satisfaction problems (CSPs), that is, a set of constraints that must be satisfied simultaneously. Constraints can either be represented extensionally, by explicitly listing allowed combinations of values, or implicitly, by special-purpose algorithms provided by a solver. Such implicitly represented constraints, known as global constraints, are widely used; indeed, they are one of the key reasons for the success of constraint programming in solving real-world problems. In recent years, a variety of restrictions on the structure of CSP instances have been shown to yield tractable classes of CSPs. However, most such restrictions fail to guarantee tractability for CSPs with global constraints. We therefore study the applicability of structural restrictions to instances with such constraints. We show that when the number of solutions to a CSP instance is bounded in key parts of the problem, structural restrictions can be used to derive new tractable classes. Furthermore, we show that this result extends to combinations of instances drawn from known tractable classes, as well as to CSP instances where constraints assign costs to satisfying assignments.

Artificial Intelligence

Constraint satisfaction problem and universal algebra

Proof complexity of universal algebra in a CSP dichotomy proof

Algebraic Global Gadgetry for Surjective Constraint Satisfaction

Time Complexity of Constraint Satisfaction via Universal Algebra

Constraint Satisfaction Tractability from Semi-lattice Operations on Infinite Sets

CSPs with Few Alien Constraints

Fine-Grained Time Complexity of Constraint Satisfaction Problems

Constraint Satisfaction Problems around Skolem Arithmetic

Logic Column 17: A Rendezvous of Logic, Complexity, and Algebra

Separation of congruence intervals and implications

A Unifying Framework for Structural Properties of CSPs: Definitions, Complexity, Tractability

Semantic Width and the Fixed-Parameter Tractability of Constraint Satisfaction Problems

Streaming and Sketching Complexity of CSPs: A survey

An invitation to the promise constraint satisfaction problem

Meditations on Quantified Constraint Satisfaction

The complexity of global cardinality constraints

Satisfiability of commutative vs. non-commutative CSPs

Lifting Structural Tractability to CSP with Global Constraints

Counting the Number of Solutions to Constraints

Structural Decompositions for Problems with Global Constraints