Abstract:We propose an incomplete algorithm for Maximum Satisfiability (MaxSAT) specifically designed to run on neural network accelerators such as GPUs and TPUs. Given a MaxSAT problem instance in conjunctive normal form, our procedure constructs a Restricted Boltzmann Machine (RBM) with an equilibrium distribution wherein the probability of a Boolean assignment is exponential in the number of clauses it satisfies. Block Gibbs sampling is used to stochastically search the space of assignments with parallel Markov chains. Since matrix multiplication is the main computational primitive for block Gibbs sampling in an RBM, our approach leads to an elegantly simple algorithm (40 lines of JAX) well-suited for neural network accelerators. Theoretical results about RBMs guarantee that the required number of visible and hidden units of the RBM scale only linearly with the number of variables and constant-sized clauses in the MaxSAT instance, ensuring that the computational cost of a Gibbs step scales reasonably with the instance size. Search throughput can be increased by batching parallel chains within a single accelerator as well as by distributing them across multiple accelerators. As a further enhancement, a heuristic based on unit propagation running on CPU is periodically applied to the sampled assignments. Our approach, which we term RbmSAT, is a new design point in the algorithm-hardware co-design space for MaxSAT. We present timed results on a subset of problem instances from the annual MaxSAT Evaluation's Incomplete Unweighted Track for the years 2018 to 2021. When allotted the same running time and CPU compute budget (but no TPUs), RbmSAT outperforms other participating solvers on problems drawn from three out of the four years' competitions. Given the same running time on a TPU cluster for which RbmSAT is uniquely designed, it outperforms all solvers on problems drawn from all four years.

An Improved GPU-Based SAT Model Counter

Weighted Model Counting on the GPU by Exploiting Small Treewidth

GANAK: A Scalable Probabilistic Exact Model Counter

GPU Accelerated Counterexample Generation in LTL Model Checking.

Implementation of Tetris as a Model Counter

Symmetric Component Caching for Model Counting on Combinatorial Instances

Learning Branching Heuristics for Propositional Model Counting

GpuShareSat: a SAT solver using the GPU for clause sharing

torchmSAT: A GPU-Accelerated Approximation To The Maximum Satisfiability Problem

An Efficient SAT-Based Test Generation Algorithm with GPU Accelerator

High-Efficiency Compressor Trees for Latest AMD FPGAs

Parallel Weighted Model Counting with Tensor Networks

FPGAs (Can Get Some) SATisfaction

Accelerating an FPGA-Based SAT Solver by Software and Hardware Co-design

SMPP: Generic SAT Solver over Reconfigurable Hardware Accelerator

SKI-SAT: A CMOS-compatible Hardware for Solving SAT Problems

Solving MaxSAT with Matrix Multiplication

BIRD: Engineering an Efficient CNF-XOR SAT Solver and Its Applications to Approximate Model Counting

Guiding High-Performance SAT Solvers with Unsat-Core Predictions

3-Regular 3-XORSAT Planted Solutions Benchmark of Classical and Quantum Heuristic Optimizers

Solving Projected Model Counting by Utilizing Treewidth and its Limits