A Transition Matrix Model of Local Search Algorithm for Satisfiability Problem

ZENG Weiling,ZHOU Zhi,HUANG Liusheng

DOI: https://doi.org/10.3969/j.issn.1000-3428.2006.03.072

2006-01-01

Abstract:This paper makes a statistical analysis on some attributes of search space first,then models in track of algorithms and gets the transition matrix model of them.These experiments also show that the model is accords with practice.

What problem does this paper attempt to address?

A Differential Testing Approach for Evaluating Abstract Syntax Tree Mapping Algorithms

Yuanrui Fan,Xin Xia,David Lo,Ahmed E. Hassan,Yuan Wang,Shanping Li

DOI: https://doi.org/10.1109/icse43902.2021.00108

2021-01-01

Abstract:Abstract syntax tree (AST) mapping algorithms are widely used to analyze changes in source code. Despite the foundational role of AST mapping algorithms, little effort has been made to evaluate the accuracy of AST mapping algorithms, i.e., the extent to which an algorithm captures the evolution of code. We observe that a program element often has only one best-mapped program element. Based on this observation, we propose a hierarchical approach to automatically compare the similarity of mapped statements and tokens by different algorithms. By performing the comparison, we determine if each of the compared algorithms generates inaccurate mappings for a statement or its tokens. We invite 12 external experts to determine if three commonly used AST mapping algorithms generate accurate mappings for a statement and its tokens for 200 statements. Based on the experts' feedback, we observe that our approach achieves a precision of 0.98-1.00 and a recall of 0.65-0.75. Furthermore, we conduct a large-scale study with a dataset of ten Java projects containing a total of 263,165 file revisions. Our approach determines that GumTree, MTDiff and IJM generate inaccurate mappings for 20%-29%, 25%-36% and 21%-30% of the file revisions, respectively. Our experimental results show that state-of-the-art AST mapping algorithms still need improvements.
Phase transition for Local Search on planted SAT

Andrei A. Bulatov,Evgeny S. Skvortsov

DOI: https://doi.org/10.48550/arXiv.0811.2546

2008-11-16

Abstract:The Local Search algorithm (or Hill Climbing, or Iterative Improvement) is one of the simplest heuristics to solve the Satisfiability and Max-Satisfiability problems. It is a part of many satisfiability and max-satisfiability solvers, where it is used to find a good starting point for a more sophisticated heuristics, and to improve a candidate solution. In this paper we give an analysis of Local Search on random planted 3-CNF formulas. We show that if there is k<7/6 such that the clause-to-variable ratio is less than k ln(n) (n is the number of variables in a CNF) then Local Search whp does not find a satisfying assignment, and if there is k>7/6 such that the clause-to-variable ratio is greater than k ln(n)$ then the local search whp finds a satisfying assignment. As a byproduct we also show that for any constant r there is g such that Local Search applied to a random (not necessarily planted) 3-CNF with clause-to-variable ratio r produces an assignment that satisfies at least gn clauses less than the maximal number of satisfiable clauses.

Data Structures and Algorithms,Logic in Computer Science
Complete Boolean Satisfiability Solving Algorithms Based on Local Search

Wen-Sheng Guo,Guo-Wu Yang,William N. N. Hung,Xiaoyu Song

DOI: https://doi.org/10.1007/s11390-013-1326-4

2013-01-01

Abstract:Boolean satisfiability (SAT) is a well-known problem in computer science, artificial intelligence, and operations research. This paper focuses on the satisfiability problem of Model RB structure that is similar to graph coloring problems and others. We propose a translation method and three effective complete SAT solving algorithms based on the characterization of Model RB structure. We translate clauses into a graph with exclusive sets and relative sets. In order to reduce search depth, we determine search order using vertex weights and clique in the graph. The results show that our algorithms are much more effective than the best SAT solvers in numerous Model RB benchmarks, especially in those large benchmark instances.
Local Search for Solving Satisfiability of Polynomial Formulas

Haokun Li,Bican Xia,Tianqi Zhao

DOI: https://doi.org/10.1007/978-3-031-37703-7_5

2023-01-01

Abstract:Satisfiability Modulo the Theory of Nonlinear Real Arithmetic, SMT(NRA) for short, concerns the satisfiability of polynomial formulas, which are quantifier-free Boolean combinations of polynomial equations and inequalities with integer coefficients and real variables. In this paper, we propose a local search algorithm for a special subclass of SMT(NRA), where all constraints are strict inequalities. An important fact is that, given a polynomial formula with n variables, the zero level set of the polynomials in the formula decomposes the n-dimensional real space into finitely many components (cells) and every polynomial has constant sign in each cell. The key point of our algorithm is a new operation based on real root isolation, called cell-jump, which updates the current assignment along a given direction such that the assignment can `jump' from one cell to another. One cell-jump may adjust the values of several variables while traditional local search operations, such as flip for SAT and critical move for SMT(LIA), only change that of one variable. We also design a two-level operation selection to balance the success rate and efficiency. Furthermore, our algorithm can be easily generalized to a wider subclass of SMT(NRA) where polynomial equations linear with respect to some variable are allowed. Experiments show the algorithm is competitive with state-of-the-art SMT solvers, and performs particularly well on those formulas with high-degree polynomials.
Local and Global Behavior for Algorithms of Solving Equations

Xinghua Wang,Chong Li

DOI: https://doi.org/10.1007/bf03187252

2001-01-01

Chinese Science Bulletin

Abstract:The theory of 'point estimate' and the concept of 'general convergence', which were put forward by Smale in order to investigate the complexity of algorithms for solving equations, have been producing a deep impact on the research about the local behavior, the semi-local behavior and the global behavior of iteration methods. The criterion of point estimate introduced by him not only provides a tool for quantitative analysis of the local behavior but also motivates the establishing of the unified determination for the semi-local behavior. Studying the global behavior in the view of discrete dynamical system will lead to many profound research subjects and open up a rich and colorful prospect. In this review, we will make a summarization about the research progress and some applications in nonsmooth optimizations.
Improving Two-mode Algorithm Via Probabilistic Selection for Solving Satisfiability Problem

Huimin Fu,Shaowei Cai,Guanfeng Wu,Jun Liu,Xin Yang,Yang Xu

DOI: https://doi.org/10.1016/j.ins.2023.119751

IF: 8.1

2023-10-08

Information Sciences

Abstract:The satisfiability problem (SAT) is a critically important issue in multiple branches of computer science and artificial intelligence, with its relevance in industrial applications being of particular Significance CCAnr is the current leading stochastic local search (SLS) solver for tackling crafted satisfiable instances. It uses a two-mode strategy, greedy mode and diversification mode. In the present work, we employ a probabilistic selection approach to enhance CCAnr, leading to a new algorithm called ProbCCAnr. Experiments are carried out using the random SAT benchmarks and structured SAT benchmarks including instances encoded from mathematical problems and application problems. The experiments demonstrate that ProbCCAnr significantly improves the performance of state-of-the-art SLS algorithms including CCAnr and ProbSAT, among others. Moreover, ProbCCAnr shows better performance than state of the art complete solvers.

computer science, information systems
Stochastic Local Search Using the Search Space Smoothing Meta-Heuristic: A Case Study.

Sheqin Dong,Fan Guo,Jun Yuan,Rensheng Wang,Xianlong Hong

DOI: https://doi.org/10.2991/jcis.2006.213

2006-01-01

Abstract:In this paper, two smoothing effects are firstly pointed out by analysis and by experiment on Traveling Salesman Problem(TSP) instances. We design a novel algorithm which runs stochastic local search under the SSS framework. The function determining the accepting probability of uphill moves is designed so that the algorithm can take advantage of the local smoothing effect ignored in original SSS. Experimental results on TSPLIB instances demonstrated that the performance of the new algorithm is much superior to traditional SSS approach.
Two Spatial Constraint Solving Algorithms

刘生礼,唐敏,董金祥

DOI: https://doi.org/10.3321/j.issn:1003-9775.2003.08.020

2003-01-01

Abstract:Analytic solution of a constraint template composed of three points and three planes is presented to enrich the graph-based algorithm. Genetic simulated annealing algorithm (SAGA) is integrated with spatial constraint solving further that not only overcomes the shortcomings of poor extensibility of the graph-based algorithm, but also handles over- and under- constrained systems. In the end, we solve the above constraint problem with SAGA and compare the two algorithms.
An algorithm based on tabu search for satisfiability problem

Wenqi Huang,Defu Zhang,Houxiang Wang

DOI: https://doi.org/10.1007/BF02947312

IF: 1.871

2002-01-01

Journal of Computer Science and Technology

Abstract:In this paper, a computationally effective algorithm based on tabu search for solving the satisfiability problem (TSSAT) is proposed. Some novel and efficient heuristic strategies for generating candidate neighborhood of the current assignment and selecting variables to be flipped are presented. Especially, the aspiration criterion and tabu list structure of TSSAT are different from those of traditional tabu search. Computational experiments on a class of problem instances show that, TSSAT, in a reasonable amount of computer time, yields better results than Novelty which is currently among the fastest known. Therefore, TSSAT is feasible and effective.
A Hybrid Simplex-Harmony Search Algorithm and Its Application to Model Reduction of Linear Systems

Peng Cheng,Wang Yong

2010-01-01

Abstract:To improve the local search ability of the basic harmony search algorithm, a hybrid algorithm that combines harmony search algorithm and concurrent simplex method is proposed. The performance of the hybrid simplex-harmony search algorithm is investigated and compared with the basic harmony search algorithm and two other heuristics through benchmark function optimization problems. The hybrid algorithm is then used to solve the model reduction problems. Simulation results demonstrate the effectiveness of the proposed hybrid algorithm.
Improving Local Minima of Columnar Competitive Model for TSPs.

Hong Qu,Zhang Yi,Huajin Tang

DOI: https://doi.org/10.1109/tcsi.2006.874180

2006-01-01

IEEE Transactions on Circuits and Systems I Fundamental Theory and Applications

Abstract:The columnar competitive model (CCM) has been recently proposed to solve the traveling salesman problem. This method performs much better than the original Hopfield network in terms of both the number and the quality of valid solutions. However, the local minima is still an open unsolved issue. This paper studies the performance of the CCM and aims to improve its local minima problem. The contributions of this paper are: 1) it proves by mathematics that the CCM is hardly to escape from local minimum states in general; 2) an alternate CCM is presented based on a modified energy function so as to enhance the capability of the original CCM; 3) a new algorithm is proposed by combining the alternative CCM with the original one, which enables the network to have lower energy level when trapped in local minima, this makes the network to reach the optimal or near-optimal state quickly; 4) Simulations are carried out to illustrate the performance of the proposed method.
A Combined Global And Local Search Method To Deal With Constrained Optimization For Continuous Tabu Search

Xi Chen,Jing Yang,Zhaohua Li,Daqing Tian,Zhijiang Shao

DOI: https://doi.org/10.1002/nme.2393

IF: 3.021

2008-01-01

International Journal for Numerical Methods in Engineering

Abstract:Heuristic methods, Such as tabu Search, are efficient for global optimizations. Most studies, however, have focused on constraint-free optimizations. Penalty functions are commonly used to deal with constraints for global optimization algorithms in dealing with constraints. This is sometimes inefficient, especially for equality constraints, as it is difficult to keel) the global search within the feasible region by purely adding a penalty to the objective function. A combined global and local search method is proposed in this paper to deal with constrained optimizations. It is demonstrated by combining Continuous tabu search (CTS) and sequential quadratic programming (SQP) methods. First, a nested inner- and outer-loop method is presented to lead the search within the feasible region. SQP, a typical local search method, is used to quickly solve a non-linear programming purely for constraints in the inner loop and provides feasible neighbors for the outer loop. CTS, in the outer loop, is used to seek for the global optimal. Finally, another local search using SQP is conducted with the results of CTS as initials to refine the global search results. Efficiency is demonstrated by a number of benchmark problems. Copyright (C) 2008 John Wiley & Sons, Ltd.
More efficient stochastic local search for satisfiability

Huimin Fu,Guanfeng Wu,Jun Liu,Yang Xu

DOI: https://doi.org/10.1007/s10489-020-01983-y

IF: 5.3

2020-11-25

Applied Intelligence

Abstract:Uniform random satisfiability (URS) and hard random satisfiability (HRS) are two significant generalizations of random satisfiability (RS). Recently, great breakthroughs have been made on stochastic local search (SLS) algorithms for uniform RS, resulting in several state-of-the-art algorithms, e.g., Dimetheus, YalSAT, ProbSAT and Score2SAT. However, compared to the great progress of SLS on URS, the performance of SLS on HRS lags far behind. In this paper, we propose two global clause weighting schemes and a new hybrid scoring function called SA based on a linear combination of a property score and property age, and then apply a second-level-biased random walk strategy based on two clause weighting schemes and SA to develop a new SLS solver called BRSAP. To evaluate the performance of BRSAP, we conduct extensive experiments to compare BRSAP with state-of-the-art SLS solvers and complete solvers on HRS instances and URS instances from SAT Competition 2017 and SAT Competition 2018 as well as 4100 generated satisfiable large HRS and URS ones. The experiments illustrate that BRSAP obviously outperforms its competitors, indicating the effectiveness of BRSAP. We also analyze the effectiveness of the underlying ideas in BRSAP.

computer science, artificial intelligence
Finding Unsatisfiable Subformulas With Stochastic Method

Jianmin Zhang,Shengyu Shen,Sikun Li

DOI: https://doi.org/10.1007/978-3-540-77226-2_40

2007-01-01

Abstract:Explaining the causes of infeasibility of Boolean formulas has many practical applications in various fields. A small unsatisfiable subformula provides a succinct explanation of infeasibility and is valuable for applications. In recent years the problem of finding unsatisfiable subformulas has been addressed frequently by research works, which are mostly based on the SAT solvers with DPLL backtrack-search algorithm. However little attention has been concentrated on extraction of unsatisfiable subformulas using stochastic methods. In this paper, we propose a resolution-based stochastic local search algorithm to derive unsatisfiable subformulas. This approach directly constructs the resolution sequences for proving unsatisfiability with a local search procedure, and then extracts small unsatisfiable subformulas from the refutation traces. We report and analyze the experimental results on benchmarks.
Diversification and determinism in local search for satisfiability

Chu Min Li,Wen Qi Huang

DOI: https://doi.org/10.1007/11499107_12

2005-01-01

Abstract:The choice of the variable to flip in the Walksat family procedures is always random in that it is selected from a randomly chosen unsatisfied clause c. This choice in Novelty or R-Novelty heuristics also contains some determinism in that the variable to flip is always limited to the two best variables in c. In this paper, we first propose a diversification parameter for Novelty (or R-Novelty) heuristic to break the determinism in Novelty and show its performance compared with the random walk parameter in Novelty+. Then we exploit promising decreasing paths in a deterministic fashion in local search using a gradient-based approach. In other words, when promising decreasing paths exist, the variable to flip is no longer selected from a randomly chosen unsatisfied clause but in a deterministic fashion to surely decrease the number of unsatisfied clauses. Experimental results show that the proposed diversification and the determinism allow to significantly improve Novelty (and Walksat).
NLocalSAT: Boosting Local Search with Solution Prediction

Wenjie Zhang,Zeyu Sun,Qihao Zhu,Ge Li,Shaowei Cai,Yingfei Xiong,Lu Zhang

DOI: https://doi.org/10.24963/ijcai.2020/164

2020-01-01

Abstract:The Boolean satisfiability problem (SAT) is a famous NP-complete problem in computer science. An effective way for solving a satisfiable SAT problem is the stochastic local search (SLS). However, in this method, the initialization is assigned in a random manner, which impacts the effectiveness of SLS solvers. To address this problem, we propose NLocalSAT. NLocalSAT combines SLS with a solution prediction model, which boosts SLS by changing initialization assignments with a neural network. We evaluated NLocalSAT on five SLS solvers (CCAnr, Sparrow, CPSparrow, YalSAT, and probSAT) with instances in the random track of SAT Competition 2018. The experimental results show that solvers with NLocalSAT achieve 27% ~ 62% improvement over the original SLS solvers.
Efficient Local Search for Nonlinear Real Arithmetic

Zhonghan Wang,Bohua Zhan,Bohan Li,Shaowei Cai

2023-11-24

Abstract:Local search has recently been applied to SMT problems over various arithmetic theories. Among these, nonlinear real arithmetic poses special challenges due to its uncountable solution space and potential need to solve higher-degree polynomials. As a consequence, existing work on local search only considered fragments of the theory. In this work, we analyze the difficulties and propose ways to address them, resulting in an efficient search algorithm that covers the full theory of nonlinear real arithmetic. In particular, we present two algorithmic improvements: incremental computation of variable scores and temporary relaxation of equality constraints. We also discuss choice of candidate moves and a look-ahead mechanism in case when no critical moves are available. The resulting implementation is competitive on satisfiable problem instances against complete methods such as MCSAT in existing SMT solvers.

Symbolic Computation
Local search for the Traveling Salesman Problem: A comparative study

Yuezhong Wu,Thomas Weise,Raymond Chiong

DOI: https://doi.org/10.1109/ICCI-CC.2015.7259388

2015-01-01

Abstract:The Traveling Salesman Problem (TSP) is one of the most well-studied combinatorial optimization problems. Best heuristics for solving the TSP known today are Lin-Kernighan (LK) local search methods. Recently, Multi-Neighborhood Search (MNS) has been proposed and was demonstrated to outperform Variable Neighborhood Search based methods on the TSP. While LK performs a variable k-opt based search operation, MNS is able to carry out multiple 2-, 3-, or 4-opt moves at once, which are discovered by a highly efficient scan of the current solution. Apart from LK and MNS, many other modern heuristics for TSPs can be found in the relevant literature. However, existing studies rarely use robust statistics for the heuristic algorithms in comparison, let alone investigate their progress over time. This leads to flawed comparisons of simple end-of-run statistics and inappropriate or even incorrect conclusions. In this paper, we thoroughly compare LK and MNS as well as their hybrid versions with Evolutionary Algorithms (EAs) and Population-based Ant Colony Optimization (PACO). This work, to the best of our knowledge, is the first statistically sound comparison of the two efficient heuristics as well as their hybrids with EAs and PACO over time based on a large-scale experimental study. We not only show that hybrid PACO-MNS and PACO-LK are both very efficient, but also find that the full runtime behavior comparison provides deeper and clearer insights whereas a focus of final results could indeed have led to a deceitful conclusion.
The Underlying Interactive Chain Structure In The Solution Space Of Constraint Satisfaction Problems

wei wei,binghui guo,zhiming zheng

DOI: https://doi.org/10.1115/1.859681.paper33

2010-01-01

Abstract:Constraint satisfaction problems are considered one of the basic literatures in artificial intelligence. In this paper we focus on the typical structure of solution space of the constraint satisfaction problem. By analyzing the decision correlations among variables, a novel structure of the organization of solution space named interactive chain is proposed. Furthermore, taking k-SAT problem and massive algebraic system model as examples, we calculate the fraction of variables belonging to the interactive chain respectively by techniques of dynamical analysis. This type of structure is supposed to be helpful to explore the origin of computational complexity and design more efficient search algorithms for constraint satisfaction problems.
Local Search Based on a Physical Model for Solving a Circle Packing Problem

wenqi huang,yu li,ruchu xu

2001-01-01

Abstract:Abstract: this paper, we propose to solve this problem by a local search algorithmbased on a physical model with a strategy to escape from local minimum inspired from a social behavior.The work is the continuation and development of our researches carried out since 1979 [7] [8] [9] in thefield of algorithm complexity and its application

A Transition Matrix Model of Local Search Algorithm for Satisfiability Problem

A Differential Testing Approach for Evaluating Abstract Syntax Tree Mapping Algorithms

Phase transition for Local Search on planted SAT

Complete Boolean Satisfiability Solving Algorithms Based on Local Search

Local Search for Solving Satisfiability of Polynomial Formulas

Local and Global Behavior for Algorithms of Solving Equations

Improving Two-mode Algorithm Via Probabilistic Selection for Solving Satisfiability Problem

Stochastic Local Search Using the Search Space Smoothing Meta-Heuristic: A Case Study.

Two Spatial Constraint Solving Algorithms

An algorithm based on tabu search for satisfiability problem

A Hybrid Simplex-Harmony Search Algorithm and Its Application to Model Reduction of Linear Systems

Improving Local Minima of Columnar Competitive Model for TSPs.

A Combined Global And Local Search Method To Deal With Constrained Optimization For Continuous Tabu Search

More efficient stochastic local search for satisfiability

Finding Unsatisfiable Subformulas With Stochastic Method

Diversification and determinism in local search for satisfiability

NLocalSAT: Boosting Local Search with Solution Prediction

Efficient Local Search for Nonlinear Real Arithmetic

Local search for the Traveling Salesman Problem: A comparative study

The Underlying Interactive Chain Structure In The Solution Space Of Constraint Satisfaction Problems

Local Search Based on a Physical Model for Solving a Circle Packing Problem