Abstract:Combinatorial optimization problems define fitness landscapes that combine the numerics of the 'fitness' function to be maximized with the combinatorics of which assignments are adjacent. Local search starts at an initial assignment in this landscape and successively moves to assignments until no further improvement is possible among the adjacent assignments. Classic analyses of local search algorithms have focused mostly on the question of effectiveness ("did the algorithm find a good solution?") and often implicitly assumed that there are no doubts about their efficiency ("did the algorithm find the solution quickly?"). But there are many reasons to doubt the efficiency of local search. Many local search algorithms are known to be inefficient even if we focus on fitness landscapes on the hypercube that are single peaked on every subcube (known as semismooth fitness landscapes, completely unimodal pseudo-Boolean functions, or acyclic unique sink orientations). Here, we want to identify the most expressive subclass of single-peaked binary Boolean valued constraint satisfaction problems for which many popular local search algorithms are efficient. In this paper, we introduce the class of conditionally-smooth fitness landscapes where the preferred assignment of a variable xj depends only on the assignments of variables xi with i less than j in an associated partial order. We prove that many popular local search algorithms like random ascent, simulated annealing, various jumping rules, and the Kernighan-Lin heuristic are very efficient on conditionally-smooth landscapes. Some other popular local search algorithms like steepest ascent and random facet, however, still require a super-polynomial number of steps on these landscapes. Our hope is to contribute to a fuller understanding of what properties fitness landscapes must have for local search algorithms to be both effective and efficient.

Barriers and local minima in energy landscapes of stochastic local search

Going after the k-SAT threshold

Local Quantum Search Algorithm for Random $k$-SAT with $Ω(n^{1+ε})$ Clauses

A Landscape Analysis of Constraint Satisfaction Problems

Limits of Sequential Local Algorithms on the Random $k$-XORSAT Problem

Using deep learning to construct stochastic local search SAT solvers with performance bounds

One-step replica symmetry breaking of random regular NAE-SAT I

The Algorithmic Phase Transition of Random $k$-SAT for Low Degree Polynomials

Counting random $k$-SAT near the satisfiability threshold

When is local search both effective and efficient?

The asymptotic k-SAT threshold

Linear Phase Transition in Random Linear Constraint Satisfaction Problem

Local geometry of NAE-SAT solutions in the condensation regime

Catching the k-NAESAT Threshold

Local algorithms and the failure of log-depth quantum advantage on sparse random CSPs

From one solution of a 3-satisfiability formula to a solution cluster: Frozen variables and entropy

Random local access for sampling k-SAT solutions

Phase transition for Local Search on planted SAT

Biased landscapes for random Constraint Satisfaction Problems

Strongly refuting random CSPs below the spectral threshold

The number of solutions for random regular NAE-SAT