Abstract:Combinatorial optimization problems define fitness landscapes that combine the numerics of the 'fitness' function to be maximized with the combinatorics of which assignments are adjacent. Local search starts at an initial assignment in this landscape and successively moves to assignments until no further improvement is possible among the adjacent assignments. Classic analyses of local search algorithms have focused mostly on the question of effectiveness ("did the algorithm find a good solution?") and often implicitly assumed that there are no doubts about their efficiency ("did the algorithm find the solution quickly?"). But there are many reasons to doubt the efficiency of local search. Many local search algorithms are known to be inefficient even if we focus on fitness landscapes on the hypercube that are single peaked on every subcube (known as semismooth fitness landscapes, completely unimodal pseudo-Boolean functions, or acyclic unique sink orientations). Here, we want to identify the most expressive subclass of single-peaked binary Boolean valued constraint satisfaction problems for which many popular local search algorithms are efficient. In this paper, we introduce the class of conditionally-smooth fitness landscapes where the preferred assignment of a variable xj depends only on the assignments of variables xi with i less than j in an associated partial order. We prove that many popular local search algorithms like random ascent, simulated annealing, various jumping rules, and the Kernighan-Lin heuristic are very efficient on conditionally-smooth landscapes. Some other popular local search algorithms like steepest ascent and random facet, however, still require a super-polynomial number of steps on these landscapes. Our hope is to contribute to a fuller understanding of what properties fitness landscapes must have for local search algorithms to be both effective and efficient.

Exploiting variable associations to configure efficient local search algorithms in large-scale binary integer programs

Fast Local Search Strategies for Large-Scale General Quadratic Integer Programming

Iterated Local Search with Linkage Learning

A Variable Search Space Strategy Based on Sequential Trust Region Determination Technique

When is local search both effective and efficient?

Unveiling the Limits of Learned Local Search Heuristics: Are You the Mightiest of the Meek?

New Characterizations and Efficient Local Search for General Integer Linear Programming

Exploiting Problem Structure in Combinatorial Landscapes: a Case Study on Pure Mathematics Application

Learning a Large Neighborhood Search Algorithm for Mixed Integer Programs

A Hybrid Method of Combinatorial Search and Coordinate Descent for Discrete Optimization

Mathematical discoveries from program search with large language models

A study on exponential-size neighborhoods for the bin packing problem with conflicts

Variable Neighborhood Search for the University Lecturer-Student Assignment Problem

Learning to project in a criterion space search algorithm: an application to multi-objective binary linear programming

An Improved Particle Swarm Optimization Algorithm Based on Variable Neighborhood Search

New techniques to improve neighborhood exploration in pareto local search

Minimizing UCB: a Better Local Search Strategy in Local Bayesian Optimization

A Symmetric Points Search and Variable Grouping Method for Large-scale Multi-objective Optimization.

A Two Phase Approach Based on Dynamic Variable Grouping and Self-Adaptive Group Search for Large Scale Optimization

Learning to Search Efficiently in High Dimensions.

A Local Search Algorithm for MaxSMT(LIA)