Abstract:Combinatorial optimization problems define fitness landscapes that combine the numerics of the 'fitness' function to be maximized with the combinatorics of which assignments are adjacent. Local search starts at an initial assignment in this landscape and successively moves to assignments until no further improvement is possible among the adjacent assignments. Classic analyses of local search algorithms have focused mostly on the question of effectiveness ("did the algorithm find a good solution?") and often implicitly assumed that there are no doubts about their efficiency ("did the algorithm find the solution quickly?"). But there are many reasons to doubt the efficiency of local search. Many local search algorithms are known to be inefficient even if we focus on fitness landscapes on the hypercube that are single peaked on every subcube (known as semismooth fitness landscapes, completely unimodal pseudo-Boolean functions, or acyclic unique sink orientations). Here, we want to identify the most expressive subclass of single-peaked binary Boolean valued constraint satisfaction problems for which many popular local search algorithms are efficient. In this paper, we introduce the class of conditionally-smooth fitness landscapes where the preferred assignment of a variable xj depends only on the assignments of variables xi with i less than j in an associated partial order. We prove that many popular local search algorithms like random ascent, simulated annealing, various jumping rules, and the Kernighan-Lin heuristic are very efficient on conditionally-smooth landscapes. Some other popular local search algorithms like steepest ascent and random facet, however, still require a super-polynomial number of steps on these landscapes. Our hope is to contribute to a fuller understanding of what properties fitness landscapes must have for local search algorithms to be both effective and efficient.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: **Under what circumstances are local search algorithms both effective and efficient?** Specifically, the paper explores the performance of local search algorithms in combinatorial optimization problems. Local search algorithms start from an initial solution and gradually move among neighboring solutions until no further improvement can be made. Traditionally, the analysis of local search algorithms has mainly focused on effectiveness (whether a good solution has been found), and usually implicitly assumes that these algorithms are efficient (i.e., quickly find a solution). However, this assumption does not always hold, especially on certain types of fitness landscapes, where many local search algorithms may be inefficient. ### Core problems of the paper 1. **Characteristics of fitness landscapes**: - The author focuses on which fitness landscapes enable local search algorithms to find the global optimal solution and ensure computational efficiency at the same time. - In particular, they study a subclass of single - peaked binary Boolean valued constraint satisfaction problems, called conditionally - smooth fitness landscapes. 2. **Conditionally - smooth fitness landscapes**: - A conditionally - smooth fitness landscape means that under a partial order, the optimal assignment of each variable \(x_j\) only depends on the assignments of all variables \(x_i\) in the partial order that are less than \(j\). - This structure makes many popular local search algorithms (such as random hill - climbing, simulated annealing, jump rules, and Kernighan - Lin heuristic algorithms) show high efficiency on these landscapes. 3. **Conditions for identifying efficient algorithms**: - The author proposes how to identify which local search algorithms are efficient on conditionally - smooth fitness landscapes and proves that some common algorithms can indeed quickly converge to the optimal solution on this type of landscape. - At the same time, they also point out that some algorithms (such as the steepest hill - climbing and random - face algorithms) may require super - polynomial time to find the optimal solution even on conditionally - smooth landscapes. ### Main contributions - **Defining and identifying conditionally - smooth fitness landscapes**: The author introduces a new class of fitness landscapes - conditionally - smooth fitness landscapes, and provides methods for identifying this type of landscape. - **Proving the efficiency of multiple local search algorithms**: Through theoretical analysis, the author proves that many popular local search algorithms are efficient on conditionally - smooth fitness landscapes. - **Revealing the relationship between the effectiveness and efficiency of local search algorithms**: The author emphasizes the importance of the structural characteristics of fitness landscapes for the performance of local search algorithms, providing a new perspective for understanding the behavior of local search algorithms. In conclusion, this paper aims to deeply explore the performance of local search algorithms on different types of fitness landscapes, especially to find those landscape features that can ensure both effectiveness and improve efficiency.

When is local search both effective and efficient?

A novel stochastic method with modified extremal optimization and nearest neighbor search for hard combinatorial problems

A Combined Global And Local Search Method To Deal With Constrained Optimization For Continuous Tabu Search

Several Algorithms of Global Optimal Search

Local and Global Behavior for Algorithms of Solving Equations

Local Optima Networks: A New Model of Combinatorial Fitness Landscapes

Local Optima Networks, Landscape Autocorrelation and Heuristic Search Performance

Aggressive Local Search for Constrained Optimal Control Problems with Many Local Minima

Local search heuristics: Fitness Cloud versus Fitness Landscape

On Application of the Local Search and the Genetic Algorithms Techniques to Some Combinatorial Optimization Problems

A Hybrid Method of Combinatorial Search and Coordinate Descent for Discrete Optimization

The Influence of Local Search over Genetic Algorithms with Balanced Representations

DeciLS-PBO: an Effective Local Search Method for Pseudo-Boolean Optimization

Sequential Optimization in Locally Important Dimensions

New techniques to improve neighborhood exploration in pareto local search

Barriers and local minima in energy landscapes of stochastic local search

On the Smoothed Complexity of Combinatorial Local Search

Unveiling the Limits of Learned Local Search Heuristics: Are You the Mightiest of the Meek?

Learning to Control Local Search for Combinatorial Optimization

Landscape properties of the very large-scale and the variable neighborhood search metaheuristics for the multidimensional assignment problem

The Behavior and Convergence of Local Bayesian Optimization