Enumeration algorithms for combinatorial problems using Ising machines

Yuta Mizuno,Mohammad Ali,Tamiki Komatsuzaki

2024-11-30

Abstract:Combinatorial problems such as combinatorial optimization and constraint satisfaction problems arise in decision-making across various fields of science and technology. In real-world applications, when multiple optimal or constraint-satisfying solutions exist, enumerating all these solutions -- rather than finding just one -- is often desirable, as it provides flexibility in decision-making. However, combinatorial problems and their enumeration versions pose significant computational challenges due to combinatorial explosion. To address these challenges, we propose enumeration algorithms for combinatorial optimization and constraint satisfaction problems using Ising machines. Ising machines are specialized devices designed to efficiently solve combinatorial problems. Typically, they sample low-cost solutions in a stochastic manner. Our enumeration algorithms repeatedly sample solutions to collect all desirable solutions. The crux of the proposed algorithms is their stopping criteria for sampling, which are derived based on probability theory. In particular, the proposed algorithms have theoretical guarantees that the failure probability of enumeration is bounded above by a user-specified value, provided that lower-cost solutions are sampled more frequently and equal-cost solutions are sampled with equal probability. Many physics-based Ising machines are expected to (approximately) satisfy these conditions. As a demonstration, we applied our algorithm using simulated annealing to maximum clique enumeration on random graphs. We found that our algorithm enumerates all maximum cliques in large dense graphs faster than a conventional branch-and-bound algorithm specially designed for maximum clique enumeration. This demonstrates the promising potential of our proposed approach.

Data Structures and Algorithms,Quantum Physics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the solution enumeration problem in combinatorial optimization and constraint satisfaction problems. Specifically, when there are multiple optimal or constraint - satisfying solutions, enumerating all of these solutions rather than just finding one solution is often more desirable in practical applications because it provides flexibility for decision - making. However, due to combinatorial explosion, these problems and their enumeration versions are computationally very challenging. To this end, the author proposes an enumeration algorithm using Ising machines to solve these problems.

### Background of the Paper and Problem Definition
1. **Combinatorial Optimization and Constraint Satisfaction Problems**
- Combinatorial optimization is the process of choosing the optimal option from a finite discrete set of solutions.
- Constraint satisfaction is the process of finding a feasible solution that satisfies specific constraint conditions without optimizing any criteria.
- These problems are widely present in science, industry, and other real - world applications.

2. **Importance of Solution Enumeration**
- When there are multiple target solutions (i.e., optimal solutions or solutions that satisfy constraints), enumerating all of these solutions rather than just finding one solution can provide greater flexibility for decision - making.
- For example, decision - makers can choose the best solution according to additional preferences or constraints that were not captured in the initial problem modeling.

3. **Computational Challenges**
- Many combinatorial problems are NP - hard, which means that in the worst - case scenario, the computational time required to solve the problem grows exponentially with the problem size.
- Enumerating all solutions usually requires more computational effort than finding one solution.

### Solutions
1. **Ising Machines**
- Ising machines are devices specifically designed to efficiently solve combinatorial problems.
- They usually work by randomly sampling low - energy solutions.
- The enumeration algorithm proposed by the author collects all desired solutions through repeated sampling.

2. **Stopping Criteria**
- The key lies in determining when to stop sampling. The author derives effective stopping criteria based on probability theory.
- The proposed algorithm has a theoretical guarantee that the probability of enumeration failure is bounded within a user - specified value, provided that lower - cost solutions are sampled more frequently and solutions with the same cost are sampled with equal probability.

3. **Algorithm Application**
- As a demonstration, the author applies the algorithm to the maximum clique enumeration problem on random graphs using simulated annealing (SA).
- The results show that the algorithm enumerates all maximum cliques on large - scale dense graphs faster than the traditional branch - and - bound algorithm.

### Formulas and Technical Details
- **Ising Model**
\[
\text{minimize} \quad H_{\text{Ising}}(\sigma)=-\sum_{i = 1}^{N - 1}\sum_{j = i + 1}^N J_{ij}\sigma_i\sigma_j-\sum_{i = 1}^N h_i\sigma_i
\]
where \( N \) is the number of spin variables, \( \sigma_i \) is the \( i \)-th spin variable, \( J_{ij} \) is the interaction coefficient between two spins, and \( h_i \) is the local field interacting with \( \sigma_i \).

- **Fair Sampling Conditions**
\[
\begin{cases}
H_{\text{Ising}}(\sigma_1)<H_{\text{Ising}}(\sigma_2)\Rightarrow p_{\text{Ising}}(\sigma_1)\geq p_{\text{Ising}}(\sigma_2),\\
H_{\text{Ising}}(\sigma_1)=H_{\text{Ising}}(\sigma_2)\Rightarrow p_{\text{Ising}}(\sigma_1)=p_{\text{Ising}}(\sigma_2).
\end{cases}
\]

- **Stopping Criteria**