Multi-objective Evolution of Heuristic Using Large Language Model

Shunyu Yao,Fei Liu,Xi Lin,Zhichao Lu,Zhenkun Wang,Qingfu Zhang

2024-09-25

Abstract:Heuristics are commonly used to tackle diverse search and optimization problems. Design heuristics usually require tedious manual crafting with domain knowledge. Recent works have incorporated large language models (LLMs) into automatic heuristic search leveraging their powerful language and coding capacity. However, existing research focuses on the optimal performance on the target problem as the sole objective, neglecting other criteria such as efficiency and scalability, which are vital in practice. To tackle this challenge, we propose to model heuristic search as a multi-objective optimization problem and consider introducing other practical criteria beyond optimal performance. Due to the complexity of the search space, conventional multi-objective optimization methods struggle to effectively handle multi-objective heuristic search. We propose the first LLM-based multi-objective heuristic search framework, Multi-objective Evolution of Heuristic (MEoH), which integrates LLMs in a zero-shot manner to generate a non-dominated set of heuristics to meet multiple design criteria. We design a new dominance-dissimilarity mechanism for effective population management and selection, which incorporates both code dissimilarity in the search space and dominance in the objective space. MEoH is demonstrated in two well-known combinatorial optimization problems: the online Bin Packing Problem (BPP) and the Traveling Salesman Problem (TSP). Results indicate that a variety of elite heuristics are automatically generated in a single run, offering more trade-off options than existing methods. It successfully achieves competitive or superior performance while improving efficiency up to 10 times. Moreover, we also observe that the multi-objective search introduces novel insights into heuristic design and leads to the discovery of diverse heuristics.

Artificial Intelligence

What problem does this paper attempt to address?

### The Problem This Paper Attempts to Solve

This paper aims to address the single-objective optimization issue in the automatic design of heuristic algorithms. Specifically:

1. **Multi-objective Optimization**:
- Existing research mainly focuses on the optimal performance of heuristic algorithms on specific problems, neglecting other practically important criteria (such as efficiency and scalability).
- The paper proposes modeling heuristic search as a multi-objective optimization problem, considering other practical criteria beyond optimal performance.

2. **Introduction of LLM**:
- Utilizing large language models (LLMs) to automatically generate heuristic algorithms and their code implementations.
- Proposes a framework called "Multi-objective Heuristic Evolution" (MEoH), which can generate a set of non-dominated heuristic algorithms in a single run, meeting multiple design criteria.

3. **Novel Mechanism**:
- Designs a new dominance-diversity mechanism for effectively managing and selecting the population, combining code diversity in the search space and dominance relationships in the objective space.

Through these methods, the paper demonstrates the application effects on two classic combinatorial optimization problems (the Bin Packing Problem [BPP] and the Traveling Salesman Problem [TSP]), proving the significant advantages of MEoH in terms of performance and efficiency.