Data-Efficient Interactive Multi-Objective Optimization Using ParEGO

Arash Heidari,Sebastian Rojas Gonzalez,Tom Dhaene,Ivo Couckuyt

2024-01-12

Abstract:Multi-objective optimization is a widely studied problem in diverse fields, such as engineering and finance, that seeks to identify a set of non-dominated solutions that provide optimal trade-offs among competing objectives. However, the computation of the entire Pareto front can become prohibitively expensive, both in terms of computational resources and time, particularly when dealing with a large number of objectives. In practical applications, decision-makers (DMs) will select a single solution of the Pareto front that aligns with their preferences to be implemented; thus, traditional multi-objective algorithms invest a lot of budget sampling solutions that are not interesting for the DM. In this paper, we propose two novel algorithms that employ Gaussian Processes and advanced discretization methods to efficiently locate the most preferred region of the Pareto front in expensive-to-evaluate problems. Our approach involves interacting with the decision-maker to guide the optimization process towards their preferred trade-offs. Our experimental results demonstrate that our proposed algorithms are effective in finding non-dominated solutions that align with the decision-maker's preferences while maintaining computational efficiency.

Neural and Evolutionary Computing

What problem does this paper attempt to address?

The paper primarily aims to address the issue of data efficiency in multi-objective optimization, especially in scenarios requiring substantial computational resources and time. Traditional methods often attempt to approximate the entire Pareto front before the decision-maker (DM) selects a solution that aligns with their preferences. This approach is neither efficient nor realistic in practical applications. Therefore, this paper proposes two new algorithms—Triangulation-based Preferred Region Exploration (TRIPE) and Weight Adjustment-based Preferred Region Exploration (WAPE). These algorithms utilize Gaussian processes and advanced discretization methods to effectively locate the most preferred regions of the Pareto front in expensive evaluation problems and guide the optimization process towards the decision-maker's preferences through interaction.

Specifically, the TRIPE method partitions the input space using Delaunay triangulation techniques and explores preferred regions based on the decision-maker's feedback. In contrast, the WAPE method encourages exploration of the decision-maker's preferred regions by adjusting scalarization weights. Both methods include an initialization phase and an exploration phase, with the initialization phase implemented based on the known ParEGO algorithm. Experimental results indicate that the proposed algorithms can find non-dominated solutions that align with the decision-maker's preferences while maintaining computational efficiency.