Abstract:Bilevel optimization involves two levels of optimization, where one optimization problem is nested within the other. The structure of the problem often requires solving a large number of inner optimization problems that make these kinds of optimization problems expensive to solve. The reaction set mapping and the lower level optimal value function mapping are often used to reduce bilevel optimization problems to a single level; however, the mappings are not known a priori, and the need is to be estimated. Though there exist a few studies that rely on the estimation of these mappings, they are often applied to problems where one of these mappings has a known form, that is, piecewise linear, convex, etc. In this article, we utilize both these mappings together to solve general bilevel optimization problems without any assumptions on the structure of these mappings. Kriging approximations are created during the generations of an evolutionary algorithm, where the population members serve as the samples for creating the approximations. One of the important features of the proposed algorithm is the creation of an auxiliary optimization problem using the Kriging-based metamodel of the lower level optimal value function that solves an approximate relaxation of the bilevel optimization problem. The auxiliary problem when used for local search is able to accelerate the evolutionary algorithm toward the bilevel optimal solution. We perform experiments on two sets of test problems and a problem from the domain of control theory. Our experiments suggest that the approach is quite promising and can lead to substantial savings when solving bilevel optimization problems. The approach is able to outperform state-of-the-art methods that are available for solving bilevel problems, in particular, the savings in function evaluations for the lower level problem are substantial with the proposed approach.

Solution polishing via path relinking for continuous black-box optimization

Piecewise Linear Plus Quadratic Surrogate Model for Real-Time Optimization

Discrete Dynamical System Approaches for Boolean Polynomial Optimization

B2Opt: Learning to Optimize Black-box Optimization with Little Budget

ParLS-PBO: A Parallel Local Search Solver for Pseudo Boolean Optimization

PolyCD: Optimization via Cycling through the Vertices of a Polytope

Beyond Discretization: Learning the Optimal Solution Path

PMBO: Enhancing Black-Box Optimization through Multivariate Polynomial Surrogates

Computing complete solution sets for approximate four-bar path synthesis

Progressively Strengthening and Tuning MIP Solvers for Reoptimization

Constrained multiobjective optimization of expensive black-box functions using a heuristic branch-and-bound approach

A PDE Framework of Consensus-Based Optimization for Objectives with Multiple Global Minimizers

Black-box Optimizers vs Taste Shocks

Proximal Policy Optimization Smoothed Algorithm

A Feasible Method for Optimization with Orthogonality Constraints

Solving Bilevel Optimization Problems Using Kriging Approximations

Versatile Black-Box Optimization

Tuning-Free Bilevel Optimization: New Algorithms and Convergence Analysis

A BFGS-SQP method for nonsmooth, nonconvex, constrained optimization and its evaluation using relative minimization profiles

Decomposition of Difficulties in Complex Optimization Problems Using a Bilevel Approach

A Primal-Dual Approach to Bilevel Optimization with Multiple Inner Minima