Abstract:Dynamic environments pose great challenges for expensive optimization problems, as the objective functions of these problems change over time and thus require remarkable computational resources to track the optimal solutions. Although data-driven evolutionary optimization and Bayesian optimization (BO) approaches have shown promise in solving expensive optimization problems in static environments, the attempts to develop such approaches in dynamic environments remain rarely unexplored. In this paper, we propose a simple yet effective meta-learning-based optimization framework for solving expensive dynamic optimization problems. This framework is flexible, allowing any off-the-shelf continuously differentiable surrogate model to be used in a plug-in manner, either in data-driven evolutionary optimization or BO approaches. In particular, the framework consists of two unique components: 1) the meta-learning component, in which a gradient-based meta-learning approach is adopted to learn experience (effective model parameters) across different dynamics along the optimization process. 2) the adaptation component, where the learned experience (model parameters) is used as the initial parameters for fast adaptation in the dynamic environment based on few shot samples. By doing so, the optimization process is able to quickly initiate the search in a new environment within a strictly restricted computational budget. Experiments demonstrate the effectiveness of the proposed algorithm framework compared to several state-of-the-art algorithms on common benchmark test problems under different dynamic characteristics.

Efficient Meta Subspace Optimization

Subspace Methods for Nonlinear Optimization

Primal-Dual Sequential Subspace Optimization for Saddle-point Problems

Learning the subspace of variation for global optimization of functions with low effective dimension

Scalable Subspace Methods for Derivative-Free Nonlinear Least-Squares Optimization

Few-shot Multi-Task Learning of Linear Invariant Features with Meta Subspace Pursuit

Exploiting Active Subspaces in Global Optimization: How Complex is your Problem?

Memory-Efficient LLM Training with Online Subspace Descent

MetaOptimize: A Framework for Optimizing Step Sizes and Other Meta-parameters

Meta-Learning Parameterized First-Order Optimizers using Differentiable Convex Optimization

Space Net Optimization

Solving Expensive Optimization Problems in Dynamic Environments with Meta-learning

A prediction method for dynamic multiobjective optimization based on joint subspace and correlation alignment

Meta-Learning-Based Deep Reinforcement Learning for Multiobjective Optimization Problems

A General Two-Level Subspace Method for Nonlinear Optimization

Mixture-of-Subspaces in Low-Rank Adaptation

Efficiently Tackling Million-Dimensional Multiobjective Problems: A Direction Sampling and Fine-Tuning Approach

Subspace Quasi-Newton Method with Gradient Approximation

Landscape-Sketch-Step: An AI/ML-Based Metaheuristic for Surrogate Optimization Problems

Output Space Entropy Search Framework for Multi-Objective Bayesian Optimization

Randomized subspace gradient method for constrained optimization