Abstract:Expensive optimization problems (EOPs) have attracted increasing research attention over the decades due to their ubiquity in a variety of practical applications. Despite many sophisticated surrogate-assisted evolutionary algorithms (SAEAs) that have been developed for solving such problems, most of them lack the ability to transfer knowledge from previously-solved tasks and always start their search from scratch, making them troubled by the notorious cold-start issue. A few preliminary studies that integrate transfer learning into SAEAs still face some issues, such as defective similarity quantification that is prone to underestimate promising knowledge, surrogate-dependency that makes the transfer methods not coherent with the state-of-the-art in SAEAs, etc. In light of the above, a plug and play competitive knowledge transfer method is proposed to boost various SAEAs in this paper. Specifically, both the optimized solutions from the source tasks and the promising solutions acquired by the target surrogate are treated as task-solving knowledge, enabling them to compete with each other to elect the winner for expensive evaluation, thus boosting the search speed on the target task. Moreover, the lower bound of the convergence gain brought by the knowledge competition is mathematically analyzed, which is expected to strengthen the theoretical foundation of sequential transfer optimization. Experimental studies conducted on a series of benchmark problems and a practical application from the petroleum industry verify the efficacy of the proposed method. The source code of the competitive knowledge transfer is available at <a class="link-external link-https" href="https://github.com/XmingHsueh/SAS-CKT" rel="external noopener nofollow">this https URL</a>.

A Surrogate-Assisted Evolutionary Algorithm with Knowledge Transfer for Expensive Multimodal Optimization Problems

Multisurrogate-Assisted Multitasking Particle Swarm Optimization for Expensive Multimodal Problems.

Multimodal Multiobjective Differential Evolution Algorithm Based on Enhanced Decision Space Search

Dual-Surrogate-Assisted Cooperative Particle Swarm Optimization for Expensive Multimodal Problems

A Surrogate-Assisted Evolutionary Algorithm for Seeking Multiple Solutions of Expensive Multimodal Optimization Problems

A Surrogate-Assisted Evolutionary Algorithm for Expensive Dynamic Multimodal Optimzation

Surrogate and Autoencoder-Assisted Multitask Particle Swarm Optimization for High-Dimensional Expensive Multimodal Problems

Objective-constraint Mutual-guided Surrogate-based Particle Swarm Optimization for Expensive Constrained Multimodal Problems

Multi-surrogate assisted PSO with adaptive speciation for expensive multimodal multi-objective optimization

Knowledge-Based Perturbation Laf-Cma-Es for Multimodal Optimization

An Ensemble Surrogate-based Framework for Expensive Multiobjective Evolutionary Optimization

Coevolutionary Framework for Generalized Multimodal Multi-Objective Optimization

A Kriging-Assisted Evolutionary Algorithm with Two-Stage Environmental Selection Strategy for Expensive Multimodal Multi-Objective Optimization

A differential evolution with adaptive neighborhood mutation and local search for multi-modal optimization

Multimodal multi-objective optimization with multi-stage-based evolutionary algorithm

A clustering-based surrogate-assisted evolutionary algorithm (CSMOEA) for expensive multi-objective optimization

Differential evolution based on strategy adaptation and deep reinforcement learning for multimodal optimization problems

Surrogate-Assisted Search with Competitive Knowledge Transfer for Expensive Optimization

Evolutionary Multimodal Optimization: A Short Survey

A dual surrogate assisted evolutionary algorithm based on parallel search for expensive multi/many-objective optimization

Adaptive Estimation Distribution Distributed Differential Evolution for Multimodal Optimization Problems