Abstract:The cognitive ability to learn with experience is a hallmark of intelligent systems. The emerging transfer optimization paradigm pursues such human-like problem-solving prowess by leveraging useful information from various source tasks to enhance optimization efficiency on a related target task. The occurrence of harmful negative transfer is a key concern in this setting, paving the way for recent probabilistic model-based transfer evolutionary algorithms that curb this phenomenon. However, in applications where the source and target domains, i.e, the features of their respective search spaces (e.g., dimensionality) and the distribution of good solutions in those spaces, do not match, narrow focus on curbing negative effects can lead to the conservative cancellation of knowledge transfer. Taking this cue, this paper presents a novel perspective on domain adaptation in the context of evolutionary optimization, inducing positive transfers even in scenarios of source-target domain mismatch. Our first contribution is to establish a probabilistic formulation of domain adaptation, by which source and/or target tasks can be mapped to a common solution representation space in which their discrepancy is reduced. Secondly, a domain adaptive transfer evolutionary algorithm is proposed, supporting both offline construction and online data-driven learning of non-linear mapping functions. The performance of the algorithm is experimentally verified, demonstrating superior convergence rate in comparison to state-of-the-art baselines on synthetic benchmarks and a practical case study in multi-location inventory planning. Our results thus shed light on a new research direction for optimization algorithms that improve their efficacy by learning from heterogeneous experiential priors.

Insights on Transfer Optimization: Because Experience is the Best Teacher

Non-linear Domain Adaptation in Transfer Evolutionary Optimization

Knowledge transfer in evolutionary multi-task optimization: A survey

Transfer Learning for Bayesian Optimization: A Survey

Surrogate-Assisted Search with Competitive Knowledge Transfer for Expensive Optimization

Evolutionary Sequential Transfer Optimization for Objective-Heterogeneous Problems

An ensemble knowledge transfer framework for evolutionary multi-task optimization

Transferability in Deep Learning: A Survey

Learn to Optimize - A Brief Overview

Transferring knowledge from human-demonstration trajectories to reinforcement learning

Experience-based Optimization: A Coevolutionary Approach

An Effective Knowledge Transfer Approach for Multiobjective Multitasking Optimization

Bridging the Gap Between Theory and Practice: Benchmarking Transfer Evolutionary Optimization

Solving many-task optimization problems via online intertask learning

Evolutionary Transfer Optimization - A New Frontier in Evolutionary Computation Research

Attend, Adapt and Transfer: Attentive Deep Architecture for Adaptive Transfer from multiple sources in the same domain

Shaping in Reinforcement Learning Via Knowledge Transferred from Human-Demonstrations

Genetic Transfer or Population Diversification? Deciphering the Secret Ingredients of Evolutionary Multitask Optimization

Exploring Knowledge Transfer in Evolutionary Many-task Optimization: A Complex Network Perspective

A Data-Driven Evolutionary Transfer Optimization for Expensive Problems in Dynamic Environments

Teaching Networks to Solve Optimization Problems