Abstract:The cognitive ability to learn with experience is a hallmark of intelligent systems. The emerging transfer optimization paradigm pursues such human-like problem-solving prowess by leveraging useful information from various source tasks to enhance optimization efficiency on a related target task. The occurrence of harmful negative transfer is a key concern in this setting, paving the way for recent probabilistic model-based transfer evolutionary algorithms that curb this phenomenon. However, in applications where the source and target domains, i.e, the features of their respective search spaces (e.g., dimensionality) and the distribution of good solutions in those spaces, do not match, narrow focus on curbing negative effects can lead to the conservative cancellation of knowledge transfer. Taking this cue, this paper presents a novel perspective on domain adaptation in the context of evolutionary optimization, inducing positive transfers even in scenarios of source-target domain mismatch. Our first contribution is to establish a probabilistic formulation of domain adaptation, by which source and/or target tasks can be mapped to a common solution representation space in which their discrepancy is reduced. Secondly, a domain adaptive transfer evolutionary algorithm is proposed, supporting both offline construction and online data-driven learning of non-linear mapping functions. The performance of the algorithm is experimentally verified, demonstrating superior convergence rate in comparison to state-of-the-art baselines on synthetic benchmarks and a practical case study in multi-location inventory planning. Our results thus shed light on a new research direction for optimization algorithms that improve their efficacy by learning from heterogeneous experiential priors.

Learning to Adapt to Evolving Domains.

Transfer Learning and Deep Domain Adaptation

Align and Adapt: A Two-stage Adaptation Framework for Unsupervised Domain Adaptation

Non-linear Domain Adaptation in Transfer Evolutionary Optimization

Hierarchical Domain Adaptation with Local Feature Patterns

Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification.

Learning explicitly transferable representations for domain adaptation

MetaAdapt: Domain Adaptive Few-Shot Misinformation Detection via Meta Learning

Progressive Conservative Adaptation for Evolving Target Domains

MetaComp: Learning to Adapt for Online Depth Completion

On-target Adaptation

Unsupervised Domain Adaptation: from Simulation Engine to the RealWorld

Complementary Domain Adaptation and Generalization for Unsupervised Continual Domain Shift Learning

Learning to Learn, from Transfer Learning to Domain Adaptation: A Unifying Perspective

Improving the Generalization of Meta-learning on Unseen Domains via Adversarial Shift

Progressive Domain Adaptation for Object Detection

Multicomponent Adversarial Domain Adaptation: A General Framework.

Joint Semantic Domain Alignment and Target Classifier Learning for Unsupervised Domain Adaptation

Knowledge Adaptation: Teaching to Adapt

DomainAdaptor: A Novel Approach to Test-time Adaptation

Domain-Invariant Adversarial Learning for Unsupervised Domain Adaption.