Abstract:Evolutionary multitasking (EMT) is an emerging approach for solving multitask optimization problems (MTOPs) and has garnered considerable research interest. The implicit EMT is a significant research branch that utilizes evolution operators to enable knowledge transfer (KT) between tasks. However, current approaches in implicit EMT face challenges in adaptability, due to the use of a limited number of evolution operators and insufficient utilization of evolutionary states for performing KT. This results in suboptimal exploitation of implicit KT's potential to tackle a variety of MTOPs. To overcome these limitations, we propose a novel Learning to Transfer (L2T) framework to automatically discover efficient KT policies for the MTOPs at hand. Our framework conceptualizes the KT process as a learning agent's sequence of strategic decisions within the EMT process. We propose an action formulation for deciding when and how to transfer, a state representation with informative features of evolution states, a reward formulation concerning convergence and transfer efficiency gain, and the environment for the agent to interact with MTOPs. We employ an actor-critic network structure for the agent and learn it via proximal policy optimization. This learned agent can be integrated with various evolutionary algorithms, enhancing their ability to address a range of new MTOPs. Comprehensive empirical studies on both synthetic and real-world MTOPs, encompassing diverse inter-task relationships, function classes, and task distributions are conducted to validate the proposed L2T framework. The results show a marked improvement in the adaptability and performance of implicit EMT when solving a wide spectrum of unseen MTOPs.

Diffusion LMS for multitask problems with overlapping hypothesis subspaces

Multitask Diffusion Adaptation over Networks

Distributed Learning of Predictive Structures from Multiple Tasks over Networks

Distributed Jointly Sparse Multitask Learning over Networks

Online Distributed Learning over Graphs with Multitask Graph-Filter Models

Exact Subspace Diffusion for Decentralized Multitask Learning

Learning Task Grouping and Overlap in Multi-task Learning

Multitask Learning Over Graphs: An Approach for Distributed, Streaming Machine Learning

Learning over Multitask Graphs -- Part II: Performance Analysis

Distributed TLS over Multitask Networks with Adaptive Intertask Cooperation

Distributed Networked Multi-task Learning

Estimation of Space-Time Varying Parameters Using a Diffusion LMS Algorithm

Solving many-task optimization problems via online intertask learning

Online Parallel Multi-Task Relationship Learning via Alternating Direction Method of Multipliers

Parallel Learning by Multitasking Neural Networks

Eigenfunction-Based Multitask Learning in a Reproducing Kernel Hilbert Space.

Distributed Multi-Task Learning with Shared Representation

Sparse Overlapping Sets Lasso for Multitask Learning and its Application to fMRI Analysis

Flexible Multi-Task Learning with Latent Task Grouping.

Learning to Transfer for Evolutionary Multitasking

Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners