Abstract:In multi-task learning, a major challenge springs from a notorious issue known as negative transfer, which refers to the phenomenon that sharing the knowledge with dissimilar and hard tasks often results in a worsened performance. To circumvent this issue, we propose a novel multi-task learning method, which simultaneously learns latent task representations and a block-diagonal Latent Task Assignment Matrix (LTAM). Different from most of the previous work, pursuing the Block-Diagonal structure of LTAM (assigning latent tasks to output tasks) alleviates negative transfer via collaboratively grouping latent tasks and output tasks such that inter-group knowledge transfer and sharing is suppressed. This goal is challenging, since 1) our notion of Block-Diagonal Property extends the traditional notion for square matrices where the $i$-th column and the $i$-th column represents the same concept; 2) marginal constraints on rows and columns are also required for avoiding isolated latent/output tasks. Facing such challenges, we propose a novel regularizer by means of an equivalent spectral condition realizing this generalized block-diagonal property. Practically, we provide a relaxation scheme which improves the flexibility of the model. With the objective function given, we then propose an alternating optimization method, which not only tells how negative transfer is alleviated in our method but also reveals an interesting connection between our method and the optimal transport problem. Finally, the method is demonstrated on a simulation dataset, three real-world benchmark datasets and further applied to personalized attribute predictions.

Mitigate Negative Transfer with Similarity Heuristic Lifelong Prompt Tuning

Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer

On Transferability of Prompt Tuning for Natural Language Processing

Lifelong Learning Via Progressive Distillation And Retrospection

Loss-Balanced Task Weighting to Reduce Negative Transfer in Multi-Task Learning

Learning After Learning: Positive Backward Transfer in Continual Learning

Disentangling and Mitigating the Impact of Task Similarity for Continual Learning

Generalized Block-Diagonal Structure Pursuit: Learning Soft Latent Task Assignment Against Negative Transfer.

A Simple Lifelong Learning Approach

ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning

LIPT: Improving Prompt Tuning with Late Inception Reparameterization

Task Difficulty Aware Parameter Allocation & Regularization for Lifelong Learning

Multi-task Combinatorial Optimization: Adaptive Multi-modality Knowledge Transfer by an Explicit Inter-task Distance

Multi-modality Meets Re-learning: Mitigating Negative Transfer in Sequential Recommendation

Continual Learning in the Teacher-Student Setup: Impact of Task Similarity

Characterizing and Avoiding Negative Transfer

Reinforcement Learning Transfer Based on Subgoal Discovery and Subtask Similarity

Enhancing Few-Shot Transfer Learning with Optimized Multi-Task Prompt Tuning through Modular Prompt Composition

Enhanced Transfer Learning with Efficient Modeling and Adaptive Fusion of Knowledge Via Prompt Tuning

HUB: Guiding Learned Optimizers with Continuous Prompt Tuning

Solving many-task optimization problems via online intertask learning